Back
CenterLine

comparability

Educational Assessment Remote Testing comparability school disruptions Assessment COVID-19 Response

One-Sided “Advice” on Remote Test Administration Isn’t Fair to States

Acknowledging the Lack of Evidence that Remote Testing Can Measure Up to In-Person Testing

A recent article in Forbes Magazine by Jim Cowen painted an irresponsibly rosy picture of remote test administration. The two organizations that coordinated the interviews on which the article was based, The Collaborative for Student Success and EducationCounsel, have been unabashed in their advocacy for returning to state summative testing in spring 2021.

read more

School Disruption Remote Testing comparability Validity COVID-19 Response Assessment

Test Score Meaning Under Remote Test Administration

Part 2: Mode or Accommodation? A Framework for Thinking about Remote Administration

This is the second in a series of three posts on planning for the examination of the validity of scores collected through remote test administration. In the first post, Michelle Boyer and Leslie Keng laid out the reasons why states should be concerned about the effect of remote testing on the comparability of score meaning. In the third post in this series, we will discuss specific challenges to score interpretations for remotely-administered tests.  

read more

school disruptions Remote Testing comparability Validity Assessment COVID-19 Response

Test Score Meaning Under Remote Test Administration

Part 1: Why Validity is Threatened under Remote Administration Conditions

This is the first in a series of three posts on planning for the examination of the validity of scores collected through remote test administration. Next up is a discussion of a framework for the types of analyses that will be useful for understanding the degree to which scores are comparable between remotely tested students and students tested in the classroom, what might be done to adjust them if they are not, and the conditions under which data can be collected to support those analyses.

read more

Educational Assessment comparability Validity

Comparability of Scores on the Same Test

In 2018, the Center was honored to be invited by the National Academy of Education to contribute two chapters to the book Comparability of Large-Scale Educational Assessments, which was released earlier this year. The Center’s chapters addressed the foundational issues surrounding the comparability of individual and aggregate group scores when students ostensibly take the same test.

read more

Standard Setting performance standards standards validation comparability Assessment

Re-envisioning Performance Standards Validation

Taking a Principled Approach to Evaluating Reporting Scales and Performance Standards when Modifications are Made to Assessments

For a variety of reasons—political, psychometric and practical—states are often required to modify their large-scale summative assessments. These changes may be significant, such as developing new assessments after the adoption of revised academic content standards, or minor, such as adding a couple items to an existing test blueprint. 

read more