The 2010 Reidy Interactive Lecture Series focused on the challenges of challenges of conducting appropriate technical evaluations of next generation assessment system. Current psychometric and technical approaches were designed largely to evaluate standardized summative assessments. Applying these techniques and criteria to a mix of assessment types, especially those that include significant amount of performance tasks and innovative item types, will likely under-represent the quality of these assessment systems. The speakers at the 2010 RILS outlined these challenges—focused around validity, reliability, and utility—and offered practical approaches for addressing technical evaluations of next generation comprehensive assessment systems.
Balanced Assessment Systems: Implications for Technical Quality Evaluations
Brian Gong, Center for Assessment
Theories of action as a tool for explicating policy goals and intended uses of assessments
Scott Marion, Center for Assessment