This is the first in a three-part series on the future of large-scale state assessment and accountability. Of course, it is impossible to know the future, but forecasts for educational assessment can be informed by examining what has shaped state assessment and accountability in the past. In this post, I look at the role played by emerging operational capacities and the desire for efficiency – specifically computer-based assessment.  

Here at the National Center for the Improvement of Educational Assessment, we think a lot about the multiple factors involved in promoting student learning through more meaningful state assessment and accountability systems. The Every Student Succeeds Act (ESSA), the current authorization of the 1965 Elementary and Secondary Education Act (ESEA), is the most significant influence on contemporary state assessment and accountability.  We believe a number of changes to ESEA could help promote innovation, restore balance, and improve outcomes.

Can we call “analysis” by another name and expect educators to teach students to analyze, and expect students to demonstrate analysis in a text-dependent analysis response? Is the word “analysis” interchangeable with other words, or does its meaning matter in defining expectations for student performance? 

In the famous line from Shakespeare’s Romeo and Juliet, Juliet says  “What’s in a name? That which we call a rose by any other name would smell as sweet.”  

Testing experts know a lot about how to conduct scoring of students’ written responses to assessment items. Raters are trained under strict protocols to follow scoring rules accurately and consistently. To verify that raters did their job well, we use a few basic score quality measures that center on how well two or more raters agree. These measures of agreement are called inter-rater reliability (IRR) statistics, and they are widely used, perhaps in part because they are easy to understand and apply. 

As 2019 drew to a close I had the chance to reflect on the conversations I've had with many of my colleagues throughout the year, and one topic of conversation that sticks out to me is frustration about the minimal value-add of work focused on large scale assessment and state-level accountability systems to the student experience. 

Developing a Better Understanding the Role of Assessment and Accountability in Improving Student Outcomes

In his CenterLine post, Can Educational Assessment Improve Teaching?, Executive Director Scott Marion invited readers to share their thoughts on the complex, but critical issue of identifying ways that assessments can be used to improve teaching quality. In this guest post, we share Kadie Wilson’s response to Scott’s invitation. Kadie Wilson is Assistant Superintendent in New Hampshire School Administrative Unit #9.

The end of the decade signified the end of an era here at the Center for Assessment; Charlie DePascale officially retired on December 31, 2019, after more than 17 years as a Senior Associate. 

In considering a decade of large-scale state assessment, I’m reminded of a moment in June 2010. while attending the Council of Chief State School Officers (CCSSO) National Conference on Student Assessment (NCSA) in Detroit, Michigan, I was part of a crowd gathered in the hotel lounge watching the U.S. Men’s National  Team (USMNT) play a World Cup soccer match against Algeria.  

Depending on your slant, you probably have a favorite among the many sayings around the kinds of things that come in threes. Some people focus on the belief that tragedies occur in threes. I prefer to focus on how some of the best things come in threes:

1. Freud’s id, ego, and superego
2. The three books in Tolkien’s Lord of the Rings series
3. The 90s hit teen pop sensation Hanson 

Okay, some might argue with the three Hanson brothers – how about The Jimi Hendrix Experience instead? 

How would I design an assessment or assessment system if my goal was to improve teaching? My colleagues, Chris Domaleski and Leslie Keng, and I met recently with state assessment leaders who are thinking about reforming their assessment system.