2021 Reidy Interactive Lecture Series: Design Innovation in Educational Assessment Systems

Join us as we step back and address how states can employ lessons from design thinking as they attempt to create innovative assessment systems this year for RILS 2021 virtual conference.

View Session Details and Register

image

The Burden of Proof: A Call for Validation Plans and Evidence in Educational Programs

Educational policy makers, program designers, and intervention developers typically identify a problem and propose a solution to that problem. Likely, they have a lot of experience and expertise that informs the design of the solution to that problem–but how do they know the assessment design achieved the intended outcomes? 

When it comes to educational assessment systems, we should be asking ourselves two key questions: 

image

How Much is Enough? 

Many schools have turned to competency-based education for meeting both equity and excellence goals. Competency-based education requires students to demonstrate mastery of key knowledge and skills rather than merely meeting some passing score “on average.” 

Local assessment data are often used to evaluate student mastery of identified competencies. There are many measurement challenges that arise when using assessments to support decisions about students’ competence. This blog focuses on one—sufficiency.

image

When It Comes to Getting Summative Information from Interim Assessments, You Can’t Have Your Cake and Eat It Too

Nathan Dadey, Associate, Center for Assessment

“You can’t have your cake and eat it too,” is a well-known idiom. In the case of educational measurement, it reflects the dilemma posed by a requirement for a single, summative score, and might read something like: “you can’t get summative scores for accountability purposes without the secure administration of carefully constructed forms in a defined window.”

image

Improving accountability: Where do we go from here?

By Chris Domaleski, Damian Betebenner, and Susan Lyons

In recent years, assessment and accountability have become charged terms to many. In fact, school accountability systems, influenced by results from standardized achievement tests, are among the most contentious aspects of contemporary education policy. 

But how did we get here–and where do we go? This ambitious topic is one of several we are poised to tackle at the Center’s annual Reidy Interactive Lecture Series (RILS) on September 27-28, 2018. 

image

Data in Schools­–Understanding What it is, How it’s Used, and How We Can Improve

Discussions of data use in schools often lead to two commonly heard refrains:  

  1. “Educators are drowning in an ocean of data”
  2. “Schools are a data desert”

When a situation is characterized by such polar opposite viewpoints, it is a signal that there are fundamental challenges that must be understood and overcome. In this case, if there are data in schools, why aren’t those data being used effectively (or at all) by teachers to support their instructional decision-making? What are the challenges?

image

A Tricky Balance: The Challenges and Opportunities of Balanced Systems of Assessment

The seminal publication, Knowing What Students Know: The Science and Design of Educational Assessment (NRC, 2001), crystalised the call for balanced systems of assessment. Yet almost 20 years have passed and there are very few examples of well-functioning systems, particularly systems that incorporate state summative tests.  Why? In spite of recent efforts to articulate principles of assessment systems, creating balanced assessment systems is really hard!  

 

image

The Center at NCSA 2018

State assessment teams, assessment industry staff, and other assessment specialists gather each June at the CCSSO National Conference on Student Assessment.  Historically, the annual conference provides an opportunity for the Center team and our partners to share innovative solutions and our latest thinking on the most pressing assessment and accountability issues of the day. This year, seven Center team members participated in eleven sessions over the three-day conference: Chris Domaleski, Carla Evans, Brian Gong, Leslie Keng, Erika Landl, Scott Marion, and Joseph Martineau

image

The Center at 20: Reliability of No Child Left Behind Accountability Designs

This is the first in a series of posts highlighting key pieces of work from the Center’s first twenty years.  Each post will feature a document, set of tools, or body of work in areas such as large-scale assessment, accountability systems, growth, educator evaluation, learning progressions, and assessment systems. In keeping with the Center’s 20th anniversary theme, Leveraging the Lessons of the Past, our goal is to apply the lessons learned from this past work to help us improve assessment and accountability practices for the future.

image

When it Comes to School Ratings, Meaning Matters

Letter grades are a popular way to describe performance. I’m referring to those same letter grades you received in school - A to F.  We all know that the coveted A is “superb,” and an F warns that performance is completely deficient. What’s a C?  Perhaps it is used to communicate “good enough” (but not great), or possibly it means “average.” Should we worry that those are often two different things?  

image

A Look Back and a Look Ahead After 20 Years of Assessment and Accountability Work

It’s been 20 years, and everyone at The Center for Assessment is excited to celebrate this milestone anniversary with a very special Reidy Interactive Lecture Series (RILS). 

New & Noteworthy

Henry Braun
Incoming Chair of the Center’s Board of Trustees, Dr. Henry Braun, just received the prestigious E.F. Lindquist Award from the American Educational…

Read More

Recent Centerline Blog Posts

image

Why Have Many (All?) Approaches to Improve K-12 Educator Assessment Literacy Failed to Produce Significant Changes in Teacher Practices at Scale?

Most of us would agree that if the problem of improving K-12 educator assessment literacy has not been solved, it is not because of a lack of trying. A quick search of books with “assessment literacy” in the title, or a more general search for books on formative assessment or classroom assessment, returns many excellent resources written by esteemed researchers, practitioners, and scholars.

image

Using Assessment to Support Learning Acceleration: It Takes a System! 

The Oklahoma State Department of Education’s (OSDE) highest priority is keeping students and staff safe so that we can focus on learning acceleration for all students. We are also intensely focused on how assessment can be used to help address these instructional and learning needs.  To this end, in this post, I discuss the importance of a balanced system of assessment and of being very intentional about the specific purposes and uses of types of assessment within that system, especially those intended to be used to support student learning and improved instruction. 

image

Addressing the Accountability Challenge of Missing Data With A Performance Profile

In a previous post I discussed the challenges of rebuilding accountability systems developed for the Every Student Succeeds Act (ESSA) in 2021-2022. Prominent among these challenges is missing data due to multiple years of pandemic-related disruptions. What are the best alternatives to solve this problem? In this post I’ll suggest a tool, the performance profile, that may help address the issue of partially missing data.