Without a doubt, the public is skeptical about using machine scoring for examinees’ written responses. This skepticism makes sense because we know that machines do not score all elements of writing equally well. Machines do not “understand” creativity, irony, humor, allegory, and other literary techniques, opening them to criticism for their insufficiency in evaluating some of these more subtle qualities of writing. 

I was an early supporter and promoter of the Innovative Assessment Demonstration Authority (IADA) under the Every Student Succeeds Act (ESSA), but I now have serious doubts about the viability of the IADA and its ability to support deep and meaningful educational reform.