This document contains the written version of the presidential address delivered by Charlie DePascale at the 47th annual conference of the Northeastern Educational Research Association (NERA). The address presents seven challenges that we face as an assessment and measurement community in defining, evaluating, and communicating about validity as it relates to our tests, testing programs, and accountability systems. The discussion of the challenges is followed by five suggestions on where we can go from here.