Skip to content
Research report
K-12 Education
Do the AZELLA Cut Scores Meet the Standards? A Validation Review of the Arizona English Language Learner Assessment
Ida Rose Florez
This is one of nine papers of the Arizona Educational Equity Project:  21 senior scholars and advanced graduate students from four major research universities joined together, under the aegis of the Civil Rights Project at UCLA, to produce the studies on the condition of English learner students in Arizona

Abstract:

The Arizona English Language Learners Assessment (AZELLA) is used by the Arizona Department of Education to determine which children should receive English support services. AZELLA results are used to determine if children are either proficient in English or have English language skills in one of four pre-proficient categories (pre-emergent, emergent, basic, intermediate). Children who test at or above the proficient cut score in English are placed in mainstream classes without English language support. Children who obtain scores below the proficient cut scores receive English language support services in state-mandated Structured English Immersion classes. Whenever tests are used to make high-stakes decisions, especially about vulnerable populations (e.g., children), it is the test developers’ responsibility to ensure the instrument yields fair and valid results. When cut scores are used as the primary interpretation of the test they are key to establishing the test’s validity. This validation study found that cut scores for the AZELLA are of questionable validity. The procedure used to set the cut scores is criticized by national measurement experts as ineffective and obsolete. Further, the test developers do not adequately establish the expertise of the judges used to set the cut scores. Evidence from the cut-score-setting process indicates judges did not come to consensus at the kindergarten level. Analysis of empirical evidence suggests cut scores over-identify kindergarten children and under-identify older children. Finally, the test developers rejected 85% of the cut scores recommended by the standard-setting judges, setting cut scores higher than recommended for kindergarten and lower than recommended for older children, without describing their process or rationale.

For more information on the series, view the Arizona Educational Equity Project Overview.
The Arizona Educational Equity Project grew from the class action lawsuit of Horne v. Flores, which was initially brought against the state of Arizona in 1992 on behalf of English language learners (ELLs) there. The case reached the U.S. Supreme Court, which issued a ruling on June 25, 2009, establishing new legal standards for the EEOA but also returning the case to the Federal District Court in Arizona, to examine Arizona’s instructional policies for ELLs.  The issues argued in the Arizona court had important implications for the educational rights of the tenth of U.S. students classified as ELL and for the federal law that protects them. The challenge to the research community was to provide the best possible information on how ELL students were faring under current Arizona educational policies. The Civil Rights Project spearheaded the Arizona Educational Equity Project to generate the most up-to-date research on the equality of educational opportunity for English learners.

 

In compliance with the UC Open Access Policy, this report has been made available on eScholarship:

http://escholarship.org/uc/item/8zk7x839

More about
Arizona Educational Equity Project

Stay Informed

Join our mailing list to receive updates on Civil Rights Project/Proyecto Derechos Civiles research, publications, and events.

Join the Mailing List

Get in Touch

UCLA | Civil Rights Project
520 Portola Plaza
8370 Math Sciences, Box 951521
Los Angeles, CA 90095-1521