Date of Award

1-1-2008

Document Type

Dissertation

Degree Name

Ph.D.

Department

Educational Administration and Policy Studies

First Advisor

Ellen Steiner

Keywords

English Language Learners, Plain Language, Universal Design

Abstract

Colorado assesses approximately 98% of students enrolled in grades 3&ndash10 in the area of mathematics. In 2005, 69,872 English Language Learners (ELLs) in grades 3&ndash10 participated in the state content area assessments. In 2007, 88,060 ELLs participated in the state content area assessments. With this dramatic growth in the ELL population in the state of Colorado and elsewhere in the nation, ensuring that ELLs have access to comprehensible materials on state assessments is of paramount importance. Accommodations provide access for students based on their individual needs. Likewise, assessment items designed and or revised using the principles of plain language and universal design increase access to the content area information in assessments. Colorado's work in plain language revision of Colorado Student Assessment Program (CSAP) items has been extensive.

Using statewide CSAP data for 2005 and 2007, this study examined how mathematics assessment items, once revised for plain language, performed compared to the original, unrevised version of the item. Access for English Language Learners was a focal point for this study. Plain language revision was evaluated for its effects on item difficulty, item discrimination, DIF and DOK.

DOK ratings from 2005 and 2007 were compared using Chi&ndashsqaure. One sample t&ndashtests were used to examine the differences in DIF and item difficulty (p&ndashvalue), as well as item discrimination for ELLs and Non&ndashELLs comparing the 2005 non&ndashrevised items with the 2007 revised items. Unrevised items were used as controls. Revised items were classified by type of linguistic change. Each type of change was examined using ANOVA to determine if a specific type of change effected differences in DIF and item difficulty.

While results indicate little if any difference in item performance at individual grade levels, overall LEP performance on revised items was higher than on non&ndashrevised items, a change in performance not present for non-ELLs. This may indicate that plain language revision continues to hold promise as a best practice for item development. As an accommodation, however, it appears that plain language revision alone may not be sufficient to ensure access to assessment items for ELLs.

Provenance

Recieved from ProQuest

Rights holder

Holly Elizabeth Baker

File size

163 p.

File format

application/pdf

Language

en

Discipline

Educational tests & measurements

Share

COinS