Date of Award

11-1-2008

Document Type

Dissertation

Degree Name

Ph.D.

Organizational Unit

Morgridge College of Education, Educational Leadership and Policy Studies

First Advisor

Ellen Steiner, Ph.D.

Second Advisor

Elinor Katz

Third Advisor

Roger Salters

Fourth Advisor

Kathy Green

Fifth Advisor

Dianne Lefly

Keywords

English language learners, Plain language, Universal design

Abstract

Colorado assesses approximately 98% of students enrolled in grades 3-10 in the area of mathematics. In 2005, 69,872 English Language Learners (ELLs) in grades 3-10 participated in the state content area assessments. In 2007, 88,060 ELLs participated in the state content area assessments. With this dramatic growth in the ELL population in the state of Colorado and elsewhere in the nation, ensuring that ELLs have access to comprehensible materials on state assessments is of paramount importance. Accommodations provide access for students based on their individual needs. Likewise, assessment items designed and/or revised using the principles of plain language and universal design increase access to the content area information in assessments. Colorado’s work in plain language revision of Colorado Student Assessment Program (CSAP) items has been extensive.

Using statewide CSAP data for 2005 and 2007, this study examined how mathematics assessment items, once revised for plain language, performed compared to the original, unrevised version of the item. Access for English Language Learners was a focal point for this study. Plain language revision was evaluated for its effects on item difficulty, item discrimination, DIF and DOK.

DOK ratings from 2005 and 2007 were compared using Chi-sqaure. One sample t-tests were used to examine the differences in DIF and item difficulty (p-value), as well as item discrimination for ELLs and Non-ELLs comparing the 2005 non-revised items with the 2007 revised items. Unrevised items were used as controls. Revised items were classified by type of linguistic change. Each type of change was examined using ANOVA to determine if a specific type of change effected differences in DIF and item difficulty.

While results indicate little if any difference in item performance at individual grade levels, overall LEP performance on revised items was higher than on non-revised items, a change in performance not present for non-ELLs. This may indicate that plain language revision continues to hold promise as a best practice for item development. As an accommodation, however, it appears that plain language revision alone may not be sufficient to ensure access to assessment items for ELLs.

Publication Statement

Copyright is held by the author. User is responsible for all copyright compliance.

Rights Holder

Holly E. Baker

Provenance

Received from ProQuest

File Format

application/pdf

Language

en

File Size

163 p.

Discipline

Educational tests & measurements

Download



Share

COinS