Measurement of Online Student Engagement: Utilization of Continuous Online Student Behaviors as Items in a Partial Credit Rasch Model
Date of Award
Quantitative Research Methods
Kathy E. Green, Ph.D.
P. Bruce Uhrmacher
Achievement, Measurement, Online education, Rasch, Student engagement, Virtual education
Student engagement has been shown to be essential to the development of research-based best practices for K-12 education. It has been defined and measured in numerous ways. The purpose of this research study was to develop a measure of online student engagement for grades 3 through 8 using a partial credit Rasch model and validate the measure using confirmatory factor analysis. The dataset for this research study comprised approximately 20,000 online students in grades 3 through 8 from five different online schools. Two random samples of 10,000 students each were drawn for the measure development process and the validation of the measures created. For this research study student engagement was defined as a three-component manifestation of cognitive engagement, affective engagement, and behavioral engagement, which are required to achieve success as measured by normalized state assessments. This research study used tracked online student behaviors as items. Online student behavior items were converted from continuous to categorical after assessing indicator strength and possible inverted U relationship with academic achievement. The measure development and item categorization processes resulted in an online cognitive engagement measure and an online behavioral engagement measure for grades 3 through 8, with each grade having its own measure. All measures were validated using the second random sample of students and all but two (grades 4 and 5) were further validated by confirmatory factor analysis to be two factor models. Future research will include measure development specifically for students receiving special education services, comparing measures developed using the original continuous items without categorization, identification of facilitators of online student engagement for grades 3 through 8 and further evaluation of the relationship between online student engagement and academic achievement.
Copyright is held by the author. User is responsible for all copyright compliance.
Anderson, Elizabeth, "Measurement of Online Student Engagement: Utilization of Continuous Online Student Behaviors as Items in a Partial Credit Rasch Model" (2017). Electronic Theses and Dissertations. 1248.
Received from ProQuest
Educational Tests & Measurements, Statistics, Educational Technology