Comparing Student Performance on Standardized Tests at Test Center versus through Online-Proctored Delivery

Authors: Jin Koo

Abstract:

The main purpose of this study is to investigate the comparability of student scores obtained from Test Center (TC) vs. Online-Proctored (OP) Delivery in the three subject areas of Verbal, Reading, and Mathematics for each level (Middle and Upper). Also, this study examines whether there is an interaction effect between test deliveries (TC vs. OP) and gender/ethnicity/ability level in each subject area. The test used in this study is a multiple-choice standardized test for students in grades 5-11. For this study, data were collected during the 2022-23 test administration. This research used a one-factor between-subjects ANOVA and Cohen’s d to compare the TC and OP groups’ test means for each level and each subject area. Also, 2-factor between-subjects ANOVAs were conducted to investigate examinee characteristics: gender (male and female), ethnicity (African-American, Asian, Hispanic, Multi-racial, and White), and ability level (low, average, and high-ability groups). The author found that students’ test scores in some subject areas varied between TC and OP test deliveries by gender, ethnicity, and ability level, meaning that gender, ethnicity, and ability level were related to the score difference. These results will be discussed according to the current testing systems.

Keywords: ability level, ethnicity, gender, online-proctored delivery, standardized test, test center