Abstract: This investigation compares the effects of test mode, gender and race on paper-based versus computer-based delivery of two high stakes multiple-choice course examinations, Midterm and Final. Computer-literate students in upper-level business courses (n = 144) were randomly assigned to receive both tests either on paper or on computer. There were no significant gender effects, though males scored slightly higher than females on both tests. However, participants who received the tests on paper significantly outscored those who received the tests on computers, but this difference occurred only on the Midterm examination. Most striking, non-white females receiving the computer-based test mode scored lowest on the Midterm examination but then scored highest on the Final; all other groups maintained their relative positions from Midterm to Final. It was concluded that test mode familiarity does impact test performance. The results suggest that even computer-literate students in advanced Information Systems classes should practice using mock computer exams before taking high stakes computer-based tests, and that test mode familiarity affected non-white females most.

Keywords: Test mode, Information systems, Test familiarity, Computer-based testing, Gender, Race

Download this article: JISE - Volume 16 Number 2, Page 177.pdf

Recommended Citation: Wallace, P. & Clariana, R. B. (2005). Test Mode Familiarity and Performance - Gender and Race Comparisons of Test Scores among Computer-Literate Students in Advanced Information Systems Courses. Journal of Information Systems Education, 16(2), 177-182.