The present study used process data from a computer-based problem-solving task as indications of behavioural level of test-taking effort, and explored how behavioural item-level effort related to overall test performance and self-reported effort. Variables were extracted from raw process data and clustered. Four distinct clusters were obtained and…

The purpose of this study is to evaluate the performance of CATSIB (Computer Adaptive Testing-Simultaneous Item Bias Test) for detecting differential item functioning (DIF) when items in the matching and studied subtest are administered adaptively in the context of a realistic multi-stage adaptive test (MST). MST was simulated using a 4-item…

The purpose of this study was to examine the role of achievement goals in online test anxiety and help-seeking while controlling for self-efficacy and potential demographic differences. A total of 150 online students participated in the survey. Separate hierarchical regression analysis results suggested the differential roles of achievement goals…

If classification in a limited number of categories is the purpose of testing, computerized adaptive tests (CATs) with algorithms based on sequential statistical testing perform better than estimation-based CATs (e.g., Eggen & Straetmans, 2000). In these computerized classification tests (CCTs), the Sequential Probability Ratio Test (SPRT) (Wald,…

This study's goal was to quantify the effects pre-lecture online quizzes and student-initiated inquiries to the instructor, either virtually or in person, had on students' achievement. Pre- and post-course tests were also implemented to an experimental and a comparison section of the same course. The number of electronic administrative contacts…

Web-based student evaluations of clinical faculty were collected over an 8-year period. There were 19,881 medical student evaluations over the 8-year period for all clinical clerkships, representing a total of 952 faculty. Students used a 5-point Likert scale to rate the teaching effectiveness of faculty. Criterion-based methods and standard…

This paper reviews the literature on comparing online and paper course evaluations in higher education and provides a case study of a very large randomised trial on the topic. It presents a mixed but generally optimistic picture of online course evaluations with respect to response rates, what they indicate, and how to increase them. The paper…

This article investigates if online evaluation leads to different results than paper-and-pencil evaluation. Given that most previous studies confound the evaluation mode (online versus paper) with the evaluation situation (in class versus after class), we expected that evaluation results would be influenced only by the evaluation situation,…

This paper describes a study comparing paper-based marking (PBM) and onscreen marking (OSM) in Hong Kong utilising English language essay scripts drawn from the live 2007 Hong Kong Certificate of Education Examination (HKCEE) Year 11 English Language Writing Paper. In the study, 30 raters from the 2007 HKCEE Writing Paper marked on paper 100…