Background: Item response times in computerized assessments are frequently used to identify rapid guessing behaviour as a manifestation of response disengagement. However, non-rapid responses (i.e., with longer response times) are not necessarily engaged, which means that response-time-based procedures could overlook disengaged responses.…

This study investigated test-taking engagement on the Spring 2019 administration of a large-scale state summative assessment. Through the identification of rapid-guessing behavior -- which is a validated indicator of disengagement -- the percentage of Grade 8 test events with meaningful amounts of rapid guessing was 5.5% in mathematics, 6.7% in…

The appropriateness of guess and check as a problem-solving strategy has been debated. This qualitative study examines the use of guess and check by middle-grades students to solve linear systems of equations. Students' reasoning is examined within the number sequences framework, which is based in part on students' units coordination. Only…

Scores from computer-based tests are increasingly used to inform a variety of school- and student-level decisions. An underlying assumption is that the associated scores represent effortful responding by each student with respect to the tasks presented. An innovative method for examining evidence for this assumption involves an examination of item…

Fifth-grade students watched a short video and then responded to multiple-choice items, including several without correct answers. Based on computer-supported stimulated recall and semi-structured interviews, we tested three common assumptions about what students are thinking when they respond to multiple-choice items in spite of being uncertain…

Educational stakeholders have long known that students might not be fully engaged when taking an achievement test and that such disengagement could undermine the inferences drawn from observed scores. Thanks to the growing prevalence of computer-based tests and the new forms of metadata they produce, researchers have developed and validated…

In achievement testing we assume that students will demonstrate their maximum performance as they encounter test items. Sometimes, however, student performance can decline during a test event, which implies that the test score does not represent maximum performance. This study describes a method for identifying significant performance decline and…

The purpose of this research is to develop a vocabulary assessment, Evaluation of Academic Vocabulary or "EAV," that gauges students' depth of knowledge of academic words and is sensitive to vocabulary growth in the context of literacy interventions. We report results from two studies with native English-speaking middle school students…

The purpose of this research is to develop a vocabulary assessment, Evaluation of Academic Vocabulary or "EAV," that gauges students' depth of knowledge of academic words and is sensitive to vocabulary growth in the context of literacy interventions. We report results from two studies with native English-speaking middle school students…

This study adopted a quasi-experimental design with follow-up interview to develop a computer-based two-tier assessment (CBA) regarding the science topic of electric circuits and to evaluate the diagnostic power of the assessment. Three assessment formats (i.e., paper-and-pencil, static computer-based, and dynamic computer-based tests) using…

The present study has two aims. Firstly, it aims to determine eighth grade students' conceptual understanding of floating and sinking through formative assessment probes. Secondly, it aims to determine whether or not there is a significant difference between students' performance in formative assessment probes and their achievement in the…

The present study has two aims. Firstly, it aims to determine eighth grade students' conceptual understanding of floating and sinking through formative assessment probes. Secondly, it aims to determine whether or not there is a significant difference between students' performance in formative assessment probes and their achievement in the…

Interest is growing at the precollege level in computer testing (CT) instead of paper-and-pencil testing (PT) for subjects in the school curriculum, including economics. Before economic educators adopt CT, a better understanding of its likely effects on test-taking behavior and performance compared with PT is needed. Using two volunteer student…

Educational systems throughout the world serve students from diverse populations. Often students from minority populations (i.e. racial, ethnic, linguistic, cultural, economic) face unique challenges when learning in contexts based on the cultural traditions and learning theories of the majority population. These challenges often leave minority…

The National Council of Teachers of Mathematics (NCTM) Algebra Standard states that instructional programs at the middle grades should enable students to "represent and analyze mathematical situations and structures using algebraic symbols" (2000, p. 222). Guess and check is a powerful problem-solving strategy that can connect a conceptual…