This study investigated the ability of test takers' behaviors during online assessments to detect probable cheating incidents. Specifically, this study focused on the role of time delay and head pose for detection of cheating incidences in a lab-based online testing session. The analysis of a test taker's behavior indicated that not only time…

This study examined the effectiveness and influence on validity of a computer-based pop-up English glossary accommodation for English learners (ELs) in grades 3 and 7. In a randomized controlled trial, we administered pop-up English glossaries with audio to students taking a statewide accountability English language arts (ELA) and mathematics…

This article explores the question of excessive testing in public schools, its value in the educational process, and the impact that excessive testing may have on the student and the family unit. While assessments are valuable when used properly, excessive testing may lead to problems with unforeseen consequences.

Because of the continuing debates about statistics, many researchers may feel confused about how to analyze and interpret data. Current guidelines in psychology advocate the use of effect sizes and confidence intervals (CIs). However, researchers may be unsure about how to extract effect sizes from factorial designs. Contrast analysis is helpful…

Originally an editorial for "English in Education," this short article summarises key issues in the imposition of a separate test for grammar, punctuation and spelling. It illustrates the poor foundations, lack of clarity and distortion of curriculum which invalidate the test.

In Andrew Maul's focus paper "Rethinking Traditional Methods of Survey Validation'" published in this issue of "Measurement: Interdisciplinary Research and Perspectives," Maul contends that self-report measures may be particularly difficult to validate. He cautions that such techniques may fall short of providing the kinds of…

Competence data from low-stakes educational large-scale assessment studies allow for evaluating relationships between competencies and other variables. The impact of item-level nonresponse has not been investigated with regard to statistics that determine the size of these relationships (e.g., correlations, regression coefficients). Classical…

Confidence in our memories is influenced by many factors, including beliefs about the perceptibility or memorability of certain kinds of objects and events, as well as knowledge about our skill sets, habits, and experiences. Notoriously, our knowledge and beliefs about memory can lead us astray, causing us to be overly confident in eyewitness…

The digital world brings with it more and more opportunities to be innovative around assessment. With a variety of digital tools and the pervasive availability of information anywhere anytime, there is a tremendous capacity to creatively employ a diversity of assessment approaches to support and evaluate student learning in higher education. The…

Test-taking is an integral part of students' lives, and the way they approach tests may be of high relevance for their academic outcomes. Therefore, the present study addressed the way college students reflect on the process of preparing for tests. Specifically, it investigated the relevance of students' achievement goals, perceived academic…

In this report we provide preliminary evidence on the measurement characteristics for a new type of teaching performance assessment designed to be combined with complementary assessments of teacher content knowledge. The resulting test, which we refer to as the Foundational Assessment of Competencies for Teaching (FACT), is designed for use as…

Stopping rules for fixed-form tests with graduated item difficulty are intended to stop administration of a test at the point where students are sufficiently unlikely to provide a correct response following a pattern of incorrect responses. Although widely employed in fixed-form tests in education, little research has been done to empirically…

Due to the complex and integrative nature of translation competence construct, its free of subjectivity assessment is considered quite a challenging task for modern translation pedagogy. The conducted literature review revealed diverse directions and opportunities to raise translation competence assessment objectivity. In this key, there is a need…

The present study used process data from a computer-based problem-solving task as indications of behavioural level of test-taking effort, and explored how behavioural item-level effort related to overall test performance and self-reported effort. Variables were extracted from raw process data and clustered. Four distinct clusters were obtained and…

In this study, we suggest combining the monitoring of actual examination time used with grades in order to assess examination time extensions in terms of access provision and expected outcome. Using naturally-occurring data collected from a large sample (N = 2315) of undergraduate engineering students, we argue that extended examination time may…