Educators and policy makers in the United States have relied on tests to measure educational progress for more than 150 years, and have used the results for many purposes. They have tried minimum competency testing; portfolios; multiple-choice items, brief and extended constructed-response items; and more. They have contended with concerns about…

Uysal's article provides a research agenda for IELTS and lists numerous issues concerning the test's reliability and validity. She asks useful questions, but her analysis ignores the uncertainties inherent in all language test development and the wider social and political context of international high-stakes language testing. In this response, I…

This article examines how the use of automated scoring procedures for short-answer reading tasks can affect the constructs being assessed. In particular, it highlights ways in which the development of scoring algorithms intended to apply the criteria used by human raters can lead test developers to reexamine and even refine the constructs they…

Everyone knows what "good" teaching is. Or do they? Although the definition of a good teacher has evolved over time, teachers have consistently been seen as responsible for effecting change. According to the current value-added model, effective teaching is not framed in terms of the specific actions of the teacher, but in terms of students'…

This article describes a soil-testing activity that enables students to learn some interesting and useful things about how soil behaves under varied conditions. It offers a great way to give them a practical pre-engineering experience and will show them how engineers think about construction and how local soils influence building design. The…

Metacognition research has focused on the degree to which nonhuman primates share humans' capacity to monitor their cognitive processes. Convincing evidence now exists that monkeys can engage in metacognitive monitoring. By contrast, few studies have explored metacognitive control in monkeys, and the available evidence of metacognitive control…

The professional literature is filled with criticism of standardized testing, and the belief is that most teachers oppose standardized testing because it forces them to abandon creative lesson plans in exchange for test prep. However, a study of Arkansas teachers found that teachers also have positive views of testing. The teachers reported that…

Most experts in the testing community have presumed that the $350 million promised by the U.S. Department of Education to support common assessments would promote those that made greater use of open-ended items capable of measuring higher-order critical-thinking skills. But as measurement experts consider the multitude of possibilities for an…

In July 2009, an e-mail survey was sent to various UK universities to gain information regarding current practices concerning mathematics diagnostic testing, and to provide an update from the review "Diagnostic Testing for Mathematics" published by the LTSN MathsTEAM Project in 2003. A total of 38 university departments were contacted…

Our ability to identify even complex scenes in rapid serial visual presentation (RSVP) is astounding, but memory for such items seems lacking. Rather than pictures, we used streams of more than 200 verbal stimuli, rushing by on the screen at a rate of more than 12 items per second while participants had to detect infrequent names (Experiments 1…

A latent variable analysis procedure for evaluation of reliability coefficients for 2-level models is outlined. The method provides point and interval estimates of group means' reliability, overall reliability of means, and conditional reliability. In addition, the approach can be used to test simple hypotheses about these parameters. The…

An achievement test score can be viewed as a joint function of skill and will, of knowledge and motivation. However, when interpreting and using test scores, the "will" part is not always acknowledged and scores are mostly interpreted and used as pure measures of student knowledge. This paper argues that students' motivation to do their…

Metacognitions of agency were investigated using a computer task in which X's and O's streamed from the top of a computer screen, and the participants moved the mouse to get the cursor to touch the X's and avoid the O's. After each 15 s trial, participants made judgments of agency and judgments of performance. Objective control was either…

In this study participants were asked to describe pictured events in one type-written sentence, containing one of two different syntactic structures (subordinated vs. coordinated subject noun phrases). According to the hypothesis, the larger subordinated structure (one noun phrase including a second, subordinated, one) should be cognitively more…

Will subscores provide additional information than what is provided by the total score? Is there a method that can estimate more trustworthy subscores than observed subscores? To answer the first question, this study evaluated whether the true subscore was more accurately predicted by the observed subscore or total score. To answer the second…