Application of Bayesian item selection criteria in computerized adaptive testing might result in improvement of bias and MSE of the ability estimates. The question remains how to apply Bayesian item selection criteria in the context of constrained adaptive testing, where large numbers of specifications have to be taken into account in the item…

This article examines how the use of automated scoring procedures for short-answer reading tasks can affect the constructs being assessed. In particular, it highlights ways in which the development of scoring algorithms intended to apply the criteria used by human raters can lead test developers to reexamine and even refine the constructs they…

Our ability to identify even complex scenes in rapid serial visual presentation (RSVP) is astounding, but memory for such items seems lacking. Rather than pictures, we used streams of more than 200 verbal stimuli, rushing by on the screen at a rate of more than 12 items per second while participants had to detect infrequent names (Experiments 1…

Current interest in measuring quality of life is generating interest in the construction of computerized adaptive tests (CATs) with Likert-type items. Calibration of an item bank for use in CAT requires collecting responses to a large number of candidate items. However, the number is usually too large to administer to each subject in the…

Metacognitions of agency were investigated using a computer task in which X's and O's streamed from the top of a computer screen, and the participants moved the mouse to get the cursor to touch the X's and avoid the O's. After each 15 s trial, participants made judgments of agency and judgments of performance. Objective control was either…

The use of timed, essay examinations is a well-established means of evaluating student learning in higher education. The reliability of essay scoring is highly problematic and it appears that essay examination grades are highly dependent on language and organisational components of writing. Computer-assisted scoring of essays makes use of language…

Temporal patterns of behavior have been observed in real-life performances such as bill passing in the U.S. Congress, in-class studying, and quiz taking. However, the practical utility of understanding these patterns has not been evaluated. The current study demonstrated the presence of temporal patterns of quiz taking in a university-level…

Aim: The purpose of this study was to characterize handwriting deficits in children with developmental coordination disorder (DCD) using computerized movement analyses. Method: Seventy-two children (40 females, 32 males; mean age 7y, SD 7mo; range 6y 2mo to 7y 11mo) with handwriting deficits (33 with DCD, 39 without DCD); and 22 age- and…

The standard evaluation forms used in most college and university courses are ill suited to assess courses and instructors whose goals and pedagogy differ significantly from the "chalk and talk" approach to undergraduate instruction. This article discusses an evaluation form that the author, a professor emeritus of economics at the…

Web-based standard setting holds promise for reducing the travel and logistical inconveniences of traditional, face-to-face standard setting meetings. However, because there are few published reports of setting standards via remote meeting technology, little is known about the practical potential of the approach, including technical feasibility of…

The action research study described in this report outlines the design and implementation of a unit of blended instruction in a traditional high school English classroom. Twenty technical high school students in an 11th grade Honors English class engaged in a variety of internet-based activities in conjunction with traditional learning activities…

In teacher education programmes, text-based portfolios are generally used to assess student-teachers' competence as new teachers. However, striking discrepancies are known to exist between the competencies reflected in a written portfolio and the competencies observed in actual classroom practice. Multiple assessments should be used to provide a…

With the advancement of information and communication technology, collaboration and knowledge sharing through technology is facilitated which enhances the learning process and improves the learning efficiency. The purpose of this paper is to review the methods of assessment and strategy of collaboration and knowledge sharing in a computer course,…

Through the Common Core State Standards and the development of new assessments aligned to the standards, the public education system is undergoing a transformation--and administrators can help make this vision a reality. Today, more than 45 states and the District of Columbia have adopted the Common Core State Standards. The standards, however,…

Beginning with the No Child Left Behind federal legislation, states were required to use data to monitor and improve student achievement. For high schools, the Missouri Department of Elementary and Secondary Education chose End of Course Exams (EOC) to demonstrate levels of student achievement. The policy changed from school choice of paper-pencil…