The promulgation of ESL learning standards by government agencies and professional organizations is intended to improve second-language (L2) proficiency and academic achievement. However, mandates have been criticized on various grounds, including difficulty of defining domains to be tested as well as vagueness of articulation. Arising from the…

"Conners 3rd Edition" is the most updated version of a series of measures for assessing attention deficit hyperactivity disorder (ADHD) and common comorbid problems/disorders in children and adolescents ranging from 6 to 18 years of age. Related problems that the test helps assess include executive dysfunction, learning problems, aggression, and…

Advances in natural language processing (NLP) and automatic speech recognition and processing technologies offer new opportunities for language testing. Despite their potential uses on a range of language test item types, relatively little work has been done in this area, and it is therefore not well understood by test developers, researchers or…

The objectives of this study were (a) to investigate whether items of the Chinese version of Beck Depression Inventory II (BDI-II-C; "Chinese Behavioral Science Corporation" in "Manual for the Beck Depression Inventory-II" [in Chinese]. The Chinese Behavioral Science Corporation, Taiwan, 2000) exhibited DIF across adolescent…

In the United States, students who are deaf or hard of hearing (SDHH) are required to participate in high-stakes standardized assessments under No Child Left Behind reforms. In 2006-2007, states added science to reading and mathematics as a tested content area. Many SDHH participate in these assessments using testing accommodations, but teachers…

After a test is developed, most content validation analyses shift from ascertaining domain definition to studying domain representation and relevance because the domain is assumed to be set once a test exists. We present an approach that allows for the examination of alternative domain structures based on extant test items. In our example based on…

There has been little data collected on how much testing actually goes on in America's schools and how the results are used. So in the Spring of 2014, the Council staff developed and launched a survey of assessment practices. This report presents the findings from that survey and subsequent Council analysis and review of the data. It also offers…

The purpose of this study was to examine Differential Item Functioning (DIF) by disability groups on an on-demand performance assessment for students with severe cognitive impairments. Researchers examined the presence of DIF for two comparisons. One comparison involved students with severe cognitive impairments who served as the reference group…

A quantitative observational study exploring the relationship of gender to mathematics self-efficacy and the frequency of back substitution in multiple-choice assessment sampled undergraduates at a western United States parochial university. Research questions addressed: to what extent are there gender differences in mathematics self-efficacy, as…

The attribute hierarchy method (AHM) is a psychometric procedure for classifying examinees' test item responses into a set of structured attribute patterns associated with different components from a cognitive model of task performance. Results from an AHM analysis yield information on examinees' cognitive strengths and weaknesses. Hence, the AHM…

"Mythbusters" uses multiple research methods to test interesting topics, offering research methods students an entertaining review of course material. To test the effectiveness of "Mythbusters" clips in a psychology research methods course, we systematically selected and showed 4 clips. Students answered questions about the clips, offered their…

This article proposes procedures for simultaneously assessing and controlling acquiescence and social desirability in questionnaire items. The procedures are based on a semi-restricted factor-analytic tridimensional model, and can be used with binary, graded-response, or more continuous items. We discuss procedures for fitting the model (item…

This article reports on a collaboration project between South Africa and Sweden, in which we want to investigate whether the emphasis in undergraduate mathematics courses for engineering students should be more conceptual than the current traditional way of teaching. On the basis of a review of the distinction between conceptual and procedural…

The development of phonological awareness (PA), the ability to reflect on the sound structure of words independent of their meaning, has been extensively explored in English-speaking children. However, this is not the case for other languages. The aim of this study was to develop a comprehensive PA test battery for German-speaking preschool…

A readily implemented procedure is discussed for interval estimation of indexes of interrelationship between items from multiple-component measuring instruments as well as between items and total composite scores. The method is applicable with categorical (ordinal) observed variables, and can be widely used in the process of scale construction,…