It is shown that the Angoff and bookmarking cut scores are examples of true score equating that in the real world must be applied to observed scores. In the context of defining minimal competency, the percentage "failed" by such methods is a function of the length of the measuring instrument. It is argued that this length is largely…

There is often confusion about distinctions between growth models and value-added models. The first half of this paper attempts to dispel some of these confusions by clarifying terminology and illustrating by example how the results from a large-scale assessment can and will be used to make inferences about student growth and the value-added…

Issues of equity and fairness across subgroups of the population (e.g., gender or ethnicity) must be seriously considered in any standardized testing program. For this reason, many testing programs require some means for assessing test characteristics, such as reliability, for subgroups of the population. However, often only small sample sizes are…

Measurements of social constructs that evaluate natural hazard preparedness are important to decrease natural hazard vulnerability. Preparedness reduces natural hazard impacts and human vulnerability. Investment in education and education research contribute to human sustainable development and natural hazard preparedness. Faced with other needs,…

The present report demonstrates the difference between classical test theory (CTT) and item response theory (IRT) approach using an actual test data for chemistry junior high school students. The CTT and IRT were compared across two samples and two forms of test on their item difficulty, internal consistency, and measurement errors. The specific…

Examinees who take high-stakes assessments are usually given an opportunity to repeat the test if they are unsuccessful on their initial attempt. To prevent examinees from obtaining unfair score increases by memorizing the content of specific test items, testing agencies usually assign a different test form to repeat examinees. The use of multiple…

Introduction: The objective was to develop and psychometrically evaluate (feasibility, reliability, validity) a questionnaire-based multisource feedback (MSF) system for quality improvement (QI) for occupational therapists (OTs). Methods: Surveys were developed for assessment of OTs by clients, co-workers, and themselves, respectively, using…

The Center on Education Policy (CEP) report, "Has Progress Been Made in Raising Achievement for English Language Learners?", finds that some states have seen increases in the number of English language learners (ELLs) meeting proficiency standards under No Child Left Behind (NCLB), while others have seen decreases. The report notes some…

In large-scale assessments, such as state-wide testing programs, national sample-based assessments, and international comparative studies, there are many steps involved in the measurement and reporting of student achievement. There are always sources of inaccuracies in each of the steps. It is of interest to identify the source and magnitude of…

In a series of publications, the author and his colleagues have obtained scores from students in higher education on different questionnaires, and they have described the relationships among these scores using the statistic known as Wilks' [lambda]. Burt (2005) has criticized that the use of this measure is inappropriate, arguing (1) that the…

When there exist omitted effects, measurement error, and/or simultaneity in multilevel models, explanatory variables may be correlated with random components, and standard estimation methods do not provide consistent estimates of model parameters. This paper introduces estimators that are consistent under such conditions. By employing generalized…

This study examined the efficacy of 4 different parceling methods for modeling categorical data with 2, 3, and 4 categories and with normal, moderately nonnormal, and severely nonnormal distributions. The parceling methods investigated were isolated parceling in which items were parceled with other items sharing the same source of variance, and…

This article presents the results of an evaluation study in Physical Education (PE) in which 23 schools, 49 classes and 1142 year 4 Cypriot students participated. This study attempted to identify the extent to which a theoretical framework of educational effectiveness research based on Creemers' model can be developed. The relationship between…

This study linked nonlinear profile analysis (NPA) of dichotomous responses with an existing family of item response theory models and generalized latent variable models (GLVM). The NPA method offers several benefits over previous internal profile analysis methods: (a) NPA is estimated with maximum likelihood in a GLVM framework rather than…

If students are to understand inferential statistics successfully, they must have a profound understanding of the nature of the sampling distribution. Specifically, they must comprehend the determination of the expected value and standard error of a sampling distribution as well as the meaning of the central limit theorem. Many students in a high…