Dynamic structural equation models (DSEM) are designed for time series analysis of latent structures. Inherent to the application of DSEM is model parameter estimation, which has to be addressed in many applications by a single time series. In this context, however, the methods currently available either lack estimation quality or are…

During the transition period between the use of exclusively old SAT® scores and the use of exclusively new SAT scores, college admission offices will be receiving both types of scores from students. Making an admission decision based on new SAT scores can be challenging at first because institutions have methods, procedures, and models based on…

We study the properties of two specification tests that have been applied to a variety of estimators in the context of value-added measures (VAMs) of teacher and school quality: the Hausman test for choosing between random and fixed effects and a test for feedback (sometimes called a "falsification test"). We discuss theoretical…

The annual Student Outcomes Survey collects information on the outcomes of two groups of students--those that have completed a qualification (graduates) and those that have completed only part of a course and then left the vocational education and training (VET) system (module completers). At the time of selecting the survey sample, insufficient…

The purpose of the recently proposed "p[subscript rep]" statistic is to estimate the probability of concurrence, that is, the probability that a replicate experiment yields an effect of the same sign (Killeen, 2005a). The influential journal "Psychological Science" endorses "p[subscript rep]" and recommends its use…

This research examined whether the SAT and ACT would predict college grade point average (GPA) after removing g from the tests. SAT and ACT scores and freshman GPAs were obtained from a university sample (N=161) and the 1997 National Longitudinal Study of Youth (N=8984). Structural equation modeling was used to examine relationships among g, GPA,…

In textbooks, foreign (second) language reading proficiency is often evaluated through comprehension questions. In case, authentic texts are used as reading material, such questions should be prepared by teachers. However, preparing appropriate questions may be a very demanding task for teachers. This paper introduces a method for automatically…

A key strength of latent curve analysis (LCA) is the ability to model individual variability in rates of change as a function of 1 or more explanatory variables. The measurement of time plays a critical role because the explanatory variables multiplicatively interact with time in the prediction of the repeated measures. However, this interaction…

Various classical approaches to evaluating test bias are reviewed, and their conceptual underpinnings are discussed. Bias is examined as it relates to predictive validity, rather than construct validity. One of the first test bias models was developed by T. A. Cleary (1968). Cleary's work with test bias and regression stimulated others to develop…

Mounting pressure in the policy arena to improve teacher productivity either by improving signals that predict teacher performance or through creating incentive contracts based on performance--has spurred two related questions: Are there important determinants of teacher productivity that are not captured by teacher credentials but that can be…

The problem of finding a meaningful way of demonstrating the benefit or satisfaction to be gained by using predictive assessment techniques to select or place individuals in work situations is explored. The urgent need of developing nations for appropriate occupational and educational selection procedures is presented and explained. A discussion…

Tests the inferential approach to the study of competence evaluation and a series of complicating factors relevant to it by having participants with known implicit theories judge an observed communicator on a set of competence-relevant characteristics and on overall competence. Finds inferential models predicted these judgments well. (MS)

The literature on validity provides much more guidance on how to collect various kinds of validity evidence than it does on which kinds of evidence to collect in specific cases. An argument-based approach to validation redresses the balance by linking the kinds of evidence needed to validate a test-score interpretation to the details of the…

The development of new statistical methods of log-linear models by Leo Goodman has led to major advances in the statistical analysis of categorical data. Goodman's logit analysis, (the simplest form of log-linear models) can be applied in evaluation studies to estimate the "main effects" and "interaction effects" of categorical…

A tailored testing model employing the beta distribution, whose mean equals the difficulty of an item and whose variance is approximately equal to the sampling variance of the item difficulty, and employing conditional item difficulties, is proposed. (Author)