Sample size and statistical power are important factors to consider when planning a research synthesis. Power analysis methods have been developed for fixed effect or random effects models, but until recently these methods were limited to simple data structures with a single, independent effect per study. Recent work has provided power…

Alternative approaches are discussed for use of e-rater[R] to score the TOEFL iBT[R] Writing test. These approaches involve alternate criteria. In the 1st approach, the predicted variable is the expected rater score of the examinee's 2 essays. In the 2nd approach, the predicted variable is the expected rater score of 2 essay responses by the…

There is a growing recognition of the value of measuring fidelity of implementation (FOI) as a necessary part of evaluating interventions. However, evaluators do not have a shared conceptual understanding of what FOI is and how to measure it. Thus, the creation of FOI measures is typically a secondary focus and based on specific contexts and…

In a provocative and influential paper, Jesse Rothstein (2010) finds that standard value added models (VAMs) suggest implausible future teacher effects on past student achievement, a finding that obviously cannot be viewed as causal. This is the basis of a falsification test (the Rothstein falsification test) that appears to indicate bias in VAM…

This article describes why measurement invariance is a critical issue to quantitative theory building within the field of human resource development. Readers will learn what measurement invariance is and how to test for its presence using techniques that are accessible to applied researchers. Using data from a LibQUAL+[TM] study of user…

This paper developed a Democratic Classroom Survey to measure students' perceived democratic environment of the classroom. Perceived democratic environment is one of the most important variables for understanding classroom activity and indeed any type of group activity, but actually measuring perceptions in an objective manner has been…

The primary goals of this project were to develop a reliable instrument to measure the chemistry course perceptions (CCP) of undergraduate chemistry students and to determine the predictors of CCP of undergraduate students as they enter their first college chemistry class. In a pilot study, 250 undergraduate students were solicited with 57…

This note describes a procedure for estimating the range restriction component used in correcting correlations for unreliability and range restriction when an estimate of the reliability of a predictor is not readily available for the unrestricted sample. This procedure is illustrated with a few examples. (Contains 1 table.)

This study documents the initial reliability and validity of the Child Suicide Risk Assessment (CSRA) for children under the age of 13. The revised CSRA retained 18 of 20 original items based on item-specific psychometric data from 140 pre-adolescents in out-of-home treatment programs. The CSRA demonstrated adequate internal consistency (alpha =…

The article presents a psychometric description of 11 statements related to use of physical violence. The items were tested in a normal sample (N=1700, age: 15-16) from urban and rural areas in Western Norway. The internal reliability was @a=0.86, and the factor analysis resulted in two factors. Boys had higher mean scores than girls.…

Documenting treatment integrity is an important issue in research and practice in any discipline concerned with prevention and intervention. However, consensus concerning the dimensions of treatment integrity and how they should be measured has yet to emerge. Advances from three areas in which significant treatment integrity work has taken…

The various costs of Type I and Type II errors of inference from data are discussed. Six methods for minimizing each error type are presented, which may be employed even after data collection for Type I and which minimizes Type II errors by a study design and analytical means combination. (Author/CM)

Addresses the validity of the Cognitive-Affective Response Test-Music by clarifying the theoretical assertions on which the construct validity of the instrument rests. Presents nine specific assertions and data from two studies. Concludes that the test is valid for college-bound high school students. (CFR)

Uses the various strategies involved in baseball to illustrate basic concepts in game theory. Specifically discusses Willie Mays' base-stealing strategy and how it relates to probability and risk. Reminds students that expected results depend on adopted assumptions. (MJP)

Statistically based risk assessment devices are widely used in criminal justice settings. Their promise remains largely unfulfilled, however, because assumptions and premises requisite to their development and application are routinely ignored and/or violated. This article provides a brief review of the most salient of these assumptions and…