This article considers the claim that machine scoring of writing test responses agrees with human readers as much as humans agree with other humans. These claims about the reliability of machine scoring of writing are usually based on specific and constrained writing tasks, and there is reason for asking whether machine scoring of writing requires…

Research on the predictors of 3 bully status groups (bullies, victims, and bully victims) for school-age children and adolescents was synthesized using meta-analytic procedures. The primary purpose was to determine the relative strength of individual and contextual predictors to identify targets for prevention and intervention. Age and how…

Imposed time limits on computer adaptive tests (CATs) can result in examinees having difficulty completing all items, thus compromising the validity and reliability of ability estimates. In this study, the effects of speededness were explored in a simulated CAT environment by varying examinee response patterns to end-of-test items. Expectedly,…

Objective: This is perhaps the first outcome study on the efficacy of ADHD coaching for adults with ADHD and its long-term effect. Method: Forty-five adults (30 women, 15 men) rated 22 areas of concern before and after the coaching experience. Factor analysis of the 22 areas of concern revealed five factors. Descriptive statistics and…

This investigation examined the listening comprehension (LC) performance of two groups of adolescent struggling readers, one group with word-finding difficulties (WFD) and one with no word-finding difficulties (NWFD). Of interest was whether the expressive language difficulties of the WFD group would interfere with their success on a LC assessment…

A questionnaire used in student evaluations of interdisciplinary courses during six semesters contained two Likert items stated in a direct negative mode which were embedded in a questionnaire (14-18 items) in which the remaining items were phrased in a direct positive mode. In the seventh semester and thereafter, the two negative items were…

Objectives: To develop a comprehensive inventory of state physical education (PE) legislation, examine trends in bill introduction, and compare bill factors. Methods: State PE legislation from January 2001 to July 2007 was identified using a legislative database. Analysis included components of evidence-based school PE from the Community Guide and…

This study is an evaluation of the psychometric issues associated with estimating objective level scores, often referred to as "subscores." The article begins by introducing the concepts of reliability and validity for subscores from statewide achievement tests. These issues are discussed with reference to popular scaling techniques, classical…

The authors aimed to propose a valid and reliable diagnostic instrument by developing a three-tier test on simple electric circuits. Based on findings from the interviews, open-ended questions, and the related literature, the test was developed and administered to 124 high school students. In addition to some qualitative techniques for…

This study aimed to develop and validate the Attitudes towards Socioscientific Issues Scale (ATSIS) for undergraduate students. In the first step, data were collected from 160 undergraduate students from the departments of science education and elementary education to provide validity of the scale. In light of the results of an exploratory factor…

This study aims to develop and apply a rubric to evaluate the solutions of pre-service primary science teachers to questions about Newton's Laws of Motion. Two groups were taught the topic using the same teaching methods and administered four questions before and after teaching. Furthermore, 76 students in the experiment group were instructed…

The purpose of this study was to develop a valid and reliable tool for measuring the quality of the language and literacy environment in home-based settings. Based on a convergence of research on the ecological and psychological factors associated with early literacy development, the Child/Home Environmental Language and Literacy Observation…

The ability to identify children who require specialist assessment for the possibility of autism at as early an age as possible has become a growing area of research. A number of measures have been developed as potential screening tools for autism. The reliability and validity of one of these measures for screening for autism in young children…

In 2006, C. F. Bond Jr. and B. M. DePaulo provided a meta-analysis of means and concluded that average lie detection accuracy was significantly greater than chance for most people. Now, they have presented an analysis of standard deviations (C. F. Bond Jr. & B. M. DePaulo, 2008), claiming that there are no reliable individual differences in lie…

The worst performance rule for cognitive tasks [Coyle, T.R. (2003). IQ, the worst performance rule, and Spearman's law: A reanalysis and extension. "Intelligence," 31, 567-587] in which reaction time is measured is the result that IQ scores correlate better with longer (i.e., 0.7 and 0.9 quantile) reaction times than shorter (i.e., 0.1 and 0.3…