The population discrepancy between unstandardized and standardized reliability of homogeneous multicomponent measuring instruments is examined. Within a latent variable modeling framework, it is shown that the standardized reliability coefficient for unidimensional scales can be markedly higher than the corresponding unstandardized reliability…

This paper reports how I addressed the issue of extensive missing values in my PhD study, "Digital Competencies of High School Mathematics Teachers". I collected data using an online survey. Several methods exist to address the issue of missing values. I utilised multiple imputation (MI) as it provides more accurate results. The mean…

In educational research that calls itself empirical, the relationship between validity and reliability is that of trade-off: the stronger the bases for validity, the weaker the bases for reliability (and vice versa). Validity and reliability are widely regarded as basic criteria for evaluating research; however, there are ethical implications of…

The report of the national response to intervention (RTI) evaluation study, conducted during 2011-2012, was released in November 2015. Anyone who has read the lengthy report can attest to its complexity and the design used in the study. Both these factors can influence the interpretation of the results from this evaluation. In this commentary, we…

In the current article, we consider the influential position of the Programme for International Student Assessment (PISA) and discuss several methodological areas that demonstrate the need for caution when using and interpreting PISA results. We motivate our argument by briefly describing the program's increased influence in educational policy…

Research and scholarship into educational effectiveness research (EER) is comprehensively reviewed from the UK, The Netherlands, the US, Cyprus, Belgium, Sweden, France, Germany, New Zealand, Australia, and other societies, dating from the field's origins in the 1970s. Issues include its history, methodological and theoretical advances, scientific…

Literature shows that most researchers are unaware of some of the characteristics of reliability. This paper clarifies some misconceptions by describing the procedures, benefits, and limitations of reliability generalization while using it to illustrate the nature of score reliability. Reliability generalization (RG) is a meta-analytic method…

Classic parametric statistical significance tests, such as analysis of variance and least squares regression, are widely used by researchers in many disciplines, including psychology. For classic parametric tests to produce accurate results, the assumptions underlying them (e.g., normality and homoscedasticity) must be satisfied. These assumptions…

To determine if the observed correlation between two variables can be "explained" by a third variable, a significance test on the partial correlation coefficient is often used. This can be misleading when the third variable is measured with error. This article shows how the problem can be partially overcome. (Author/BW)

The clinical inquiry approach to classroom research is seen as a desirable alternative to traditional educational research methods. (LH)

Reviews 26 instruments developed to assess temperament at the infant, preschool, and school-age levels, giving particular attention to instrument content, standardization samples, reliability, and validity. It is concluded that, at present, no single psychometrically adequate instrument is available. Suggestions are made for future approaches to…

Learning styles advocates claim long-term improvements in four aspects of teaching and learning: curriculum design, instructional methods, assessment, and student guidance. The application of learning style theory encompasses three pervasive problems: confusion in definitions, weakness in measurement reliability and validity, and identification of…

Motivating students to perform well on assessment tests is difficult when students know the results have no academic consequence. The present study evaluates the influence of assessment context (graded vs. non-graded) on the reliability of an assessment measure. Results indicate the graded condition produces higher reliability (r = 0.71) than the…

The report of the National Academy of Education (NAE), "Setting Performance Standards for Student Achievement," provides an interpretation of NAE investigations into the procedures surrounding establishment of achievement levels for the National Assessment of Educational Progress (NAEP). The NAE report synthesizes the investigations of…

The National Academy of Education (NAE) Panel has drawn two major conclusions in its evaluation of the National Assessment Governing Board's (NAGB) efforts to set achievement levels for the National Assessment of Educational Progress (NAEP). They are that the Angoff procedure is fundamentally flawed for the setting of achievement levels, and that…