A slowdown or a speedup in response times across experimental conditions can be taken as evidence of online deployment of knowledge. However, response-time difference measures are rarely evaluated on their reliability, and there is no standard practice to estimate it. In this article, we used three open data sets to explore an approach to…

Purpose: There is little consensus in the literature regarding a) what it means for a school leader to lead with data, and b) how to measure data-informed leadership in a reliable and valid way. This study examines the psychometric properties of an operational measure intended to assess the extent to which a school leader is a data-informed school…

This three-paper dissertation systematically investigates the methodology issues related to using observational systems to observe, analyze, and interpret teachers' reformed teaching practices within the K-12 classroom context. Each paper contributes a distinct perspective to evaluate instructional practices accurately, consistently, and…

In this article, I respond to Noel Card's "Methodological Issues in Measuring the Development of Character." I focus on the ways in which social scientific knowledge represents human constructions of the world and the implications of this stance for the measurement of character. Further, I consider how context influences those…

In this article I provide an overview of the methodological issues involved in measuring constructs relevant to character development and education. I begin with a nontechnical overview of the 3 fundamental psychometric properties of measurement: reliability, validity, and equivalence. Developing and evaluating measures to ensure evidence of all 3…

Theoretically, reflection is known to be an essential skill for improving learning on a metacognitive level. In practice, students may not use it of their own accord to improve this kind of learning because it can be mentally demanding. The author reports on the legitimation of an instrument measuring self-induced self-reflective thinking, which…

Research links to positive student outcomes have highlighted the need to address disposition during teacher clinical practice using sound measures. Education preparation providers may use these indicators to create defensible measures of disposition by formatting the indicators into Likert scales or rubrics. Authors have extended the psychometric…

Although there is a common understanding of instructional sensitivity, it lacks a common operationalization. Various approaches have been proposed, some focusing on item responses, others on test scores. As approaches often do not produce consistent results, previous research has created the impression that approaches to instructional sensitivity…

This integrative literature review examines educational research that focuses on quantitative measurement of the construct of personal responsibility, in studies which included participants from middle childhood to young adulthood. National policies in education are increasingly concerned with values and skills that students develop through their…

This study determined psychometric properties of 3-ET, an instrument specifically designed to track the effects of a curriculum support intervention created to enhance the delivery of the national curriculum in a war zone in Uganda. The instrument was developed through brain storm and expert review before being committed to structural and…

The Locus-of-Hope Scale (LHS) was developed as a measure of the locus-of-hope dimensions (Bernardo, 2010). The present study adds to the emerging literature on locus-of-hope by assessing the psychometric properties of the LHS using Rasch analysis. The results from the Rasch analyses of the four subscales of LHS provided evidence on the…

Health education and behavior researchers and practitioners often develop, adapt, or adopt surveys/scales to quantify and measure cognitive, behavioral, emotional, and psychosocial characteristics. To ensure the integrity of data collected from these scales, it is vital that psychometric properties (i.e., validity and reliability) be assessed. The…

An important component of a student's science literacy is scale and concepts relating to scale including proportion and quantity. Measuring a student's scale concept has been examined using laboratory studies with one-on-one activities and interviews. However, classwide assessments to measure a student's scale concept have been…

The aim of this paper was to examine the validity and reliability of age band 1 of the Movement Assessment Battery for Children-Second Edition (MABC-2) in preparation for its standardization in mainland China. Interrater and test-retest reliability of the MABC-2 was estimated using Intraclass Correlation Coefficient (ICC). Cronbach's alpha for…

Student evaluations of teaching (SET) have been the principal instrument to elicit students' opinions in higher education institutions. Many decisions, including high-stake ones, are made based on SET scores reported by students. In this respect, reliability of SET scores is of considerable importance. This paper has an argument that there are…