The use of large-scale assessments (LSAs) in education has grown in the past decade though analysis of LSAs using multilevel models (MLMs) using R has been limited. A reason for its limited use may be due to the complexity of incorporating both plausible values and weighted analyses in the multilevel analyses of LSA data. We provide additional…

This review aimed to identify measurement tools to assess dietary intake and physical activity (PA) among individuals with autism spectrum disorder (ASD) and describe the evidence of validity and availability of each tool. Searches were conducted in PubMed, Embase, CINAHL, and PsycINFO using keywords for ASD, PA, diet, and assessment/measurement…

Measurement is significant in geospatial thinking research. This study evaluated the geospatial thinking of pre-service geography teachers through an orienteering design tasks and subjective evaluation methods. Moreover, it analyzed their level of geospatial thinking, difficulty of evaluation indicators and rater severity with the Many-Faceted…

The process of privatising services historically provided by the state has blurred the boundaries between what is considered to be 'private' and 'public'. However, few efforts have been made in the educational arena to develop tools to measure this process. Most of the previous research has relied on narrow definitions about what is private and…

Confirmatory factor analyses (CFA) are often used in psychological research when developing measurement models for psychological constructs. Evaluating CFA model fit can be quite challenging, as tests for exact model fit may focus on negligible deviances, while fit indices cannot be interpreted absolutely without specifying thresholds or cutoffs.…

Educational research outcomes frequently rely on an assumption that measurement metrics have interval-level properties. While most investigators know enough to be suspicious of interval-level claims, and in some cases even question their findings given such doubts, there is a lack of understanding regarding the measurement conditions that create…

This article, located in the discipline of academic literacy studies, draws upon the fields of critical realism, design research, and evaluation studies. It reports on the validation of a flexible evaluation design for assessing the impact of academic literacy interventions. The design was validated in two ways. Firstly, through a process of…

Diagnostic classification models (DCMs) have grown in popularity as stakeholders increasingly desire actionable information related to students' skill competencies. Longitudinal DCMs offer a psychometric framework for providing estimates of students' proficiency status transitions over time. For both cross-sectional and longitudinal DCMs, it is…

Back random responding (BRR) behavior is one of the commonly observed careless response behaviors. Accurately detecting BRR behavior can improve test validities. Yu and Cheng (2019) showed that the change point analysis (CPA) procedure based on weighted residual (CPA-WR) performed well in detecting BRR. Compared with the CPA procedure, the…

The purpose of this research was to create a Culture of Assessment Instrument (Appendix F) that will allow education program provider (EPP) assessment leaders to measure the assessment culture within their program. General Systems Theory was the theoretical framework as the foundation of this research. Using a modified Delphi panel of assessment…

Predictive student models are increasingly used in learning environments due to their ability to enhance educational outcomes and support stakeholders in making informed decisions. However, predictive models can be biased and produce unfair outcomes, leading to potential discrimination against certain individuals and harmful long-term…

Educators everywhere are responding to the realities of student learning loss, unfinished learning, or disrupted learning as they continue to experience the lasting impact of the COVID-19 pandemic. Students of color and students attending high poverty schools experienced the largest achievement declines, increasing preexisting gaps for already…

In an increasingly data-driven society, making decisions with data is a requirement not only for research scientists but also for navigating life more generally (Kjelvik & Schultheis, 2019). An informed citizenry must be prepared to discover patterns, predict outcomes, make decisions with data, and evaluate data-based claims for legitimacy and…

Although a large variety of methodologies, contexts and perspectives have been used to examine educational application of technology, there is a paucity of instruments that are designed to comprehensively evaluate the use of technology in education. This paper presents a Confirmatory Factor Analysis (CFA) of an instrument that incorporates eight…

The challenges and possibilities for improvement may vary across the three levels of an assessment system--classroom assessment, school or district assessment, and state-level accountability assessment. In this brief, the discussion of the challenges and possibilities focuses on these three levels and on two forms of assessment--formative and…