This rubric was developed for the analysis of intervention programs against the criteria of implementing the four recommendations and accompanying action steps presented in the IES Practice Guide "Providing Reading Interventions for Students in Grades 4-9" for the Adolescent Literacy Intervention Selection Tool (A-LIST). Each item in…

Despite the increasing interest in using AI tools as assistant agents in instructional settings, the effectiveness of ChatGPT, the generative pretrained AI, for evaluating the accuracy of second language (L2) writing has been largely unexplored in formative assessment. Therefore, the current study aims to examine how ChatGPT, as an evaluator,…

The purpose of this research is to determine the competencies and difficulties experienced by science teachers in developing, using, and scoring rubrics. For this purpose, the descriptive survey model was used in the research. This study was conducted with 71 science teachers working in 12 different provinces of Turkey. The availability sampling…

This booklet is a conceptual introduction to item response theory (IRT), which many large-scale testing programs use for constructing and scoring their tests. Although IRT is essentially mathematical, the approach here is nonmathematical, in order to serve as an introduction on the topic for people who want to understand why IRT is used and what…

Grades serve as one of the primary indicators of student learning, directing subsequent actions for students, instructors, and administrators, alike. Therefore, grade validity--that is, the extent to which grades communicate a meaningful and credible representation of what they purport to measure--is of utmost importance. However, a grade cannot…

California's Commission on Teacher Credentialing (Commission) requires all programs of preliminary multiple and single subject teacher preparation to use a Commission-approved Teaching Performance Assessment (TPA) as one of the program completion requirements for prospective teacher candidates. Three TPA models were approved by the Commission: (1)…

Conducting valid and reliable empirical research in the prevention sciences is an inherently difficult and challenging task. Chief among these is the need to obtain numerical scores of underlying theoretical constructs for use in subsequent analysis. This challenge is further exacerbated by the increasingly common need to consider multiple…

This study presents a scaffold approach to building critical academic writing skills among honors students. Faced with limited instructional time, a reading-intensive curriculum, and students in need of rigorous writing instruction, a scaffold model was developed to include a series of condensed writing assignments called "Close Reading…

This paper provides a meta-analytic update on the relationship between intelligence and divergent thinking (DT), as research on this topic has increased, and methods have diversified since Kim's meta-analysis in 2005. A three-level meta-analysis was used to analyze 849 correlation coefficients from 112 studies with an overall N = 34,610. The…

The use of mixed-format tests made up of multiple-choice (MC) items and constructed response (CR) items is popular in large-scale testing programs, including the National Assessment of Educational Progress (NAEP) and many district- and state-level assessments in the United States. Rater effects, or raters' scoring tendencies that result in…

Higher professional education aims to prepare students for professional practice, for which students will need to develop conceptual understanding. Conceptual understanding requires a synthesis of relevant facts, theories and practices. This research explores what types of change take place in students' conceptual understanding during a bachelor…

In evaluating the learning achievement of programming-thinking skills, the method of using a rubric that describes evaluation items and evaluation stages is widely employed. However, few studies have evaluated the reliability, validity, and consistency of the rubrics themselves. In this study, we introduced a statistical method for evaluating the…

This article proposes a class of cognitive diagnosis models (CDMs) for polytomously scored items with different link functions. Many existing polytomous CDMs can be considered as special cases of the proposed class of polytomous CDMs. Simulation studies were carried out to investigate the feasibility of the proposed CDMs and the performance of…

The aim of this study was to develop a rubric as a measurement tool for experiential educators and with this purpose, we investigated a group of the participants on it. Assessing whether the experiential training process follows all four steps of the experiential learning cycle and determining correct or incorrect applications of the experiential…

Originality is scored based on standard zero-originality lists (ZOLs) in the Torrance Tests of Creative Thinking (TTCT). The applicability of those ZOLs to diverse groups has not been examined. We examined the consistency of TTCT-Figural's sample-based (SB) ZOLs and the published ZOLs based on a sample of predominantly African American college…