In this ITEMS module, we provide a two-part introduction to the topic of reliability from the perspective of "classical test theory" (CTT). In the first part, which is directed primarily at beginning learners, we review and build on the content presented in the original didactic ITEMS article by Traub and Rowley (1991). Specifically, we…

Computational thinking (CT) has been recognized as an essential part of every child's education (Wing, 2006) and Bebras contest items have been frequently used to measure CT. Think alouds has emerged as a prominent method for identifying thought processes and correcting problems with assessments. As little research has examined validity evidence…

Reliability is a measure of consistency. It is the degree to which student results are the same when they take the same test on different occasions, when different scorers score the same item or task, and when different but equivalent tests are taken at the same time or at different times. Reliability is about making sure that different test forms…

One of the questions with the longest history in educational assessment is whether it is possible to increase the reliability of a test simply by altering the way in which scores on individual test items are combined to make the overall test score. Most usually, the score available on each item is communicated to the candidate within a question…

This research reports learning strategies of the first-year Estonian university students in mathematics. The data were collected during two years from 440 university students of different disciplines. The respondents were among students who take at least one compulsory mathematics course during their first study year. The participants filled out a…

Social validity focuses on a program's goals, procedures, and outcome, which helps determine if an intervention is socially acceptable and valued. This study represents a conceptual replication of the investigation by Lane and colleagues (2009) regarding the psychometric properties of the Primary Intervention Rating Scale (PIRS), a teacher survey…

Metamemory can be defined as the knowledge about one's memory capabilities and about strategies that can aid memory. In this paper, we describe the development and validation of the Eyewitness Metamemory Scale (EMS), tailored specifically for use in face memory and eyewitness identification settings. Participants (N = 800) completed the EMS and…

The goal of this study is to determine the degree of leadership skills practiced by principals at UNRWA schools. In order to achieve this goal a questionnaire consisting of 56 items was developed, which included two domains: Administrative and Technical skills, and personal and social skills. This questionnaire had been verified in terms of its…

The purpose of the present study was to apply the methodology developed by Raykov on modeling item-specific variance for the measurement of internal consistency reliability with longitudinal data. Participants were a randomly selected sample of 500 individuals who took on a professional qualifications test in Saudi Arabia over four different…

This brief report presents preliminary psychometrics of responses to the Youth Externalizing Problems Screener (YEPS), which is a 10-item self-report rating scale intended for use as a screening instrument. The YEPS was designed to function as a companion measure to the Youth Internalizing Problems Screener (YIPS), facilitating the screening of…

This paper investigates the use of checklists to assess pragmatics in children and adolescents who are deaf and hard of hearing. A systematic literature review was undertaken to identify all of the published research articles between 1979 and 2018 on the topic of the assessment of pragmatics for this population of children and adolescents. The 67…

Teaching is a complex profession and feedback on teacher practices is needed for teachers' development. Many instruments are available to measure teacher practices, but little is known about their quality. This systematic review aimed to gain insight into the quality of instruments available to measure teacher practices. A systematic review based…

The ACRL "Framework for Information Literacy for Higher Education" has provided academic librarians a guiding document to facilitate the development of information literacy skills in students. Despite widespread adoption of the "Framework" in academic libraries, a lack of valid and reliable "Framework"-based scales…

This study was conducted to compare the functional movement patterns of female volleyball players from different countries. 34 the women's volleyball national team athletes from three different countries participated in the study; Turkey (n=9), Azerbaijan (n=16) and Kyrgyzstan (n=9). Functional movement screen of the athletes were determined by…

Academic expectations play a significant role in the quality of student adaptation and academic success. Previous research suggests that expectations are a multidimensional construct, making it crucial to test the measures used for this important characteristic. Because assessment of student adaptation to higher education comprises a multitude of…