The Programme for the International Assessment of Adult Competencies (PIAAC) assesses key skills in literacy, numeracy and problem-solving in technology-rich environments, as well as their relationship to other social outcomes for adults. PIAAC's developers claimed to better account for adults' literacy practices than earlier international studies…

In this digital ITEMS module, Dr. Jacqueline Leighton and Dr. Blair Lehman review differences between think-aloud interviews to measure problem-solving processes and cognitive labs to measure comprehension processes. Learners are introduced to historical, theoretical, and procedural differences between these methods and how to use and analyze…

A procedure for evaluation of validity related coefficients and their differences is discussed, which is applicable when one or more frequently used assumptions in empirical educational, behavioral and social research are violated. The method is developed within the framework of the latent variable modeling methodology and accomplishes point and…

This study aimed to design a measurement tool for measuring the therapeutic alliance skills of the experts providing psychological counseling services. For the preliminary validity and reliability study of the Therapeutic Alliance Scale, 224 people working as psychological counselors were reached. After the preparation of the data for analysis and…

Rigorous evidence identification is essential for systematic reviews and meta-analyses (evidence syntheses) because the sample selection of relevant studies determines a review's outcome, validity, and explanatory power. Yet, the search systems allowing access to this evidence provide varying levels of precision, recall, and reproducibility and…

Research Findings: This study explores the variations in paternal play beliefs and the relation to young children's developmental outcomes in a sample of 163 Chinese fathers of 3-year-olds (M = 38.73 months, SD = 4.91) in Shenzhen, China. The fathers completed the Chinese Parent Play Beliefs Scale (CPPBS) to report their attitudes towards play and…

This study aims to describe how subjects construct explicit warrant derived from implicit warrant when completing mathematical proof. This research was conducted on seventeen students of mathematics education study programs by providing tests on vector material in elementary linear algebra courses. The test results show that there are four…

The Cambridge Digital Mocks Service offers on-screen assessments created by transferring paper-based (PB) exams into a digital test platform. This feasibility project considered the validity of extending the Digital Mocks Service to maths and science qualifications, thinking about (1) the outcomes that are likely when maths and science items are…

Background: The Language Development Survey (LDS) and the MacArthur-Bates Communicative Development Inventories (MB-CDI) are two parental report forms that have been productive in providing data on early child language during the past 30 years. The instruments have been used both in studies relating to typical developing children and in screening…

Argumentation plays a significant role in science as a scientific practice in which knowledge is constructed, evaluated, and modified. Scientific argumentation (SA) is thus a promising activity for students to pursue in order to think and act like scientists and to enhance their understanding of science. Considering the impact that assessments…

Despite the importance of evolution to understand biology, there is significant evidence that many biology teachers have difficulties to successfully teach this topic. The purpose of this study is to describe procedures by which a paper-and-pencil instrument to assess teachers' pedagogical content knowledge for evolution (PCK[subscript evo]) was…

Background: The reciprocal internal/external frame of reference (RI/E) combines two models of academic self-concept formation, namely the reciprocal effects model (REM) and the internal/external frame of reference (I/E) model. The REM assumes reciprocal relations between achievement and academic self-concept. The I/E model assumes contrast effects…

Single-case design has a long history of use for assessing intervention effectiveness for children with disabilities. Although these designs have been widely employed for more than 50 years, recent years have been especially dynamic in terms of growth in the use of single-case design and application of standards designed to improve the validity…

In this study, the Maker Competency Instrument (MCI) was developed to diagnose the level of Maker Competence of elementary and secondary students in South Korea. First, in this study, a draft of the test tool was adapted based on the Maker Competency Model developed as part of Yoon et al.'s research (2018). Then, two expert-level Delphi surveys…

Biology instructors use concept assessments in their courses to gauge student understanding of important disciplinary ideas. Instructors can choose to administer concept assessments based on participation (i.e., lower stakes) or the correctness of responses (i.e., higher stakes), and students can complete the assessment in an in-class or…