The current study investigates Talk Aloud Problem Solving (TAPS) for master's level students at Endicott College in preparation for the Behavior Analysis Certification Board (BACB) exam. The exam format of multiple-choice questions was used as the basis for acquisition and utilization of a TAPS skill repertoire. The purpose was to add to the…

In educational tests, a group of questions related to a shared stimulus is called a testlet (e.g., a reading passage with multiple related questions). Use of testlets is very common in educational tests. Additionally, computerized adaptive testing (CAT) is a mode of testing where the test forms are created in real time tailoring to the test…

One of the diagnostic tests which is very valuable and used in education frequently is two-tier test. Two-tier tests are used for different purposes such as determining misconceptions, determining the comprehension level of students and etc.. Due to the wide and effective uses of two-tier tests, there are different studies in which two-tier tests…

The purpose of this study was to investigate a new way of evaluating interrater reliability that can allow one to determine if two raters differ with respect to their rating on a polytomous rating scale or constructed response item. Specifically, differential item functioning (DIF) analyses were used to assess interrater reliability and compared…

The purpose of this study was to compare the quality of multiple choice questions (MCQs) developed using automated item generation (AIG) versus traditional methods, as judged by a panel of experts. The quality of MCQs developed using two methods (i.e., AIG or traditional) was evaluated by a panel of content experts in a blinded study. Participants…

Alternate assessments based on alternate achievement standards (AA-AAS) have historically lacked broad validity evidence and an overall evaluation of the extent to which evidence supports intended uses of results. An expanding body of validation literature, the funding of two AA-AAS consortia, and advances in computer-based assessment have…

This document provides advice on moving from in-place, closed-book examinations to open-book, remote assessment. It offers conceptual considerations, practical tips, and discusses the relative merits of two common approaches to open-book exams: those with strict time limits, and those with broad time limits ('take-home' exams).

New Meridian Corporation has developed the "Quality Testing Standards and Criteria for Comparability Claims" (QTS). The goal of the QTS is to provide guidance to states that are interested in including content from the New Meridian item bank and intend to make comparability claims with "other assessments" that include New…

Despite the increasing use of virtual modalities in schools since the COVID-19 pandemic, no systematic tools exist to evaluate the process of online learning. We developed and validated an Online Learning Process Questionnaire (OLPQ) for assessing online at-home learning among 219 Hong Kong primary-school students and 474 caregivers. Exploratory…

This study explores the similarities and differences between English and Arabic numeral-based formulaic expressions, and difficulties that student-translators have with them. A corpus of English and Arabic numeral-based formulaic expressions containing zero, two, three, twenty, sixty, hundred, thousand…etc., and another corpus of specialized…

In the educational literature on peer effects, attention has been brought to the fact that the mechanisms creating peer effects are still to a large extent hidden in obscurity. The hypothesis in the study reported in this article was that the Frame Factor Theory (FFT) can be used to reveal such mechanisms. Using data from the Swedish TIMSS 2015 (N…

The rapid decline in Australian students' performance on the "National Assessment Program--Literacy and Numeracy" (NAPLAN) writing test is an issue of national concern. This paper presents the first investigation into patterns of achievement and progress on the NAPLAN writing test across the tested year levels (3, 5, 7 and 9) between…

This study determined the psychometric properties of the Economics Achievement Test (EAT) using Item Response Theory (IRT). Two popular IRT models namely, one-parameter logistics (1PL) and two-parameter logistics (2PL) models were utilized. The researcher adopted instrumentation research design. Four research questions and two hypotheses were…

This study aims to design mathematical literacy instruments that have evidence of content and construct validity and are reliable for use as an assessment for learning. The research involved eight experts as instrument validators and 273 eighth-grade students of junior high school in Yogyakarta Province. The results showed that the ten…

The instructions in this manual explain the responsibilities of school administrators for the New York State Testing Program (NYSTP) Grades 3-8 English Language Arts and Mathematics Tests. School administrators must be thoroughly familiar with the contents of the manual, and the policies and procedures must be followed as written so that testing…