In 2018, the National Center for Education Statistics (NCES) administered two assessments--the National Assessment of Educational Progress (NAEP) Technology and Engineering Literacy (TEL) assessment and the International Computer and Information Literacy Study (ICILS)--to two separate nationally representative samples of 8th-grade students in the…

Originally designed for students in Grades 3 through 5, MOCCA (formerly the Multiple-choice Online Causal Comprehension Assessment), identifies students who struggle with comprehension, and helps uncover why they struggle. There are many reasons why students might not comprehend what they read. They may struggle with decoding, or reading words…

Three mode comparability studies were conducted on the following Saturday national ACT test dates: October 26, 2019, December 14, 2019, and February 8, 2020. The primary goal of these studies was to evaluate whether ACT scores exhibited mode effects between paper and online testing that would necessitate statistical adjustments to the online…

In preparation for online administration of the ACT® test, ACT conducted studies to examine the comparability of scores between online and paper administrations, including a timing study in fall 2013, a mode comparability study in spring 2014, and a second mode comparability study in spring 2015. This report presents major findings from these…

On-line trial testing for fourth-grade students was an exploratory study realized as a part of the project "Developing annual test of students' achievement in Nature & Society" realized by Institute for Education Quality and Evaluation. Main ideas of the study were to explore possibilities for on-line testing at national level in…

Canada's knowledge-based economy--especially the fields of science, technology, engineering and mathematics (STEM)--continues to grow. Related changes in the economy, including shifts to globalized markets and an emphasis on innovation and technology, all mean that education is more and more an integral component of economic and social well-being.…

Operational testing programs employing item response theory (IRT) applications benefit from of the property of item parameter invariance whereby item parameter estimates obtained from one sample can be applied to other samples (when the underlying assumptions are satisfied). In theory, this feature allows for applications such as computer-adaptive…

This paper considers differences in modes of test administration, addressing three questions: (1) Do examinees respond to items in the same way across administration modes and computer interface variations? (2) What are some of the factors that can contribute to modal effects? and (3) Can item parameters calibrated from paper and pencil…

The gold standard in making causal inference on program effects is a randomized trial. Most randomization designs in education randomize classrooms or schools rather than individual students. Such "clustered randomization" designs have one principal drawback: They tend to have limited statistical power or precision. This study aims to…

This report contains 11 tables and 5 figures documenting the results for the General Educational Development (GED) tests in 1992. The tables provide information on the following: testing volumes; percent tested by age group; credentials issued by age group; testing by language; testing by special editions and adaptations; highest grade completed;…

This report contains 13 tables and 13 figures documenting the results for the General Educational Development (GED) tests in 1994. The tables and figures provide information on the following: GED participation and credentials issued--percent change from 1993 to 1994; testing volumes; percent tested by age group; credentials issued by age group;…

This report contains 12 tables and 12 figures documenting the results for the General Educational Development (GED) tests in 1993. The tables and figures provide information on the following: testing volumes; percent tested by age group; credentials issued by age group; testing by language; testing by special editions and adaptations; highest…

The research leading to the decisions to revise the Graduate Record Examination Aptitude Test (GRE) (beginning in October 1981) is reviewed. The issues discussed include the format of the test (the timing of each section and the number of sections, the content of the sections--especially the analytical section), the scoring procedure for the GRE,…

To discover factors which contribute to a high response rate for questionnaire surveys, the preferences of 150 college teachers and teaching assistants were studied. Four different questionnaire formats using 34 common items were sent to the subjects: open-ended; Likert-type (five points, from "strong influence to return," to…

This study examined the cross-lingual equating process adopted by a large scale testing system in which target language (TL) forms are equated to the source language (SL) forms using a set of translated items. The focus was on evaluating the degree of error inherent in the routine cross-lingual equating of the Verbal Reasoning subtest of the…