Item response theory (IRT) becomes an increasingly important tool when analyzing "big data" gathered from online educational venues. However, the mechanism was originally developed in traditional exam settings, and several of its assumptions are infringed upon when deployed in the online realm. For a large-enrollment physics course for…

The Preschool Behavioral and Emotional Rating Scale (PreBERS) is an assessment of emotional and behavioral strengths in preschoolers with well-established reliability and validity for educational and clinical application in children with and without disabilities. The present study provides further evidence of psychometric rigor for items and…

This article introduces the Supports Intensity Scale-Children's Version (SIS-C) designed and normed to be used with children across multiple contexts, including home, school, and community life. Steps taken to develop the scale are described, and findings from data collected on a field test version of the SIS-C are shared. Preliminary findings in…

The purpose of this study was to examine the overall level of student achievement on the 2012 Kansas History-Government Assessment in Grades 6, 8, and high school, with major emphasis on the subject area of economics. It explored four specific research questions in order to: (1) determine the level of student knowledge of assessed economic…

The true power of comparative research around the impact and use of open educational resources is only just being realised, largely through the work done by the Hewlett-funded OER Research Hub, based at The Open University (UK). Since late 2012, the project has used a combination of surveys, interviews and focus groups to gather data about the use…

Task difficulty is a critical issue affecting test developers. Controlling or balancing the item difficulty of an assessment improves its validity and discrimination. Test developers construct tests from the cognitive perspective, by making the test constructing process more scientific and efficient; thus, the scores obtained more precisely…

This report reviews the major international and regional large-scale educational assessments, including international surveys, school-based surveys and household-based surveys. The report compares and contrasts the cognitive and contextual data collection instruments and implementation methods used by the different assessments in order to identify…

University science teachers' technological pedagogical and content knowledge (TPACK) is crucial for effective teaching. Although there has been a plethora of studies investigating pre-service and in-service teachers' TPACK, few studies have examined university instructors' TPACK and university students' perceptions of instructors' TPACK. The main…

This study investigated comprehension of indirect meaning among learners of L2 Spanish via an original computer-delivered multimedia listening test. The comprehension of implied speaker intention is a type of indirect communication that involves the ability to understand implied intention by using linguistic knowledge, contextual cues, and the…

This article provides information for Extension professionals on the correct analysis of Likert data. The analyses of Likert-type and Likert scale data require unique data analysis procedures, and as a result, misuses and/or mistakes often occur. This article discusses the differences between Likert-type and Likert scale data and provides…

Learning progressions are used to describe how students' understanding of a topic progresses over time and to classify the progress of students into steps or levels. This study applies Item Response Theory (IRT) based methods to investigate how to design learning progression-based science assessments. The research questions of this study are: (1)…

This article describes how a detailed notebook analysis was used to assess and compare the opportunity to learn of a sample of grade 6 students from 126 classes in South East Botswana and North West Province, South Africa. Students' mathematics notebooks provided the main data source for estimating how much time is spent on the subject during the…

Previous studies have shown that method effects associated with item wording produce artifactual factors and threaten scale validity. This study examines item wording effects on a scale of attitudes toward learning mathematics for Taiwanese and U.S. samples. Analyses from a series of CFA (confirmatory factor analysis) models support the presence…

The applications of item response theory (IRT) models assume local item independence and that examinees are independent of each other. When a representative sample for psychometric analysis is selected using a cluster sampling method in a testlet-based assessment, both local item dependence and local person dependence are likely to be induced.…

Three university ranking systems in vogue have been shown in the previous issue of "Higher Education Review" to be capable of modifications to make them more parsimonious by using only about half of the number of predictors currently in use. This makes some of the predictors "redundant" as they contributed little to the overall ranking. It is…