An observational study has been carried out to analyse differences in performance between students of different undergraduate curricula in the same written business administration examination, focusing particularly on possible effects of "integrated" or "multi-modular" examinations, a recently widespread format in Italian…

We analyzed a pool of items from an admissions test for differential item functioning (DIF) for groups based on age, socioeconomic status, citizenship, or English language status using Mantel-Haenszel and item response theory. DIF items were systematically examined to identify its possible sources by item type, content, and wording. DIF was…

The development of the 21-item Learner Awareness Levels Questionnaire (LALQ) was carried out using data from three separate studies. The LALQ is a self-reporting questionnaire assessing how and why students learn. Study 1 refined the initial pool of items to 21 using exploratory factor analysis. In Study 2, the analysis showed evidence for a…

One approach to plagiarism prevention focuses on improving students' authorial identity, but work in this area depends on robust measures. This paper presents the development of a psychometrically robust measure of authorial identity--the Student Attitudes and Beliefs about Authorship Scale. In the item generation phase, a pool of items was…

The Irish inter-institutional virtual learning environments (VLEs) open dataset stems from ongoing work with a rolling longitudinal survey of students' usage of VLEs which has been ongoing in 12 higher education institutions since 2008. The project has collected over 21,000 student responses to date through the growth of an extended network of…

The primary goal of teaching is to successfully facilitate learning. Testing can help accomplish this goal in two ways. First, testing can provide a powerful motivation for students to prepare when they perceive that the effort involved leads to valued outcomes. Second, testing can provide instructors with valuable feedback on whether their…

The true power of comparative research around the impact and use of open educational resources is only just being realised, largely through the work done by the Hewlett-funded OER Research Hub, based at The Open University (UK). Since late 2012, the project has used a combination of surveys, interviews and focus groups to gather data about the use…

As the demands for public accountability increase for the higher education industry, institutions are seeking methods for continuous improvement in order to demonstrate quality within programs and processes, including those provided through online education. Because of the rapid growth of online education programs, institutions are further called…

Six methods for assembling tests from a pool with an item-set structure are presented. All methods are computational and based on the technique of mixed integer programming. The methods are evaluated using such criteria as the feasibility of their linear programming problems and their expected solution times. The methods are illustrated for two…

Eight text banks that accompany cost accounting textbooks were evaluated for the presence of bias in the distribution of correct responses. All but one were found to have considerable bias, and three of eight were found to have significant choice bias. (SK)

The Tower of London test (T. Shallice, 1982), a measure of executive function, was reconstructed to increase its reliability through revisions tested with successive samples of 50, 50, and 34 college students. Adjusting the item pool resulted in acceptable test-retest reliability. (SLD)

A specific application of the process of automating exams for any introductory statistics course is described. The process of automating exams was accomplished by using the Statistical Test Item Collection System (STICS). This system was first used to select a set of questions based on course requirements established in advance; afterward, STICS…

Describes the SOCRATES Computer-Assisted Test Retrieval system available to the faculty and students of the California State University and Colleges. (Author/IRT)

Discusses how to design a large exam question file for any discipline and how to use this file to extract examinations. (MLH)

A sample of 2,913 questions from 17 nursing test banks was evaluated for adherence to multiple-choice guidelines, cognitive level in Bloom's Taxonomy, and distribution of correct answers. Analysis revealed 2,233 guideline violations; 47.3% of items were written at the knowledge level, 6.5% at the analysis level; and correct answers were evenly…