The present study explored the generation and retrieval practice effects within a college classroom using a free, online tool called PeerWise (PW). PW allows students to create their own multiple-choice questions, share them with peers, and answer the shared questions written by their peers. Forty students from two sections of an upper level…

Context: The accuracy of summative assessment scoring and discriminating the level of knowledge in subject matter is critical in fairness to learners in health care professional programs and to ensure stakeholders of competent providers. An evidence-based approach to determine examination quality for the assessment of applied knowledge is…

VocQGen is an automated tool designed to generate multiple-choice cloze (MCC) questions for vocabulary assessment in second language learning contexts. It leverages several natural language processing (NLP) tools and OpenAI's GPT-4 model to produce MCC items quickly from user-specified word lists. To evaluate its effectiveness, we used the first…

For a multiple-choice test under development or redesign, it is important to choose the optimal number of options per item so that the test possesses the desired psychometric properties. On the basis of available data for a multiple-choice assessment with 8 options, we evaluated the effects of changing the number of options on test properties…

Different versions of multiple-choice exams were administered to an undergraduate class in human physiology as part of normal testing in the classroom. The goal was to evaluate whether the number of options (possible answers) per question influenced the effectiveness of this assessment. Three exams (each with three versions) were given to each of…

Background: Chi and colleagues have argued that some of the most challenging engineering concepts exhibit properties of emergent systems. However, students often lack a mental framework, or schema, for understanding emergence. Slotta and Chi posited that helping students develop a schema for emergent systems, referred to as schema training, would…

The use of video lectures and authentic listening tasks (e.g., taking notes; responding to short answer questions) is common practice in EAP classrooms. However, many classroom-based tests of L2 listening comprehension continue to employ audio-only listening texts and a multiple-choice response format. The effect of these differences in input type…

A modified essay is an open-ended question about clinical presentations, with the goal to test application of basic science principles to novel scenarios. Due to high reliability and validity, multiple-choice question (MCQ) examinations are more commonly used. We have employed a combination of MCQ and modified essay examinations in medical school.…

In undergraduate college courses, assignments designed to showcase preservice teacher learning traditionally include classroom presentations, papers, projects, and tests. Often, these activities do not translate into permanent products that will be utilized outside the course. The purpose of this pilot study was to investigate the effects of…

Measurement tools that are used in education are important factors that affect course success and motivation of students. This study aims to determine the opinions of high school students on different question types. As the subgoals of the research, the study aims to determine the reasons for multiple choice test preference and its effect on…

This paper reports on the development and piloting of a new model of multiplechoice question (MCQ) assessment used in two undergraduate degree modules at a tertiary university. The new model was purposefully designed to promote deeper learning closely aligned with the SOLO taxonomy. Students were invited to participate in an exploratory…

This study determined the psychometric properties of the Economics Achievement Test (EAT) using Item Response Theory (IRT). Two popular IRT models namely, one-parameter logistics (1PL) and two-parameter logistics (2PL) models were utilized. The researcher adopted instrumentation research design. Four research questions and two hypotheses were…

Measurement instruments of early childhood teachers' mathematical pedagogical content knowledge (MPCK) have to consider the special characteristics of early childhood teaching. Early childhood teaching includes some planned activities but in contrast to learning in school, it is often motivated and generated by situations which unfold…

This study explores the effect of categorically different pre-reading activities in learners' L1 on reading comprehension and learning of focus-on-vocabulary. The participants were sixty Turkish EFL learners attending a state high school, and the data was gathered from their achievement test scores. We analyzed the data through one-way…

The Multiple-choice (MC) item format is commonly used in educational assessments due to its economy and effectiveness across a variety of content domains. However, numerous studies have examined the quality of MC items in high-stakes and higher-education assessments and found many flawed items, especially in terms of distractors. These faulty…