Paul E. Newton is to be commended for addressing as challenging a topic as the clarification of the concept of validity. The impetus for this foray is Newton's judgment that, despite decades of development, the definition and elaboration of the term test validity in the 1999 "Standards" retains sufficient ambiguity to permit, if not invite, both…

This paper explored the authors' concerns about students enrolled in their introductory accounting course. Anecdotal evidence suggested that students struggle with basic arithmetic concepts that underlie basic business transactions even though their math placement and ACT scores are high. A survey of 125 students in a first accounting course was…

Schools have an obligation to assess the literacy skills of their students, and the provision of reading instruction to students includes the ability to measure progress in this area. However, the design of reading tests includes the ability not only to read words, but also the ability to verbalise them. This presents a particular challenge for…

Purpose: The main purpose of the study was to develop an empirically validated Teacher Leadership Competency Model (TLCM) which would enhance teacher leadership competencies in Malaysian secondary schools. There is currently no established instrument that measures teacher leadership competency, particularly in the Malaysian context. Methodology:…

Two examples demonstrate an argument-based approach to validation of diagnostic assessment using automated writing evaluation (AWE). "Criterion"®, was developed by Educational Testing Service to analyze students' papers grammatically, providing sentence-level error feedback. An interpretive argument was developed for its use as part of…

Although International Association for the Evaluation of Educational Achievement-pioneered international large-scale assessment (ILSA) of education is now a well-established science, non-practitioners and many users often substantially misunderstand how large-scale assessments are conducted, what questions and challenges they are designed to…

This paper examines how different test methods may tap different aspects of second language knowledge. It employs multiple-choice (MC) and constructed response (CR) items which yield distinct or convergent information in the computer delivered testing of English in its presentation of this factor. In order to examine the effects of test method, a…

One of the central considerations in the validity argument for the TOEFL iBT is the relationship between the language on the exam and the language required for university courses. Corpus linguistics has recently been shown to be an effective way to explore this relationship, which can also be considered as an aspect of authenticity. Applying…

Valid and reliable standardized assessment of nursing competencies is needed to monitor the quality of vocational education and training (VET) in nursing and evaluate learning outcomes for care work trainees with increasingly heterogeneous learning backgrounds. To date, however, the modeling of professional competencies has not yet evolved into…

Results from the Survey of Adult Skills, also known as PIAAC (Programme for the International Assessment of Adult Competencies), were recently made available for 24 participating countries. PIAAC involves several developments in relation to the earlier international "adult skills" surveys (IALS in the 1990s and ALL in the 2000s), notably…

Background: Applying Benson's program of validation (Benson, 1998) we provide evidence supporting the validity of a projective instrument that assesses the autonomous motivation of students with impaired cognitive abilities. Method: Eighty-eight grade 7-9 students diagnosed with cognitive impairment participated in this study. Participants'…

An online Moodle Workshop was evaluated for peer assessment effectiveness. A quasiexperiment was designed using a Seminar in Professionalism course taught in face-to-face mode to undergraduate students across two campuses. The first goal was to determine if Moodle Workshop awarded a fair peer grader grade. The second objective was to estimate if…

New systems that seek to evaluate teachers with regard to their classroom quality often rely on observation instruments that capture general instructional pedagogies. However, decades of research suggest that content-specific dimensions of instruction also are important to differentiate teachers and improve student outcomes. We explore the degree…

This technical report provides detailed information regarding the technical, statistical, and measurement attributes of the New York State Testing Program (NYSTP) for the Grades 3-8 Common Core English Language Arts (ELA) and Mathematics 2014 Operational Tests. This report includes information about test content and test development, item (i.e.,…

Mentoring has received considerable attention from scholars, and in the relevant literature, a number of studies give reference to the mentoring programs developed at universities and to the mentoring relations in higher education. Yet, most of these studies either only have a theoretical basis or deal with the mentoring relationships between…