Neil Dorans has made a career of advocating for the examinee. He continues to do so in his NCME career award address, providing a thought-provoking commentary on some current trends in educational measurement that could potentially affect the integrity of test scores. Concerns expressed in the address call attention to a conundrum that faces…

The purpose of this study to investigate, how third year mechanical engineering students are able to use their knowledge of concept maps in their study of the topic of "Introduction to the Internal Combustion Engines (IICE)". 41 students participated in this study. Firstly, the students were taught about concept maps and then asked to…

The impetus for this paper stems from a concern about directions and progress in the measurement of the Technological Pedagogical Content Knowledge (TPACK) framework for effective technology integration. In this paper, we develop the rationale for using a seven-criterion lens, based upon contemporary validity theory, for critiquing empirical…

Measurement and evaluation of students' achievement are an important aspect to make sure that students really understand the course content and monitor students' achievement level. Performance is not only reflected from the numbers of high achievers of the students, but also on quality of the grade obtained; does the grade "A" truly…

Argumentation in science is the process of coordinating theory and evidence to justify conclusions. This practice is at the heart of scientific journal writing and communication, but little is known regarding the argument quality of college science majors, the future scientists. Studies on written arguments at the college level have focused…

This research centers on the psychometric examination of the structure of an instrument, known as the 5E Lesson Plan (5E ILPv2) rubric for inquiry-based teaching. The instrument is intended to measure an individual's skill in developing written 5E lesson plans for inquiry teaching. In stage one of the instrument's development, an exploratory…

Two studies were conducted to examine content knowledge changes following 2 weeks of professional development that included scientific research with university scientists. Engaging teachers in scientific research is considered to be an effective way of encouraging knowledge of both inquiry pedagogy and content knowledge. We used concept maps with…

The present study will be divided in three parts: (1) a discussion of authentic alternative assessments vs. traditional assessments in language and business classes; (2) an explanation on how to create authentic alternative assessments using technology-based and non-technology-based materials; and (3) tools to evaluate these authentic assessments.…

Marking number/gender agreement on Hebrew adjectives is a case in point: It is a challenging task requiring lexical and grammatical insight, a well-known source of processing errors in Hebrew usage. The current study examined impaired processing of noun and adjective inflection in adult speakers of Hebrew with dyslexia. Thirty normally reading…

Researchers and educators recognize that performance assessments and naturalistic observations are well suited for assessing young children's thinking abilities and understanding. The need to establish explicit evaluation criteria to guide assessment decisions has led to the widespread use of rubrics. Rubrics tend to channel assessors to look for…

Item response models (IRMs) were used to analyze Cross Racial Identity Scale (CRIS) scores. Rasch analysis scores were compared with classical test theory (CTT) scores. The partial credit model demonstrated a high goodness of fit and correlations between Rasch and CTT scores ranged from 0.91 to 0.99. CRIS scores are supported by both methods.…

This dissertation describes a design for training, in accordance with probability judgment heuristics principles, for the Angoff standard setting method. The new training with instruction, practice, and feedback tailored to the probability judgment heuristics principles was called the Heuristic training and the prevailing Angoff method training…

The purpose of this study was to address the utility of curriculum-based measurements of written expression (CBM-W) for predicting writing growth longitudinally and address the extent to which CBM-W relate to other academic and behavior measures. CBM-W has been shown to be an appropriate and useful method for assessing and monitoring writing skill…

This work describes three case studies conducted to address two major problems in the area of chemistry education research, the lack of reported psychometrics regarding instrument scores, and the need for well-characterized assessments to evaluate college chemistry curricula. The first case study describes a psychometric evaluation of the Colorado…

The Grade 5 Informational Text Reading Inventory (ITRI) was developed to address the specific reading challenges that grade 5 students encounter when reading their textbooks and other informational text. In fifth grade, students are expected not only to comprehend difficult passages, but also to extend their comprehension through drawing…