Researchers have documented the impact of rater effects, or raters' tendencies to give different ratings than would be expected given examinee achievement levels, in performance assessments. However, the degree to which rater effects influence person fit, or the reasonableness of test-takers' achievement estimates given their response patterns,…

This study represents the inaugural attempt at assessing the authenticity of the tasks encompassed in the IELTS Speaking Module. The evaluation is conducted from the vantage points of applied linguistics and general education, and serves to enhance comprehension of authenticity and authentic assessment. In order to achieve this objective, an…

This paper introduces the new Massachusetts Performance Assessment for Leaders (PAL) and uses critical policy analysis to re-examine the validity evidence (using the 2014 Standards for Educational and Psychological Testing and a theory of multicultural validity) for the use and interpretation of the PAL in regards to emerging school leadership.…

This article report on the development and use of an analytical framework intended to map the language demands encountered by English learners as they engage in science performance assessments. Grounded in functional and interactional views of language and language use, the authors--two science education researchers and a language…

Studied the use of SERVPEFR the performance component of the Service Quality Scale (SERVQUAL) in 2 studies involving 113 and 212 customers of businesses in Australia and investigated a revised (extended) version of SERVPEFR with 122 customers. Results suggest that SERVPEFR items are too easy to rate highly, and that the revisions did not overcome…

The amount of variability contributed to large-scale performance assessment scores by raters is a constant concern for those who wish to use results from these assessments for educational decisions. This study approaches the problem by examining the behaviors of essay scorers who demonstrate different levels of proficiency with a holistic scoring…

This study used a qualitative research methodology to examine how four primary teachers used a district literacy performance assessment. Data were collected through observations, interviews, and documents. Grounded theory and NUD*IST software were used for text analysis and theory building. Findings show that a theory-grounded teacher-empowered…

This paper reports the results of an analysis of the relationship between scorer behaviors and score variability. Thirty-six essay scorers were interviewed and asked to perform a think-aloud task as they scored 24 essays. Each comment made by a scorer was coded according to its content focus (i.e. appearance, assignment, mechanics, communication,…

A study was conducted to begin a process of validating hypothesized causes of local item dependence (LID) in large-scale performance assessments. Data for the study are item level scores from 26 science tasks from the 1993 edition of the Maryland School Performance Assessment Program. Causes of high LID were hypothesized from studies by Ferrara et…

This paper presents a study of primary and secondary mathematics teachers' changing assessment practices in the context of policy, stakeholder, and personal presses for change. Two cohorts of teachers, one of 35 elementary, middle school, and high school teachers and the other of 24 elementary and middle school teachers participated. Using survey…

A descriptive study was conducted to examine the current assessment practices of teachers in Ohio. The specific aim of the study was to gain an understanding of the extent to which teachers use traditional versus alternative forms of assessment techniques in their classrooms. Participants were 625 teachers from kindergarten through grade 12. The…

This study explored the use of multiple-choice item formats and performance formats for assessment of learning science at the second grade level. It was completed during a 2-week unit entitled "Living Systems" that addressed Virginia Standards of Learning for second grade science. A 7-day unit was designed and both multiple-choice and…

Trends in performance assessments across the states of California, Colorado, Connecticut, and Illinois were explored through the development, administration, and analysis of an interstate survey. These four states were selected to represent the diversity of state-mandated testing programs relative to emphasis placed on performance assessment.…

A crucial, but often forgotten, role of educational assessment is to enhance students' learning. This author advocates that an assessment program designed for student learning differs from assessment for accountability in purpose, test format, measurement type, number, and spread of tests, use of test results, and amount of interval between…

The temporal stability and intertask consistency of an eighth-grade mathematics performance assessment and how task similarity affects the ability to generalize results of the assessments were studied with results from 101 eighth graders. Results support the suggestion that large-scale performance assessments be used with considerable caution…