NotesFAQContact Us
Collection
Advanced
Search Tips
Publication Date
In 20250
Since 20240
Since 2021 (last 5 years)0
Since 2016 (last 10 years)0
Since 2006 (last 20 years)10
Publication Type
Reports - Descriptive11
Journal Articles8
Tests/Questionnaires2
Numerical/Quantitative Data1
Audience
Laws, Policies, & Programs
No Child Left Behind Act 20011
What Works Clearinghouse Rating
Showing all 11 results Save | Export
Smith, Margaret A. – School Administrator, 2012
The author's community, which includes parents of the 62,000 students who attend schools in Volusia County, Florida, has been baffled over the conflicting nature of Florida's school grading system of A, B, C, D, F based on the Florida Comprehensive Assessment Test, and the federal system of pass or fail. While many of the 80 schools in her…
Descriptors: Grading, Elementary Secondary Education, Federal Legislation, Advocacy
Graham, Matthew; Milanowski, Anthony; Miller, Jackson – Online Submission, 2012
As states, districts, and schools transition toward more rigorous educator evaluation systems, they are placing additional weight on judgments about educator practice. Since teacher and principal observation ratings inherently rely on evaluators' professional judgment, there is always a question of how much the ratings depend on the particular…
Descriptors: Interrater Reliability, Evaluators, Observation, Principals
Peer reviewed Peer reviewed
Direct linkDirect link
Cropley, David H.; Kaufman, James C. – Journal of Creative Behavior, 2012
The Creative Solution Diagnosis Scale (CSDS) is a 30-item scale based on a core of four criteria: Relevance & Effectiveness, Novelty, Elegance, and Genesis. The CSDS offers potential for the consensual assessment of functional product creativity. This article describes an empirical study in which non-expert judges rated a series of mousetrap…
Descriptors: Expertise, Creativity, Identification, Measures (Individuals)
Peer reviewed Peer reviewed
Direct linkDirect link
Nunan, Anna – Language Learning in Higher Education, 2014
The Applied Language Centre at University College Dublin offers foreign language modules to students in ten languages at CEFR [Common European Framework of Reference for Languages] levels ranging from A1 to B2. Efforts have been underway in the Centre to standardise the assessment components across languages to ensure parity between module credits…
Descriptors: Second Language Learning, Second Language Instruction, College Students, Standards
Haberman, Shelby J. – Educational Testing Service, 2011
Alternative approaches are discussed for use of e-rater[R] to score the TOEFL iBT[R] Writing test. These approaches involve alternate criteria. In the 1st approach, the predicted variable is the expected rater score of the examinee's 2 essays. In the 2nd approach, the predicted variable is the expected rater score of 2 essay responses by the…
Descriptors: Writing Tests, Scoring, Essays, Language Tests
Peer reviewed Peer reviewed
Direct linkDirect link
Schuster, Christof; Smith, David A. – Psychometrika, 2005
The rater agreement literature is complicated by the fact that it must accommodate at least two different properties of rating data: the number of raters (two versus more than two) and the rating scale level (nominal versus metric). While kappa statistics are most widely used for nominal scales, intraclass correlation coefficients have been…
Descriptors: Psychometrics, Statistics, Rating Scales, Correlation
Peer reviewed Peer reviewed
Direct linkDirect link
Webb, Norman L. – Applied Measurement in Education, 2007
A process for judging the alignment between curriculum standards and assessments developed by the author is presented. This process produces information on the relationship of standards and assessments on four alignment criteria: Categorical Concurrence, Depth of Knowledge Consistency, Range of Knowledge Correspondence, and Balance of…
Descriptors: Educational Assessment, Academic Standards, Item Analysis, Interrater Reliability
Peer reviewed Peer reviewed
Direct linkDirect link
Aleong, Chandra – Journal of College Teaching & Learning, 2007
This paper discusses whether there are differences in performance based on differences in strategy. First, an attempt was made to determine whether the institution had a strategy, and if so, did it follow a particular model. Major models of strategy are the industry analysis approach, the resource based view or the RBV model and the more recent,…
Descriptors: Strategic Planning, Higher Education, Institutional Evaluation, Case Studies
OECD Publishing (NJ1), 2009
The Organisation for Economic Cooperation and Development's (OECD's) Programme for International Student Assessment (PISA) surveys, which take place every three years, have been designed to collect information about 15-year-old students in participating countries. PISA examines how well students are prepared to meet the challenges of the future,…
Descriptors: Policy Formation, Scaling, Academic Achievement, Interrater Reliability
Peer reviewed Peer reviewed
Direct linkDirect link
Meijer, Joost; Veenman, Marcel V. J.; van Hout-Wolters, Bernadette H. A. M. – Educational Research and Evaluation, 2006
This article describes the construction of a hierarchical taxonomy of metacognitive activities for the interpretation of thinking-aloud protocols of students in secondary education, who studied texts on history and physics. After testing an initial elaborate taxonomy on a restricted number of protocols by multiple raters, it appeared that the…
Descriptors: Classification, Physics, Metacognition, Interrater Reliability
Peer reviewed Peer reviewed
Direct linkDirect link
Clariana, Roy B.; Wallace, Patricia – Journal of Educational Computing Research, 2007
This proof-of-concept investigation describes a computer-based approach for deriving the knowledge structure of individuals and of groups from their written essays, and considers the convergent criterion-related validity of the computer-based scores relative to human rater essay scores and multiple-choice test scores. After completing a…
Descriptors: Computer Assisted Testing, Multiple Choice Tests, Construct Validity, Cognitive Structures