This paper enquires into the grounds for convergence of judgements in a situation of blind peer review, where reviewers are asked to assess the standing of scholars in a disciplinary field. The paper first considers traditional accounts of peer review and threats to its reliability and validity. Next it examines the grounds for disciplinary…

The authors describe the development and validation of a multidimensional instrument of students' evaluation of university teaching (the Pedagogical Questionnaire of the University of Porto). The goal was to develop an instrument based on a sound psychometric analysis and simultaneously supported by the learning theory. Based on the data from 4875…

When taking a standardized test, one wants it to be fair and objective. Catherine McClellan makes sure that it is. Catherine is a psychometrician. Like many in this occupation, she designs, scores, and analyzes data from exams. Psychometrics is the science of measuring psychological attributes, such as intelligence or understanding. Tests are one…

In this study, I investigated the reliability of the U.S. Naturalization Test's civics component by asking 414 individuals to take a mock U.S. citizenship test comprising civics test questions. Using an incomplete block design of six forms with 16 nonoverlapping items and four anchor items on each form (the anchors connected the six subsets of…

Teachers' self-efficacy (SE) in their classroom management capabilities is thought to be an important factor in teachers' overall judgements of their teaching SE. Low SE in classroom management has been linked to teacher attrition and burnout, and reduced student learning outcomes. This article provides the first comprehensive review of classroom…

This study investigates the effective research-based characteristics of professional development (ERBCPD) of the National Science Foundation's GK-12 Program--a program which partners institutions of higher education with local school districts and places science, technology, engineering, and mathematics graduates in the K-12 classroom with…

This study extends the examination of moral content in the media by exploring moral messages in television programming and viewer characteristics predictive of the ability to perceive such messages. Generalisability analyses confirmed the reliability of the Media's Moral Messages (MMM) rating form for analysing programme content and the existence…

A novel assessment scale, the multi-dimensional scale for pervasive developmental disorder (PDD) and attention-deficit/hyperactivity disorder (ADHD) (MSPA), is reported. Existing assessment scales are intended to establish each diagnosis. However, the diagnosis by itself does not always capture individual characteristics or indicate the level of…

Research suggests that executive function (EF) may distinguish between children who are well- or ill-prepared for kindergarten; however, little is known about the test-retest reliability of measures of EF for children. We aimed to establish a battery of EF measures that are sensitive to both development and individual differences across the…

Faculty and staff from three university departments (Special Education, Distance Learning Programs, and Distance Learning Networks) collaborated to develop a system for remote observation of student teachers. Colleges across the campus currently use the system. The development process from inception to implementation is described, and the specific…

There are two main objectives of this study: The first is to reconsider the Listening Skill Scale and the second is to compare the levels of students of counseling and guidance according to the situations of whether they took the courses including the listening skills and to gender variable. In accordance with these objectives, the data obtained…

Science process skills are claimed to enable an individual to improve their own life visions and give a scientific view/literacy as a standard of their understanding about the nature of science. The main purpose of this study was to develop a test for measuring a valid, reliable and practical test for Science Process Skills (SPS) in secondary…

This study pilot tested an employability skills rubric (ESR) to support the summary of performance (SOP) requirement in Individuals With Disabilities Education Improvement Act. The ESR consisted of three performance areas: (a) Responsibility, (b) Problem-Solving Skills, and (c) Interpersonal Skills. The study sought to establish (a) interrater…

Increasing demands for accountability from both the public and the government have resulted in increasing pressure for higher education professionals to use data to support their choices. There is significant speculation that professionals at all levels of education lack the knowledge to implement data-driven decision making. However, empirical…

In the recent drive to revamp teacher evaluation and accountability, measures of a teacher's value added have played the starring role. But the star of the show is not always the best actor, nor can the star succeed without a strong supporting cast. In assessing teacher performance, observations of classroom practice, portfolios of teachers' work,…