As a result of the fact that judgments of non-native speech are closely tied to social biases, oral proficiency ratings are susceptible to error because of rater background and social attitudes. In the present study we seek first to estimate the variance attributable to rater background and attitudinal variables on novice raters' assessments of L2…

Criterion referenced tests of second language speaking performance are administered in different institutions using different procedures. The present study reports raters' practices of second language speaking tests, in particular the correspondence between test-takers' grades when assessed individually and in groups. Data derived from…

Scholarly journals provide a record of the research, issues, and concerns of a field. Authors have their names associated with their individual articles, while editors are connected with a publication. However, there is another group of individuals who are often left out of the record, although their contributions are just as critical in the…

The aim of this study is to examine the variability in and reliability of scores assigned to different quality EFL compositions by EFL instructors and their rating behaviors. Using a mixed research design, quantitative data were collected from EFL instructors' ratings of 30 compositions of three different qualities using a holistic scoring rubric.…

In language testing programs, different test forms are often used to administer the same test. Demonstrating the comparability of these forms is essential to avoid criticisms of potential test unfairness. However, studies with this objective are scarce. This study aims to investigate the extent to which the picture-prompt writing tasks of three…

Background: There is a dearth of research regarding the content and structure of juvenile predisposition psychological evaluations. Limited research suggests that key mental health domains are insufficiently represented and judges use evaluator recommendations regarding legal outcomes more often than clinical outcomes. Studies have not addressed…

This study evaluates, through the employment of scientific methods and techniques, a total of 107 Biology projects submitted by secondary education students to the Bursa Region Coordinatorship of TUBITAK (a region which encompasses the municipalities of Afyonkarahisar, Balikesir, Bilecik, Canakkale, Eskisehir, Kutahya, and Yalova). The projects…

Community psychology blends psychological science, a community-level perspective on social issues, and a social justice orientation. Despite important difference between community psychology and program evaluation, program evaluation is a key component of many community psychologists' practice and holds a central place in my own. In this…

In this article, I reflect on how ways of reporting research as well as reviewing and commenting on submitted manuscripts could take new directions to promote progress in the discipline of developmental science. I argue for (a) attitudinal openness toward migratory impulses in relation to Stokes's quadrant model of science, (b) the…

Professionals in various fields have the opportunity to train in real-life situations before they take on a job by themselves. In program evaluation, however, preservice training usually focuses on coursework oriented to research design and methods. After completing these studies, evaluators go off to conduct evaluations guided primarily by their…

Policymakers have turned to teacher evaluation as one way to ensure accountability for school reform. In most evaluation systems, the emphasis focuses on the external: test scores, observations of classroom practices, rubric based assessments, student feedback, evaluation, and student work. While these activities have a place in professional…

Direct Behavior Rating (DBR) is a repeatable and efficient method of behavior assessment that is used to document teacher perceptions of student behavior in the classroom. Time-series data can be graphically plotted and visually analyzed to evaluate patterns of behavior or intervention effects. This study evaluated the decision accuracy of novice…

Using a non-experimental comparative group design in a sample consisting of 100 English teachers randomly selected from 30 secondary schools of a district of Kerala and assigning fifty teachers to groups for marking and grading, this study compares inter and intra-individual reliability in marking and absolute grading. Studying (1) the in marking…

This paper addressed the place of the use of international 'experts' in assuring the quality of Education programmes within Higher Education in relation to the globalisation agenda. The experiences of one such 'expert' are discussed and recommendations made as to the type of person suited to the role. Some issues relating to Higher Education in…

Two factors were investigated that are thought to contribute to consistency in rater scoring judgments: rater training and experience in scoring. Also considered were the relative effects of scoring rubrics and exemplars on rater performance. Experienced teachers of English (N = 20) scored recorded responses from the TOEFL iBT speaking test prior…