Longitudinal studies are permeating clinical trials in psychiatry. Therefore, it is of utmost importance to study the psychometric properties of rating scales, frequently used in these trials, within a longitudinal framework. However, intrasubject serial correlation and memory effects are problematic issues often encountered in longitudinal data.…

Background: Most empirical investigations in survey research have been conducted using self-reported or self-evaluated item responses. Such measures are common because they are relatively easy to obtain and are often the only feasible way to assess constructs of interest. In order to improve on the validity of self-reports it has become a common…

Despite increased recent attention to improving the quality of encounters between police officers and people with serious mental illness, there are no measures available for assessing how consumers perceive their interactions with police officers. Drawing upon conceptual frameworks developed within social psychology, this study reports the…

This study evaluated the Battelle Developmental Inventory, 2nd Edition, Screening Test (BDI-2 ST) for use in states' child outcomes accountability systems under the Individuals with Disabilities Education Act. Complete Battelle Developmental Inventory, 2nd Edition (BDI-2), assessment data were obtained for 142 children, ages 2 to 62 months, who…

The article presents the stages of the experiment planning that are necessary to ensure the validity and reliability of it. The research data reveal that doctoral students of Educational Research approach the planning of the experiment as the planning of the whole dissertation research; and the experiment as a research method is often confused…

The present study explored motivation and engagement among Chinese and Australian school students. Based on a sample of 528 Hong Kong Chinese 12-13 year olds and an archive sample of 6,366 Australian 12-13 year olds, achievement motivation was assessed using the Motivation and Engagement Scale-High School (MES-HS). Confirmatory factor analysis and…

In addition to collecting achievement data, international large-scale assessment programmes gather auxiliary information from students and schools regarding the context of teaching and learning. In an effort to clarify some of the opacity surrounding international large-scale assessment programmes and the potential problems associated with less…

Background: Cigarette smoking is a health-risk behavior of global proportions. Self-efficacy plays an important role in both smoking acquisition and smoking resistance. Reliability and validity of an instrument is fundamental to research results, particularly in its simplified form on a different population. The purpose of this study was to…

This experimental project investigated the reliability and validity of rubrics in assessment of students' written responses to a social science "writing prompt". The participants were asked to grade one of the two samples of writing assuming it was written by a graduate student. In fact both samples were prepared by the authors. The…

The purpose of this study was to standardize the Primary Measures of Music Audiation in Greece ( N = 1,188). Split-halves reliability was acceptable across grade levels (K through 3) for the Tonal and Rhythm subtests, but test-retest reliability was generally unacceptable, especially for the Rhythm subtest. Concurrent validity was mixed, with…

The main purpose of the study was to investigate the distinctness and reliability of analytic (or multi-trait) rating dimensions and their relationships to holistic scores and "e-rater"[R] essay feature variables in the context of the TOEFL[R] computer-based test (TOEFL CBT) writing assessment. Data analyzed in the study were holistic…

The purpose of this review was to examine the practice of oral assessment in postgraduate medical education in the context of the core assessment constructs of validity, reliability and fairness. Although oral assessment has a long history in the certification process of medical specialists and is a well-established part of such proceedings for a…

Research has consistently shown that principal leadership matters for successful schools. Evaluating principals on the behaviors shown to improve student learning should be an important leverage point for raising leadership quality. Yet principals are often evaluated with the use of instruments with no theoretical background and little, if any,…

Objectives: The purpose of this article is to create transparency for the psychometric methods employed for the development of the Association of Social Work Boards' (ASWB) exams. Results: The article includes an assessment of the macro (political) and micro (statistical) environments of testing social work competence. The seven-step process used…

We present a novel approach to the automated marking of student programming assignments. Our technique quantifies the structural similarity between unmarked student submissions and marked solutions, and is the basis by which we assign marks. This is accomplished through an efficient novel graph similarity measure ("AssignSim"). Our experiments…