There is a lively discussion on how to evaluate competence-based higher education in both evaluation and competence research. The instruments used are often limited to course evaluation or specific competences, taking a rather narrow perspective. Furthermore, the instruments often comprise predetermined competences that cannot be adapted to higher…

Elicited imitation (EI) has been widely used to examine second language (L2) proficiency and development and was an especially popular method in the 1970s and early 1980s. However, as the field embraced more communicative approaches to both instruction and assessment, the use of EI diminished, and the construct-related validity of EI scores as a…

The statistical analysis technique of correlation has extensively been used in second/foreign language testing research for a variety of purposes. Most commonly, the technique has been used to validate newly constructed language tests (particularly cloze tests) against previous supposedly valid measures. Tests such validated are meant to…

The purpose of this study was to examine the impact of dimensionality, common-item set format, and different scale linking methods on preserving equity property with mixed-format test equating. Item response theory (IRT) true-score equating (TSE) and IRT observed-score equating (OSE) methods were used under common-item nonequivalent groups design.…

A consistent message emerges from research on undergraduate students' perceptions of assessment which describes traditional assessment as detrimental to learning. However this literature has not included students in the pure sciences. Mathematics education literature advocates the introduction of innovative assessment at university. In this…

The study assesses the psychometric properties of the Italian version of the Norwegian Teacher Self-Efficacy Scale--NTSES. Multiple group confirmatory factor analysis was used to explore the measurement invariance of the scale across two countries. Analyses performed on Italian and Norwegian samples confirmed a six-factor structure of the scale…

The purpose of the study was to investigate the reliability and validity of a Turkish adaptation of Technology-Rich Outcomes-Focused Learning Environment Inventory (TROFLEI) which was developed by Aldridge, Dorman, and Fraser. A sample of 985 students from 16 high schools (Grades 9-12) participated in the study. Translation process followed…

This manual contains information about the American College Test (ACT) Plan® program. The principal focus of this manual is to document the Plan program's technical adequacy in light of its intended purposes. This manual supersedes the 2011 edition. The content of this manual responds to requirements of the testing industry as established in the…

This document describes the breadth of the research that the ETS (Educational Testing Service) Research & Development division is conducting in 2010. This portfolio will be updated in early 2011 to reflect changes to existing projects and new projects that were added after this document was completed. The research described in this portfolio falls…

This document describes the breadth of the research being conducted in 2008 by the Research and Development Division at Educational Testing Service (ETS). The research described falls into three large categories: (1) Research supported by the ETS research allocation; (2) Research funded by testing programs at ETS; and (3) Research funded by…

Analyzes Hughes and Nelson's study of placement testing at Riverside Community College and offers an alternative method of evaluating placement systems using logistic regression. Reanalyzes data from an ASSET placement test validity study using logistic regression. (DMM)

The purpose of this study was to compare the effectiveness of the Raven's Standard Progressive Matrices, the Naglieri Nonverbal Abilities Test (NNAT), and the Iowa Test of Basic Skills (ITBS) in selecting for ethnically diverse students who may be gifted. The participants of the study were 175 students enrolled in Grades 3-5 and Grade 8 in a…

Statistical methods designed for categorical data were used to perform confirmatory factor analyses and item response theory (IRT) analyses of the Fear of Negative Evaluation scale (FNE; D. Watson & R. Friend, 1969) and the Brief FNE (BFNE; M. R. Leary, 1983). Results suggested that a 2-factor model fit the data better for both the FNE and the…

Differential item functioning (DIF) is an important consideration in assessing the validity of test scores (Camilli & Shepard, 1994). A variety of statistical procedures have been developed to assess DIF in tests of dichotomous (Hills, 1989; Millsap & Everson, 1993) and polytomous (Penfield & Lam, 2000; Potenza & Dorans, 1995) items. Some of these…

A study of methods used to ensure validity and reliability in classroom assessments surveyed 625 elementary and secondary teachers in Ohio. Results indicate teachers spent little time conducting statistical analyses of their student evaluation data, and many techniques used were poor and inadequate. Additional professional development and improved…