This experimental project investigated the reliability and validity of rubrics in assessment of students' written responses to a social science "writing prompt". The participants were asked to grade one of the two samples of writing assuming it was written by a graduate student. In fact both samples were prepared by the authors. The…

The main purpose of the study was to investigate the distinctness and reliability of analytic (or multi-trait) rating dimensions and their relationships to holistic scores and "e-rater"[R] essay feature variables in the context of the TOEFL[R] computer-based test (TOEFL CBT) writing assessment. Data analyzed in the study were holistic…

Although we know that family involvement is associated with stronger math performance, little is known about what educators are doing to effectively involve families and community members, and whether this measurably improves math achievement at their schools. This study used data from 39 schools to assess the effects of family and community…

A series of resampling studies was conducted to compare the accuracy of equating in a common item design using four different methods: chained equipercentile equating of smoothed distributions, chained linear equating, chained mean equating, and the circle-arc method. Four operational test forms, each containing more than 100 items, were used for…

For purposes of the present study, it was hypothesized that field (in)dependence would introduce systematic variance into EFL learners' performance on composition tests. 1743 freshman, sophomore, junior, and senior students all majoring in English at different Iranian universities and colleges took the Group Embedded Figures Test (GEFT). The…

This problem-based learning project focused on the need to enhance the capacity for leadership of building administrators in order to effectively evaluate teachers. Federal and state guidelines mandate highly qualified teachers in every classroom, and teacher evaluation is an important component to ensure qualified teachers are in the classroom.…

Background: Currently, clinicians mainly rely on perceptual judgements to assess intelligibility of dysarthric speech. Although often highly reliable, this procedure is subjective with a lot of intrinsic variables. Therefore, certain benefits can be expected from a speech technology-based intelligibility assessment. Previous attempts to develop an…

This paper describes and evaluates the use of measurement decision theory (MDT) to classify examinees based on their item response patterns. The model has a simple framework that starts with the conditional probabilities of examinees in each category or mastery state responding correctly to each item. The presented evaluation investigates: (1) the…

Quantitative literacy involves a set of skills necessary to reason about data. Such skills are imperative in our increasingly data-oriented world. Despite the importance of such skills, assessment of quantitative literacy has not been a focus in education and there is a lack of assessment tools that specifically address these skills. This study…

A variety of cognitive diagnosis approaches (CDAs) have been used by researchers to extract fine-grained information about the linguistic knowledge states and skill mastery levels of test takers based on their performance on language tests. Although some of these approaches have been in use in the psychometric community for quite some time, many…

In second language acquisition (SLA) research, two types of second language (L2) knowledge, explicit and implicit, have been discussed for almost three decades. Although many SLA researchers agree that L2 instruction should give priority to implicit knowledge, researchers have not agreed on what type of test (e.g., oral narrative test and timed…

Hofstede's model of cultural difference has been used widely for exploring aspects of culture in educational settings. In this paper, we review Hofstede's model and explore some of its limitations, particularly in relation to the field of higher education. These limitations include an oversimplification of cultural differences, inconsistencies…

Through the use of in-depth interviews, this study investigated how gifted high-school students scoring high on at least one measure of perfectionism (self-oriented, socially prescribed, or other-oriented) perceived their perfectionism as developing. Findings suggested support for three family history models outlined by Flett, Hewitt, Oliver, and…

The advent of the modern form of the Scholastic Aptitude Test (SAT), brought to bear by the combination of the Educational Testing Service (ETS) and Harvard's former president James Bryant Conant (Lemann 1999), was designed to promote the recognition of talent and intellect, wherever they may be found. Their aim was to provide greater educational…

The purpose of this study was to investigate the difference in the evaluations of online course quality using the Quality Matters model among four groups of reviewers: instructional designers, faculty with subject-matter expertise, peer faculty with no subject-matter expertise, and administrators. A causal-comparative design was utilized to…