Multidimensional forced-choice (FC) questionnaires have been consistently found to reduce the effects of socially desirable responding and faking in noncognitive assessments. Although FC has been considered problematic for providing ipsative scores under the classical test theory, item response theory (IRT) models enable the estimation of…

In two independent studies of questionnaire administration, respondents completed multidimensional self-concept inventories within four randomized research conditions that mirrored the most common administration formats used in practice: paper booklets with and without answer sheets and computer questionnaires with single versus multiple items per…

One major threat to validity in high-stakes testing is construct-irrelevant variance. In this study we explored whether the transition from a paper-and-pencil to a computer-based test mode in a high-stakes test in China, the College English Test, has brought about variance irrelevant to the construct being assessed in this test. Analyses of the…

Examining the testing processes, as well as the scores, is needed for a complete understanding of validity and fairness of computer-based assessments. Examinees' rapid-guessing and insufficient familiarity with computers have been found to be major issues that weaken the validity arguments of scores. This study has three goals: (a) improving…

The Program for International Student Assessment (PISA) is a system of international assessments that allows countries to compare outcomes of learning as students near the end of compulsory schooling. PISA measures the performance of 15-year-old students in science, reading, and mathematics literacy every 3 years. PISA uses the term…

Various hints have been proposed to scaffold students. Such hints can be broadly divided into direct hints and indirect hints. On the other hand, individual differences existed among learners. In particular, cognitive styles greatly affect student learning. However, there is a lack of studies to investigate how cognitive styles affect students'…

The Progress in International Reading Literacy Study (PIRLS) is an international assessment of student performance in reading literacy at the fourth grade. PIRLS measures students in the fourth year of formal schooling because this is typically when students' learning transitions from a focus on "learning to read" to a focus on…

Executive function is best measured in loosely structured, multi-component tasks that reflect real-life demands. These tasks require participants to develop a strategy, keep a plan in mind and monitor time. Errors include ignoring stated goals ("goal neglect"), over-allocation of time to one task and violating rules. Teasing apart such…

An English placement test (PT) is an essential component of any foundation program. It helps place students into their suitable language proficiency level so that they do not spend time learning materials below or above their levels. It also helps teachers to prepare teaching materials to students of similar levels (Brown, 2004; Illinois, 2012).…

A new score report based on a mechanism of formative assessment and feedback is developed to offer individual testees not only their final scores but also their sub-scale scores, their percentile position, as well as corresponding feedback on self-regulation strategies. Structural equation modeling is adopted in the confirmatory factor analysis to…

The effects of computer and paper test media on EFL test-takers with different computer familiarity in writing scores and in the cognitive writing process have been comprehensively explored from the learners' aspect as well as on the basis of related theories and practice. The results indicate significant differences in test scores among the…

Language test preparation has often been studied within the consequential validity framework in relation to ethics, equity, fairness, and washback of assessment. The use of independent and integrated speaking tasks in the "TOEFL iBT"® test represents a significant development and innovation in assessing speaking ability in academic…

Energy literacy is multidimensional, comprising broad content knowledge as well as affect and behavior. Our previous study has defined four core dimensions for the assessment framework, including energy concepts, reasoning on energy issues, low-carbon lifestyle, and civic responsibility for a sustainable society. The present study compiled a…

Emotions experienced during online academic examinations may differ from emotions experienced in the traditional classroom testing situation. Students in a "Psychology of Learning" course (n = 61) completed assessments of emotions before and after a quiz in each of the following settings: online at their own choice of time and location; online in…

We describe a study conducted during 2009-12 into innovative assessment practice, evaluating an assessed coursework task on a final year Medical Genetics module for Biomedical Science undergraduates. An authentic e-assessment coursework task was developed, integrating objectively marked online questions with an online DNA sequence analysis tool…