English learners (ELs) represent one of the fastest growing student populations in the United States. Given that language can serve as a barrier in EL performance, test accommodations are provided to help level the playing field and allow ELs to better demonstrate their true performance level. Test accommodations on the computer offer the ability…

Indirect metaphors are pervasive in everyday language: People talk about "long" vacations, "short" tempers, and "colorful" language. But, why do we use concrete lexical items that are associated with the physical world when we talk about abstract, or non-physical, concepts? A potential answer is provided by proponents…

Online and on-demand tests are increasingly used in assessment. Although the main focus has been cheating and test security (e.g., Selwyn, 2008) the cross-setting equivalence of scores as a function of contrasting test conditions is also an issue that warrants attention. In this study, the impact of environmental and cognitive distractions, as…

When respondents answer paper-and-pencil (PP) questionnaires, they sometimes modify their responses to correspond to previously answered items. As a result, this response bias might artificially inflate the reliability of PP questionnaires. We compared the internal consistency of PP questionnaires to computerized questionnaires that presented a…

Computerized adaptive testing (CAT) is an active current research field in psychometrics and educational measurement. However, there is very little software available to handle such adaptive tasks. The R package "catR" was developed to perform adaptive testing with as much flexibility as possible, in an attempt to provide a developmental and…

This study examined the predictive validity of a computer-adaptive assessment for measuring kindergarten reading skills using the STAR Early Literacy (SEL) test. The findings showed that the results of SEL assessments administered during the fall, winter, and spring of kindergarten were moderate and statistically significant predictors of year-end…

This study explored EFL students and faculty's perceptions of and attitudes towards the use of online assessment and practice. A descriptive method was used, employing quantitative data collection and analyses from a sample of 400 students of different age categories and educational levels and another sample of 25 teachers in the English…

Language tools are reflections of the academic traditions of assessment developers, as well as the perceptions of language quality as held by a society. The certification of Quebec's teachers offers an interesting case in point: the Québec Government's "ministère de l'Éducation, du Loisir et du Sport" (MELS) requires that all students in…

The purpose of this study was to determine the extent to which performance on the TOEFL iBT speaking section is associated with other indicators of Japanese university students' abilities to communicate orally in an academic English environment and to determine which components of oral ability for these tasks are best assessed by TOEFL iBT. To…

The need for foreign language education in the US has increased in recent years, and teaching methods based on traditional textbooks are unlikely to meet the real-world needs of current learners. As a response, interest in Language for Specific Purposes programs has grown and so has Task-Based Language Teaching (TBLT) methodology. This article…

This article presents a research study addressing the development, implementation, evaluation, and use of Interactive Modules for Online Training (MITO) of mathematics in higher education. This work was carried out in the context of the MITO project, which combined several features of the learning and management system Moodle, the computer-aided…

When conducting item reviews, analysts evaluate an array of statistical and graphical information to assess the fit of a field test (FT) item to an item response theory model. The process can be tedious, particularly when the number of human reviews (HR) to be completed is large. Furthermore, such a process leads to decisions that are susceptible…

This paper describes a curriculum-based multidimensional computerized adaptive test that was developed for Indonesia junior high school Biology. In adherence to the Indonesian curriculum of different Biology dimensions, 300 items was constructed, and then tested to 2238 students. A multidimensional random coefficients multinomial logit model was…

Remedial mathematics at the college level has evidenced strikingly low retention and passing rates. It has been shown that at least 25% of the variation in student performance is explained by students' affective variables such as attitudes, study skills, and mathematics anxiety. This study endeavored to address affective variables by: (a)…

Introduction: Use of the Internet for open Web searches is common among university students in academic learning tasks. The tools used by students to find relevant information for online assessment tasks were investigated and their information seeking behaviour was documented to explore the impact on assessment design. Method: A mixed methods…