Second languages (L2s) are often learned through spoken and written input, and L2 orthographic forms (spellings) can lead to non-native-like pronunciation. The present study investigated whether orthography can lead experienced learners of English[subscript L2] to make a phonological contrast in their speech production that does not exist in…

This classroom-based study employs a mixed-methods approach to exploring both short-term and long-term effects of Criterion feedback on ESL students' development of grammatical accuracy. The results of multilevel growth modeling indicate that Criterion feedback helps students in both intermediate-high and advanced-low levels reduce errors in eight…

Current and emerging technologies enable Open Distance Learning (ODL) institutions integrate e-Learning in innovative ways and add value to the existing teaching-learning and assessment processes. ODL e-Assessment systems have evolved from Computer Assisted/Aided Assessment (CAA) systems through intelligent assessment and feedback systems.…

This study examines test-takers' views on a computer-delivered speaking test in order to investigate the aspects they consider most relevant in technology-based oral assessment, and to explore the main advantages and disadvantages computer-based tests may offer as compared to face-to-face speaking tests. A small-scale open questionnaire was…

Examining the testing processes, as well as the scores, is needed for a complete understanding of validity and fairness of computer-based assessments. Examinees' rapid-guessing and insufficient familiarity with computers have been found to be major issues that weaken the validity arguments of scores. This study has three goals: (a) improving…

This article describes a case study in which Our Lady of Hungary Catholic School (OLH) principal Kevin Goralczyk and the parish's pastor, Reverend Kevin Bauman, faced educators' universal challenge: Knowing what students need to learn but wondering how to evaluate if they were really successfully taking in the information rather than simply…

Can student performance on computer-based tests (CBT) and paper-and-pencil tests (PPT) be considered equivalent measures of student knowledge? States and school districts are grappling with this question, and although studies addressing this question are growing, additional research is needed. We report on the performance of students who took…

This study investigated the cognitive processes underlying pauses at different textual locations (e.g., within/between words) and various levels of revision (e.g., below word/clause). We used stimulated recall, keystroke logging, and eye-tracking methodology in combination to examine pausing and revision behaviors. Thirty advanced Chinese L2 users…

This technical assistance paper provides policy and guidance to individuals with test administration responsibilities in adult education programs. The Florida assessment policies and guidelines presented in this paper are appropriate for state and federal reporting. Therefore, guidance and procedures regarding the selection and use of appropriate…

The validity of the computer-based language test is possibly affected by three factors: computer familiarity, audio-visual cognitive competence, and other discrepancies in construct. Therefore, validating the equivalence between the paper-and-pencil language test and the computer-based language test is a key step in the procedure of designing a…

Low health literacy is associated with poor health outcomes. Research is needed to understand the mechanisms and pathways of its effects. Computer-based assessment tools may improve efficiency and cost-effectiveness of health literacy research. The objective of this preliminary study was to assess if administration of the Short Test of Functional…

Diagnostic testing has long been valued by language testing researchers and practitioners for its ability to inform both teaching and learning. However, the number of well-developed diagnostic language tests is relatively low, most likely due to the difficulty in constructing a diagnostic test that incorporates a wide enough range of language…

This study uses mixed integer quadratic programming (MIQP) to construct multiple highly equivalent item pools simultaneously, and compares the results from mixed integer programming (MIP). Three different MIP/MIQP models were implemented and evaluated using real CAT item pool data with 23 different content areas and a goal of equal information…

The development of statistical methods for detecting test collusion is a new research direction in the area of test security. Test collusion may be described as large-scale sharing of test materials, including answers to test items. Current methods of detecting test collusion are based on statistics also used in answer-copying detection.…

Automated test assembly uses the methodology of mixed integer programming to select an optimal set of items from an item bank. Automated test-form generation uses the same methodology to optimally order the items and format the test form. From an optimization point of view, production of fully formatted test forms directly from the item pool using…