While multiple theories exist to explain the diagnostic process, there are few available assessments that reliably determine diagnostic competence in trainees. Most methods focus on aspects of the process of diagnostic reasoning, such as the relation between case features and diagnostic hypotheses. Inevitably, detailed elucidation of aspects of…

Background: Computerised adaptive tests (CATs) are tests that provide personalised, efficient and accurate measurement while reducing testing time, depending on the desired level of precision. Schools have different types of assessments that can benefit from a significant reduction in testing time to varying degrees, depending on the area of…

We compared the influence of open-book extended duration versus closed book time-limited format on reliability and validity of written assessments of pharmacology learning outcomes within our medical and dental courses. Our dental cohort undertake a mid-year test (30xfree-response short answer to a question, SAQ) and end-of-year paper (4xSAQ,…

When cognitive and educational tests are administered under time limits, tests may become speeded and this may affect the reliability and validity of the resulting test scores. Prior research has shown that time limits may create or enlarge gender gaps in cognitive and academic testing. On average, women complete fewer items than men when a test…

Introduction: Teachers and researchers often need to evaluate word decoding skill in groupwise and in a short time. The LEO-1-min test is created to measure word reading through a lexical decision procedure where the examinee identifies pseudowords in a list of frequent words. Objetive: To examine the reliability and validity of LEO-1-min, a…

In this study, the cloze-elide test was developed and administered under time constraints. This research is aimed to examine the validity and reliability of the speeded cloze-elide test and investigate its relationship with reading comprehension, C-Test, and multiple-choice cloze test. Processing speed is a vital indicator to distinguish high to…

Differential granting of extra-examination time (EET) is commonly based on learning disabilities (LD) status: EET is granted to LD examinees and is denied to nondisabled examinees. We argue that LD serves as a proxy for the extent to which time limitation affects the examinee's test score (e). Hence, the validity of the LD-based EET granting…

The C-test as a measure of first and second language proficiency suffers from ceiling effect. That is, the C-test is very easy for native speakers and for advanced second language learners and many examinees obtain full scores. Therefore, the test cannot distinguish among advanced learners or native speakers. Speeded C-test is suggested as a…

The purpose of this study was to examine 4 early writing measures used to monitor the early writing progress of 1st-grade students. We administered the measures to 23 1st-grade students biweekly for a total of 16 weeks. We obtained 3-min samples and conducted analyses for each 1-min increment. We scored samples using 2 different methods: correct…

The purpose of this study was to examine the validity and reliability of Curriculum-Based Measures in writing for English learners. Participants were 36 high school English learners with moderate to high levels of English language proficiency. Predictor variables were type of writing prompt (picture, narrative, and expository), time (3, 5, and 7…

Results obtained by the Kudar-Richardson formula (20) adapted for use with R-KW scoring are compared with three other reliability formulas. Based on parallel tests administered at the same sitting the KR (20) estimates are compared with alternate-form correlations and with odd-even correlations adjusted by the Spearman-Brown prophecy formula.…

Contrary to common belief, reliability estimates of number-right multiple-choice tests are not inflated by speededness. Because examinees guess on questions when they run out of time, the responses to these questions show less consistency with the responses of other questions, and the reliability of the test will be decreased. The surprising…

Describes a study designed to determine whether one-minute or two-minute tests of reading rates are more reliable and whether warm-up exercises improve the accuracy of rate measures. Indicates that results were inconsistent with theoretical expectations and past research and suggests that no changes in standardized testing practices are currently…

This study compared four methods for setting item response time thresholds to differentiate rapid-guessing behavior from solution behavior. Thresholds were either (a) common for all test items, (b) based on item surface features such as the amount of reading required, (c) based on visually inspecting response time frequency distributions, or (d)…