Since the early 2000s, literacy education has become an area of intense focus in Australian education policy, positioned to have a role in Australia's pursuit of enhanced international competitiveness in the "global knowledge economy". Policy called for improvements in literacy outcomes, monitored by mandated annual assessments, and…

Purpose: Evidence-based data analysis methods are important in clinical research fields, including speech-language pathology and audiology. Although commonly used, null hypothesis significance testing (NHST) has several limitations with regard to the conclusions that can be drawn from results, particularly nonsignificant findings. Bayes factors…

Most of the existing classification accuracy indices of attribute patterns lose effectiveness when the response data is absent in diagnostic testing. To handle this issue, this article proposes new indices to predict the correct classification rate of a diagnostic test before administering the test under the deterministic noise input…

Two-stage collaborative testing is an assessment strategy that involves students initially writing a test individually and then immediately afterward writing the same (or similar) test again in groups. Current evidence shows that two-stage testing improves performance on multiple-choice tests as well as short-term retention of material, but little…

Null hypothesis testing has long since been the 'go-to analytic approach' in quantitative second language (L2) research (Norris, 2015, p. 97). To many, however, years of reliance on this approach has resulted in a crisis of inference across the social and behavioral sciences (e.g., Rouder et al., 2016). As an alternative to the null hypothesis…

This study sought to determine whether an evaluator conducting electronic course evaluations in person in a classroom increased response rates. At a large public university in the United States, course evaluations were being conducted electronically, attaining a response rate of <50% over several semesters. At the end of the Spring 2015 at this…

Computer-based assessment (CBA) is an important area of e-learning research. Most studies of CBA technology add new constructs to existing user acceptance models and rarely consider the moderating effects. However, the self-regulation (SR) levels (i.e., high or low) in an e-learning environment substantially affect individual learning behaviour…

Purpose: Well-designed assessment methodologies and various cognitive diagnosis models (CDMs) to extract diagnostic information about examinees' individual strengths and weaknesses have been developed. Due to this novelty, as well as educational specialists' lack of familiarity with CDMs, their applications are not widespread. This article aims at…

Examinees' performances are assessed using a wide variety of different techniques. Multiple-choice (MC) tests are among the most frequently used ones. Nearly, all standardized achievement tests make use of MC test items and there is a variety of ways to score these tests. The study compares number right and liberal scoring (SAC) methods. Mixed…

Summary Employing a Wald confidence interval to test hypotheses about population proportions could lead to an increase in Type I or Type II errors unless the hypothesized value, p0, is used in computing its standard error rather than the sample proportion. Whereas the Wald confidence interval to estimate a population proportion uses the sample…

We examined the effect of two methods of assessment--multiple-choice sentence-picture matching and an animated sentence-verification task--on typically developing children's understanding of relative clauses. A sample of children between the ages of 3 years 6 months and 4 years 11 months took part in the study (N = 103). Results indicated that (a)…

Infants' ability to perform visual short-term memory (VSTM) tasks develops rapidly between 6 and 8 months. Here we tested the hypothesis that infants' VSTM performance is influenced by their ability to individuate simultaneously presented objects. We used a "one-shot change detection task" to ask whether 6-month-old infants (N = 47)…

James Madison University has used dedicated Assessment Days for more than 30 years to collect longitudinal data on student learning outcomes. Our model ensures all incoming students are tested twice: once before beginning classes and again after accumulating 45-70 credit hours. Although each student completes only four instruments during a 2-hour…

In 2009 New York State began an initiative to improve teaching and learning through the implementation of new teacher certification exams. The Academic Literacy Skills Test (ALST) replaced the much-maligned Liberal Arts and Sciences Exam (LAST) that had been in a legal battle with minority test takers since 1996. Billed as a "basic test of…

Many large-scale educational surveys have moved from linear form design to multistage testing (MST) design. One advantage of MST is that it can provide more accurate latent trait [theta] estimates using fewer items than required by linear tests. However, MST generates incomplete response data by design; hence questions remain as to how to…