In this Forum article, Komatsu and Rappleye report that the results of PISA 2015 released December 2016 revealed a major oddity: reading scores in several of the "leading" East Asian countries had apparently plummeted. An interesting point is that Japan, Taiwan, Korea and Hong Kong are among the most advanced technological societies in…

Using the capabilities of expert knowledge structures, the researcher prepared test questions on the university calculus topic of "finding the area by integration." The quiz is divided into two types of multiple choice items (one out of four and one out of many). After the calculus course was taught and tested, the results revealed that…

This paper is based on a design-based research project investigating how to use digital resources to help activate formative assessment processes in the classroom. Performed as part of FaSMEd, a European Union project, our own project adopts a comprehensive theoretical framework, including the different functionalities of technology, formative…

This article discusses talk and gesture as neglected sources of process data (Maddox, 2015, Maddox and Zumbo, 2017). The significance of the article is the growing use of various sources of process data in computer-based testing (Ercikan and Pellegrino, (Eds.) 2017; Zumbo and Hubley, (Eds.) 2017). The use of process data on talk and gesture…

This article is a review of literature on online formative assessment (OFA). It includes a narrative summary that synthesizes the research on the diverse delivery methods of OFA, as well as the empirical literature regarding the strong psychological benefits and limitations. Online formative assessment can be delivered using many traditional…

This study aimed to investigate the effects of using online formative assessments on students' learning achievements. Using a quasi-experimental study design with one control group (no formative assessments available), and two experimental groups receiving feedback in available online formative assessments (knowledge of the correct response--KCR,…

Research investigating corpora of English learners' language raises new questions about how syntactic complexity is defined theoretically and operationally for second language (L2) writing assessment. I show that syntactic complexity is important in construct definitions and L2 writing rating scales as well as in L2 writing research. I describe…

Background: This study examined the comparability of reading and writing tasks of two English language proficiency tests--the General English Proficiency Test-A (GEPT-A) developed by Language Training Center, Taipei and the Internet-Based Test of English as a Foreign Language (iBT) developed by Educational Testing Service, Princeton. Methods: Data…

With the online assessment becoming mainstream and the recording of response times becoming straightforward, the importance of response times as a measure of psychological constructs has been recognized and the literature of modeling times has been growing during the last few decades. Previous studies have tried to formulate models and theories to…

The Every Student Succeeds Act (ESSA) provides greater flexibility in state accountability systems than did previous federal legislation. In response, many states continue to refine their accountability systems to include college readiness tests, including college admissions and placement exams. This paper summarizes perspectives of K-12…

Massive Open Online Courses (MOOCs) are a promising form of online education. However, the occurrence of academic dishonesty has been threatening MOOC certificates' effectiveness as a serious tool for recruiters and employers. Recently, a large-scale study on the log traces from more than one hundred MOOCs created by Harvard and MIT has identified…

Adaptive testing is advantageous in that it provides more efficient ability estimates with fewer items than linear testing does. Item-driven adaptive pretesting may also offer similar advantages, and verification of such a hypothesis about item calibration was the main objective of this study. A suitability index (SI) was introduced to adaptively…

Among the several forms of accommodations used in the assessment of English language learners (ELLs), language-based accommodations are the most effective in making assessments linguistically accessible to these students. However, there are significant challenges associated with the implementation of many of these accommodations. This article…

On August 7th, 2013, the New York State Education Commissioner, John King, announced the initial results of the state's new assessment, which was designed to measure college and career readiness relative to the Common Core Learning Standards. Commissioner King noted that the proficiency rates on these assessments were significantly lower than…

Item response theory parameters have to be estimated, and because of the estimation process, they do have uncertainty in them. In most large-scale testing programs, the parameters are stored in item banks, and automated test assembly algorithms are applied to assemble operational test forms. These algorithms treat item parameters as fixed values,…