Many different elements have a significant impact on the effectiveness of both teaching and assessment. The ever-expanding body of research on assessment has provided an overview of several cognitive, social, and emotional aspects that impact the academic accomplishment of learners in either a direct or indirect manner. In spite of the promising…

J.D. Brown (JD) served as the author of an instructional column titled "Statistics Corner" in the "Shiken": JALT "Testing & Evaluation SIG Newsletter" for an extensive period spanning over two decades, from 1997 to 2019. This publication was under the auspices of the Testing and Evaluation Special Interest Group,…

In the test-centric Thai education system, results on national exams are often viewed as indicators of educational success. These exams use multiple-choice which can have detrimental effects on students' attitudes and learning. If school assessments also rely on multiple-choice exams, the situation would be worrying, yet there is little data…

The Multilevel Assessment of Science Standards (MASS) project is creating a new generation of technology-enhanced formative assessments that bring the best formative assessment practices into classrooms to transform what, how, when, and where science learning is assessed. The project is investigating the feasibility, utility, technical quality,…

When English learners are "reclassified" as fluent English proficient, often their instructional setting changes, including a significant reduction in or elimination of English language development services. Depending on a child's language skills, this instructional change could hinder future development or provide needed opportunities…

Drawing on experience between 2000 and 2007 in developing a validity argument for the high-stakes Test of English as a "Foreign Language[TM]" (TOEFL[R]), this paper evaluates the differences between the argument-based approach to validity as presented by "Kane (2006)" and that described in the 1999 "AERA/APA/NCME Standards for Educational and…

This article discusses CALL development from both educational and ergonomic perspectives. It focuses on the learner-task-tool interaction, in particular on the aspects contributing to its overall quality, herein called "usability." Two pilot studies are described that were carried out with intermediate to advanced learners of French in two…

We examined the technical adequacy of writing progress measures as indicators of success on state standards tests. Tenth-grade students wrote for 10 min, marking their samples at 3, 5, and 7 min. Samples were scored for words written, words spelled correctly, and correct and correct minus incorrect word sequences. The number of correct minus…

That the English learner (EL) student population is growing is not a problem, but that ELs are not generally thriving in U.S. classrooms is. ELs score lower on tests, get poorer grades, take fewer advanced or college prep classes at the secondary level, and graduate from high school at much lower rates than do native speakers of English. Moreover,…

The purpose of this study was to determine the statistical difference of a proficient score on the third and forth grade teacher-created criterion-referenced math assessments, aligned to state standards, on the Tennessee Comprehensive Achievement Program (TCAP). This study examined if this statistical difference relates to minority,…

I welcome the feedback from Downey et al. on my analysis of the "Versant for English" Test (formerly called the PhonePass Test), as it provides opportunities to engage in dialogue on differing notions of language performance and authenticity and address the implications of technological expediency influencing and shaping the design of test tasks.…

Two teachers engage in assessment discussions based on an analytical rubric to assess an ELL student's writing. Discourse analysis methods were used to analyze recorded/transcribed assessments and discussions. The teachers focused on descriptors for the rubric's lowest scores, neglecting their own knowledge and experience with English learners. As…

This study analyzes the Arizona policy of utilizing a single assessment of English proficiency to determine if students should be exited from the ELL program, which is ostensibly designed to make it possible for them to succeed in the mainstream classroom without any further language support. The study examines the predictive validity of this…

Identifies different types of tests and then treats evaluation tests at some length. Emphasizes that there is no such things as a universal test, which can be used to measure the second-language competence of any group of people," and that tests are only useful for the group they were designed to measure." (FB)

Examines objectivity as a criterion for excellency in language tests through a critical presentation of the characteristics of objective tests. This examination leads to a discussion of what the best approach to testing language might be, endorsing a combination of integrative and objective techniques. (Author/MES)