Purpose: Our aim was to evaluate the psychometric properties of the online administered format of the Test of Narrative Language--Second Edition (TNL-2; Gillam & Pearson, 2017), given the importance of assessing children's narrative ability and considerable absence of psychometric studies of spoken language assessments administered online.…

As a form of assessment, examinations are designed to determine whether students have met learning outcomes. However, students with disabilities report avoiding examinations, selecting units of study where the assessments align with their strengths. To ensure examinations do not contribute to the systematic exclusion of students with disabilities,…

As a spoken word unfolds over time, similar sounding words ("cap" and "cat") compete until one word "wins". Lexical competition becomes more efficient from infancy through adolescence. We examined one potential mechanism underlying this development: lexical inhibition, by which activated candidates suppress…

English learners (ELs) comprise approximately 10% of kindergarten to Grade 12 students in US public schools, with about 15% of ELs identified as having disabilities. English language proficiency (ELP) assessments must adhere to universal design principles and incorporate universal tools, designed to increase accessibility for all ELs, including…

The premise of this research is that analytical and extensive reading in a digital environment might be used to facilitate second language acquisition at the tertiary education level. Despite the general orientation toward communicative methods in modern second language acquisition, reading methods and techniques have seen an unexpected yet very…

The purpose of this evaluation was to examine the impact of i-Ready Personalized Instruction on math achievement, as measured by SBA scores. We compared students in schools using i-Ready Personalized Instruction school-wide (Treatment students) and students who only received i-Ready Diagnostic assessments and who were in schools only partially…

Target onsets in dynamically changing displays can be predicted when contingencies exist between different stimulus states over time. In the present study, we examined predictive monitoring when participants searched dynamically changing displays of numbers and colored squares for a color target, a number target, or both. Stimuli were presented in…

The increasing interest in electronic management of assessment is a sign of a gradual institutionalisation of e-submission and e-marking technologies in UK Higher Education. The effective adoption of these technologies requires a managed approach, especially a detailed understanding of current assessment practices within the institution and the…

Extension faculty and staff are constantly planning, implementing, and evaluating programming efforts. Data from participants are needed for assessing changes in knowledge, attitude, and behavior through summative and formative evaluation. However, collecting these data can be time-consuming and hard to achieve. A technological tool called…

Traditional and online university courses share expectations for quality content and rigor. Student and faculty concerns about compromised academic integrity and actual instances of academic dishonesty in assessments, especially with online testing, are increasingly troublesome. Recent research suggests that in the absence of proctoring, the time…

This research derived information functions and proposed new scalar information indices to examine the quality of multidimensional forced choice (MFC) items based on the RANK model. We also explored how GGUM-RANK information, latent trait recovery, and reliability varied across three MFC formats: pairs (two response alternatives), triplets (three…

Diagnostic classification models (DCMs) can provide multidimensional diagnostic feedback about students' mastery levels of knowledge components or attributes. One advantage of using DCMs is the ability to accurately and reliably classify students into mastery levels with a relatively small number of items per attribute. Combining DCMs with…

In this study we developed and evaluated a crowdsourcing-based latent semantic analysis (LSA) approach to computerized summary scoring (CSS). LSA is a frequently used mathematical component in CSS, where LSA similarity represents the extent to which the to-be-graded target summary is similar to a model summary or a set of exemplar summaries.…

With the widespread use of technology in the assessment field, many testing programs use both computer-based tests (CBTs) and paper-and-pencil tests (PPTs). Both the Standards for Educational and Psychological Testing (AERA, APA, & NCME, 2014) and the International Guidelines on Computer-Based and Internet Delivered Testing (International Test…

As large-scale standardized tests move from paper-based to computer-based delivery, opportunities arise for test developers to make use of items beyond traditional selected and constructed response types. Technology-enhanced items (TEIs) have the potential to provide advantages over conventional items, including broadening construct measurement,…