Agreement statistics and measures of prediction accuracy are often used to assess the quality of two measures of a construct. Agreement statistics are appropriate for measures that are supposed to be interchangeable, whereas prediction accuracy statistics are appropriate for situations where one variable is the target and the other variables are…

The items that are suitable for everyone's own ability level with the support of computer programs instead of paper and pencil tests may help students to reach more accurate results. Computer adaptive tests (CAT), which are developed based on certain assumptions in this direction, are to create an optimum test for every person taking the exam. It…

The present study investigated the predictability of a computer-adaptive, curriculum-based reading assessment for measuring second-grade students' overall and comprehension reading achievement on a standardized reading achievement test. Specifically, second-grade student scores (N = 428) of the Istation's Indicators of Progress for Early Reading…

Children have traditionally been viewed as less reliable witnesses than are adults. More recently, a concept known as developmental reversals, has brought this view into question. Developmental reversals have demonstrated that in certain contexts, children produce fewer false memories than adults. The primary paradigm used to demonstrate…

Computerized assessments and interactive simulation tasks are increasingly popular and afford the collection of process data, i.e., an examinee's sequence of actions (e.g., clickstreams, keystrokes) that arises from interactions with each task. Action sequence data contain rich information on the problem-solving process but are in a nonstandard,…

It has been demonstrated that the Simon effect may be increased or reversed due to proportion congruency manipulation, suggesting that learned spatial irrelevant stimulus-response (S-R) associations are used to guide responses. In this study, we tested the hypothesis that learning spatial irrelevant S-R associations by rewards may show a similar…

Studies have shown that item difficulty can vary significantly based on the context of an item within a test form. In particular, item position may be associated with practice and fatigue effects that influence item parameter estimation. The purpose of this research was to examine the relevance of item position specifically for assessments used in…

This study investigated the constructs underlying second language (L2) word association (WA) with regard to three dimensions of lexical competence--size, organization, and accessibility--and the lexical performance of speech. One-hundred and thirteen Japanese learners of English completed a computer-delivered oral WA task along with three…

Empirically supported multimedia learning (MML) principles [1] suggest effective ways to design instruction, generally for elements on the order of a graphic or an activity. We examined whether the positive impact of MML could be detected in larger instructional units from a MOOC. We coded instructional design (ID) features corresponding to MML…

Purpose: The purpose of this study was to develop and pilot a novel treatment framework called "BEARS" (Balancing Effort, Accuracy, and Response Speed). People with aphasia (PWA) have been shown to maladaptively balance speed and accuracy during language tasks. BEARS is designed to train PWA to balance speed-accuracy trade-offs and…

The heightened importance of foreign languages (L2) in the post 9-11 world demands more L2 listening research as listening is considered the most critical skill for most American military linguists. Some larger studies show that lexical knowledge can positively affect L2 listening (Chang, 2007; Mehrpour & Rahimi, 2010; Staehr, 2009), yet…

This study examined the following question: What is the relationship, if any, between COMPASS placement scores and the student success in the first online course during the students first semester? Discriminant function analysis was used to examine the relationship. This study used existing data from new students, who took the COMPASS placement…

The current work uses memory errors to examine the mental representation of verb-particle constructions (VPCs; e.g., "make up" the story, "cut up the meat"). Some evidence suggests that VPCs are represented by a cline in which the relationship between the VPC and its component elements ranges from highly transparent ("cut…

The present study investigates integrated writing assessment performances with regard to the linguistic features of complexity, accuracy, and fluency (CAF). Given the increasing presence of integrated tasks in large-scale and classroom assessments, validity evidence is needed for the claim that their scores reflect targeted language abilities.…

This study sought to provide a framework for evaluating machine score-ability of items using a new score-ability rating scale, and to determine the extent to which ratings were predictive of observed automated scoring performance. The study listed and described a set of factors that are thought to influence machine score-ability; these factors…