Data-mined models often achieve good predictive power, but sometimes at the cost of interpretability. We investigate here if selecting features to increase a model's construct validity and interpretability also can improve the model's ability to predict the desired constructs. We do this by taking existing models and reducing the feature set to…

Alzheimer's disease (AD) can impair metacognition in addition to more basic cognitive functions like memory. However, while global metacognitive inaccuracies are well documented (i.e., low deficit awareness, or anosognosia), the evidence is mixed regarding the effects of AD on local or task-based metacognitive judgments. Here we investigated local…

Data from 181 college students were used to assess whether math reasoning item response times in computerized testing can provide valid and reliable measures of a speed dimension. The alternate forms reliability of the speed dimension was .85. A two-dimensional structural equation model suggests that the speed dimension is related to the accuracy…

The purpose of this study was to investigate whether hyphens that disambiguate phrasing in ambiguous sentences influence reading rate and reading comprehension for younger and older adults. Moreover, as working memory (WM) has been implicated in age-related changes in sentence comprehension for both auditory and written materials, we asked if it…

Accuracy for a second target (T2) is reduced when it is presented within 500 ms of a first target (T1) in a rapid serial visual presentation (RSVP)--an attentional blink (AB). There are reliable individual differences in the magnitude of the AB. Recent evidence has shown that the attentional approach that an individual typically adopts during a…

In administration of individually administered intelligence tests, items are commonly presented in a sequence of increasing difficulty, and test administration is terminated after a predetermined number of incorrect answers. This practice produces stochastically censored data, a form of nonignorable missing data. By manipulating four factors…

This study presents an evaluation of the diagnostic accuracy and concurrent validity of Direct Behavior Rating Single Item Scales for use in school-based behavior screening of second-grade students. Results indicated that each behavior target was a moderately to highly accurate predictor of behavioral risk. Optimal universal screening cut scores…

The impact of uncertainty about item parameters on test information functions is investigated. The information function of a test is one of the most important tools in item response theory (IRT). Inaccuracy in the estimation of test information can have substantial consequences on data analyses based on IRT. In this article, the major part (called…

This article introduces two new classification consistency indices that can be used when item response theory (IRT) models have been applied. The new indices are shown to be related to Rudner's classification accuracy index and Guo's classification accuracy index. The Rudner- and Guo-based classification accuracy and consistency indices are…

Measurement scholars have recently constructed validity arguments in support of a variety of educational assessments, including classroom observation instruments. In this article, we note that users must examine the robustness of validity arguments to variation in the implementation of these instruments. We illustrate how such an analysis might be…

Deaf Learners' Acquisition of fundamental lexical properties of high-frequency English verbs related to transitivity and intransitivity was examined, including the subtle distinction between unergative and unaccusative verbs. A 140-item sentence acceptability rating scale was used to assess this lexical knowledge in deaf college students at two…

Wikis, as one of the Web 2.0 social networking tools, have been increasingly integrated into second language (L2) instruction to promote collaborative writing. The current study examined and compared summary writing abilities between students learning by wiki-based collaboration and students learning by traditional face-to-face collaboration.…

For native (L1) comprehenders, lower-level language processes such as lexical access and parsing are considered to consume few cognitive resources. In contrast, these processes pose considerable demands for second-language (L2) comprehenders. Two reading-time experiments employing inconsistency detection found that English learners did not detect…

The beliefs, attitudes, experiences and responses that Hong Kong higher education students have about assessment are an important facet to developing our understanding of the "Chinese learner". Using six focus groups, 26 Hong Kong university students drew pictures of assessment. The visual elements of the pictures were content analysed…

This article examines changes in the research design, sample size, and precision between the planning phase and implementation phase of group randomized trials (GRTs) funded by the Institute of Education Sciences. Thirty-eight GRTs funded between 2002 and 2006 were examined. Three studies revealed changes in the experimental design. Ten studies…