Teachers' ability to accurately judge difficulties of mathematical tasks is an essential aspect of their diagnostic competencies. Although research has suggested that pedagogical content knowledge (PCK) is positively correlated with the accuracy of diagnostic judgments, experimental studies have not been conducted to investigate how PCK affects…

Despite the increasing demand for diagnostic information, observed subscores have been often reported to lack adequate psychometric qualities such as reliability, distinctiveness, and validity. Therefore, several statistical techniques based on CTT and IRT frameworks have been proposed to improve the quality of subscores. More recently, DCM has…

One of the most widely used communication tools in evaluation is the logic model. Despite its extensive use, there has been little research into the visualization aspect of the logic model. To assess the impact that design modifications would have on its effectiveness, we applied established visualization principles to revise a program model.…

In this study, we examined the accuracy and consistency of Greek-speaking children with spelling difficulties using a spelling level-matched design at two time points. Eighty-seven children were selected for inclusion in three groups: a group with spelling difficulties (SpD, n = 22 fifth graders) and two control groups, a chronological age-matched…

This study aims to examine the effects of mixture item response theory (IRT) models on item parameter estimation and classification accuracy under different conditions. The manipulated variables of the simulation study are set as mixture IRT models (Rasch, 2PL, 3PL); sample size (600, 1000); the number of items (10, 30); the number of latent…

Many scholars compared various item discrimination indices in real or simulated data. Item discrimination indices, such as item-total correlation, item-rest correlation, and IRT item discrimination parameter, provide information about individual differences among all participants. However, there are tests that aim to select a very limited number…

To test the predictive power of the SSARC (stabilize, simplify, automatize, reconstruct, and complexify) model of pedagogic task sequencing in second language (L2) writing development, the present study explores the performance of written decision-making tasks with varied levels of cognitive complexity in a simple-to-complex sequence in comparison…

The aim of this study was to compare, by simulation, the accuracy of mapping a cut-score from one test to another by expert judgement (using the Angoff method) versus the accuracy with a small-sample equating method (chained linear equating). As expected, the standard-setting method resulted in more accurate equating when we assumed a higher level…

The ability to synthesize and communicate complicated problems with confidence is paramount for success in STEM fields, but programs tend to overemphasize memorization. We conducted a preliminary study to determine if asking students to repeatedly link materials: (1) improved students' ability to build connections; and (2) increased students'…

Cross-situational word learning (XSWL) tasks present multiple words and candidate referents within a learning trial such that word-referent pairings can be inferred only across trials. Adults encode fine phonological detail when two words and candidate referents are presented in each learning trial (2 × 2 scenario; Escudero, Mulak, & Vlach,…

This study used wrap-up effects on eye movements to assess the relationship between online reading behavior and comprehension. Participants, assessed on measures of reading, vocabulary, and spelling, read short passages that manipulated whether a syntactic boundary was "unmarked" by punctuation, "weakly marked" by a comma, or…

In theoretical accounts of second language acquisition, socioeconomic status (SES) has a great impact on the second language (L2) learning outcomes, where their relationship is suggested to be indirect (Ellis, 1994; Gardner, 1985, 2007). Previous studies mostly focus on the influence of SES on L2 general proficiency or L2 academic achievements…

Introduction: Despite the popularity of crowdsourcing, the reliability of crowdsourced output has been questioned since crowdsourced workers display varied degrees of attention, ability and accuracy. It is important, therefore, to understand the factors that affect the reliability of crowdsourcing. In the context of producing relevance judgments,…

After explicit instruction on how to give possible bidirectional (two-way) causality explanations for a correlation, 240 students from eight sections of social psychology and research methods courses wrote "reverse causality" explanations on various test questions, creating a total of 882 answers. Averaging across multiple graded…

This study investigated the effect of complex structure on dimensionality assessment in compensatory multidimensional item response models using DETECT- and NOHARM-based methods. The performance was evaluated via the accuracy of identifying the correct number of dimensions and the ability to accurately recover item groupings using a simple…