Popular item response theory (IRT) models are considered complex, mainly due to the inclusion of a random factor variable (latent variable). The random factor variable represents the incidental parameter problem since the number of parameters increases when including data of new persons. Therefore, IRT models require a specific estimation method…

Rating scales are ubiquitous in the social sciences, yet may present practical difficulties when response formats change over time or vary across surveys. To allow researchers to pool rating data across alternative question formats, the article provides a generalization of the ordered logit model that accommodates multiple scale formats in the…

In this article, the authors share their favorite "Construct It!" activity, which focuses on rate of change and functions. The initial approach to instruction was procedural in nature and focused on making use of formulas. Specifically, after modeling how to find the slope of the line given two points and use it to solve for the…

Notwithstanding its crucial role in facilitating desired outcomes of schooling, educational psychology researchers have recognized the conceptual haziness of student engagement as a multidimensional construct. With the main purpose of refining its conceptual definition, this paper aims to attain the following four goals. First, we seek to…

Purpose: Many studies using machine learning (ML) in speech, language, and hearing sciences rely upon cross-validations with single data splitting. This study's first purpose is to provide quantitative evidence that would incentivize researchers to instead use the more robust data splitting method of nested k-fold cross-validation. The second…

In educational research, there is the general trade-off that empirical evidence should be generalizable to be applicable across contexts; at the same time, empirical evidence should be as specific as possible to be localizable in subject-specific educational interventions to successfully transfer the empirical evidence to educational practice.…

Given the frequent presence of slipping and guessing in item responses, models for the inclusion of their effects are highly important. Unfortunately, the most common model for their inclusion, the four-parameter item response theory model, potentially has severe deficiencies related to its possible unidentifiability. With this issue in mind, the…

Adolescents and young adults with autism spectrum disorders (ASD) have persistent difficulty developing and generalizing social communication and interaction skills. Emerging research has demonstrated that people with ASD have benefited from strategies that embed multiple-exemplar training (MET) to increase generalization of social skills.…

A major question for the study of learning and memory is how to tailor learning experiences to promote knowledge that generalizes to new situations. In two experiments, we used category learning as a representative domain to test two factors thought to influence the acquisition of conceptual knowledge: the number of training examples (set size)…

The unique orthographic complexities of Japanese, which utilizes multiple types of scripts (morphographic kanji and syllabic hiragana and katakana) for the same spoken language, place unique demands on early learners. Much research has centered on the average ability of Japanese readers, but given the varying challenges of these scripts, attention…

This article presents the consensus of an National Council on Measurement in Education Presidential Task Force on Foundational Competencies in Educational Measurement. Foundational competencies are those that support future development of additional professional and disciplinary competencies. The authors develop a framework for foundational…

The samples of evidence we use to make inferences in everyday and formal settings are often subject to selection biases. Two property induction experiments examined group and individual sensitivity to one type of selection bias: sampling frames - causal constraints that only allow certain types of instances to be sampled. Group data from both…

Complex Dynamic Systems Theory (CDST) has received considerable attention over the last decades, inspiring a number of second language acquisition studies. This article examines the research from a critical epistemological point of view, starting from the Greek philosopher Cratylus, who concluded that remaining silent is the only way to be…

We explore how different components of an Automatic Short Answer Grading (ASAG) model affect the model's ability to generalize to questions outside of those used for training. For supervised automatic grading models, human ratings are primarily used as ground truth labels. Producing such ratings can be resource heavy, as subject matter experts…

Learning analytics (LA) provides tools to analyze historical data with the goal of better understanding how curricular structures and features have impacted student learning. Forward-looking curriculum design, however, frequently involves a degree of uncertainty. Historical data may be unavailable, a contemplated modification to curriculum may be…