Purpose: In this study, we investigated the agreement between the 175-item Philadelphia Naming Test (PNT; Roach, Schwartz, Martin, Grewal, & Brecher, 1996) and a 30-item computer adaptive PNT (PNT-CAT; Fergadiotis, Kellough, & Hula, 2015; Hula, Kellough, & Fergadiotis, 2015) created using item response theory (IRT) methods. Method: The…

Generalization is a fundamental problem solved by every cognitive system in essentially every domain. Although it is known that how people generalize varies in complex ways depending on the context or domain, it is an open question how people "learn" the appropriate way to generalize for a new context. To understand this capability, we…

In an on-demand testing program, some items are repeatedly used across test administrations. This poses a risk to test security. In this study, we considered a scenario wherein a test was divided into two subsets: one consisting of secure items and the other consisting of possibly compromised items. In a simulation study of multistage adaptive…

Although the null hypothesis significance testing procedure is problematic, many still favor the use of "p"-values as indicating the state of evidence against the model used to generate the "p"-value. From this perspective, "p"-values benefit science; or would benefit science if used correctly. In contrast, the novel…

Monolingual content assessments of multilingual students remarkably fail their most essential endeavor--to provide meaningful information about their content proficiency. Multilingual students take years to catch up with their monolingual peers in terms of language proficiency, and it is inappropriate to assess them using a language that they do…

This study explores faculty beliefs about teaching and learning in different institutional settings and over time. This study surveyed faculty at two Canadian universities, one research-intensive, the other teaching-intensive, using a conceptual replication of a survey originally administered in 1976. Some results differ from the original survey,…

There is considerable variability in the literacy assessments taken in Kindergarten through second grade, across schools and between multilingual learners and other students, and within students over time. This makes it difficult to study changes in students' acquisition of ELA skills in these formative years, or to evaluate policies and practices…

Background: Current UK measures of early spoken language comprehension require manipulation of toys and/or verbal responses and are not accessible to children with severe motor impairments. The Computer-Based Instrument for Low motor Language Testing (C-BiLLT) (originally validated in Dutch) is a computerized test of spoken language comprehension…

Written assignments for large classes pose a far more significant challenge in the age of the GenAI revolution. Suggestions such as oral exams and formative assessments are not always feasible with many students in a class. Therefore, we conducted a study in South Africa and involved 280 Honors students to explore the usefulness of Turnitin's AI…

Self-knowledge is an important element of metacognition. It encompasses understanding one's own strengths and weaknesses and includes belief and self-assessment of one's capacity to perform a task. Cognitive skills comprise a range of mental processes, such as attention, memory, problem solving, systems thinking, abstract thinking, and critical…

Within the research on bilingual learning, first studies have revealed that content learned in one language is retrieved more slowly when participants have to switch language from instruction to testing (i.e., language-switching costs, LSC). These costs are attributed to language-dependent knowledge representations. However, the cognitive…

In this article, I respond creatively to the recent Australian Government Department of Education Teacher education expert panel [TEEP] report entitled "Strong Beginnings." Released in July 2023 and led by Professor Mark Scott AO, the report outlines problems pertaining to teacher education in Australia. It aims to improve student…

Background: Individuals with intellectual disabilities are at increased risk of mental health disorders, but may struggle to access appropriate services. While assessment/treatment may need to be adapted, knowledge is limited about what such adaptations may entail. Method: During a service development project, the participants (33 professionals,…

Role-play activities are considered a useful instructional design in enhancing the speaking performance of foreign language learners. However, in the traditional classroom context, learners may not readily have access to interlocutors for role-play activities. In this study, we proposed a designed method that integrated the GenAI agent into…

The integration of Generative Artificial Intelligence (GenAI) in education has introduced innovative approaches to assessment. One such approach is AI chatbot-based assessment, which utilizes large language models to provide students with timely and consistent feedback. However, the effectiveness of AI chatbots in generating assessments comparable…