Although content validity--how well each item of an instrument represents the construct being measured--is foundational in the development of an instrument, statistical validity is also important to the decisions that are made based on the instrument. The primary purpose of this study is to demonstrate how simulation studies can be used to assist…

The Research Methods Skills Assessment (RMSA) was created to measure psychology majors' statistics knowledge and skills. The American Psychological Association's Guidelines for the Undergraduate Major in Psychology (APA, 2007, 2013) served as a framework for development. Results from a Rasch analysis with data from n = 330 undergraduates showed…

This paper describes a classroom demonstration that showcases how pre-existing beliefs (e.g., stereotypes) influence problem-solving. Across four studies, participants solved riddles with gender stereotype-consistent (e.g. doctor is male) or gender stereotype-inconsistent (e.g., doctor is female; barber is female) solutions. Solve time, perceived…

This study tests the theoretical predictions regarding effects of increasing task complexity (Robinson, 2001a, 2001b, 2007, 2010; Robinson & Gilabert, 2007) for second language (L2) pronunciation. Specifically, we examine whether more complex tasks (a) lead to greater incidence of pronunciation-focused language-related episodes (LREs) and (b)…

This study explored a diagnostic assessment method that emphasized the cognitive process of algebra learning. The study utilized a design and a theory-driven model to examine the content knowledge. Using the theory driven model, the thinking skills of algebra learning was also examined. A Bayesian network model was applied to represent the theory…

Missing data is a common problem in datasets that are obtained by administration of educational and psychological tests. It is widely known that existence of missing observations in data can lead to serious problems such as biased parameter estimates and inflation of standard errors. Most of the missing data imputation methods are focused on…

This study investigated the effect of complex structure on dimensionality assessment in compensatory multidimensional item response models using DETECT- and NOHARM-based methods. The performance was evaluated via the accuracy of identifying the correct number of dimensions and the ability to accurately recover item groupings using a simple…

Although there is no universal agreement that students should learn programming, many countries have reached a consensus on the need to expose K-12 students to Computational Thinking (CT). When, what and how to teach CT in schools are open questions and we attempt to address them by examining how well students around the world solved problems in…

The purpose is to improve insights and educational results by applying analytic methods. The focus is on the mathematics applied to learn from the kind of data available to most classes such as final examination marks or homework grades. The sample is 249 students learning introductory college statistics. The result is a predictive model for…

The aim of this simulation study, determine the relationship between true latent scores and estimated latent scores by including various control variables and different statistical models. The study also aimed to compare the statistical models and determine the effects of different distribution types, response formats and sample sizes on latent…

Using a secondary device while viewing a primary device (i.e. TV), or media multitasking, is now common. Numerous researchers and practitioners have attempted to introduce secondary devices into education as a new learning environment providing additional information to the user. However, the learning-related effects of using a second screen…

The distinction between similarity-based and rule-based strategies has instigated a large body of research in categorization and judgment. Within both domains, the task characteristics guiding strategy shifts are increasingly well documented. Across domains, past research has observed shifts from rule-based strategies in judgment to…

Assessment is an integral part of the teaching-learning process in both conventional and distance education contexts. Literature suggests that with the increase in the use of Information and Communications Technology in the delivery of learning, a number of institutions are resorting to formative assessment practices that are mediated by…

This paper investigates grammatical difficulty from the perspective of Saudi university students, of EFL as well as from the perspective of university teachers. It aims to find out which English grammar features are more difficult/less difficult than others. Furthermore, it attempts to determine the reasons and causes that account for such grammar…

We examined whether using drawing to distract, by either coloring a design or drawing a design, improves mood more than drawing to express feelings. We manipulated levels of cognitive demand in the first 2 conditions by asking participants to color a design (low cognitive demand) or draw a design (high cognitive demand). After a sad mood…