The fit of an item response model is typically conceptualized as whether a given model could have generated the data. We advocate for an alternative view of fit, "predictive fit", based on the model's ability to predict new data. We derive two predictive fit metrics for item response models that assess how well an estimated item response…

The influx of data and the advances in computing have led to calls to update the introductory statistics curriculum to better meet the needs of the contemporary workforce. To this end, we developed the COMputational Practices in Undergraduate TEaching of Statistics (COMPUTES) instrument, which can be used to measure the extent to which computation…

This study investigates the relationships among factor correlations, inter-item correlations, and the reliability estimates of subscores, providing a guideline with respect to psychometric properties of useful subscores. In addition, it compares subscore estimation methods with respect to reliability and distinctness. The subscore estimation…

The vibrant demand for academic excellence in the twenty-first century has brought diverse determinants of students' outcome into play. However, few studies have validated the instruments and examined the mediating effect between exogenous and endogenous variables of the student outcome model. This study, therefore, investigates the psychometric…

This paper briefly discusses four measurement challenges of data science or "big data" in educational assessments that are enabled by technology: 1. Dealing with change over time via time-based data. 2. How a digital performance space's relationships interact with learner actions, communications and products. 3. How layers of…

The role of teacher assistants has paralleled the changes in education over the years. The teacher assistants, who numbered 1.3 million in 2008 and are projected to increase by 10 percent by 2018 (Office of Labor Statistics, 2012) are valuable members of our educational communities providing support to students with special needs. These teacher…

The population of Spanish-speaking preschoolers in the United States continues to increase and there is a significant need to develop psychometrically sound early language and literacy screening measures to accurately capture children's ability in Spanish. In this paper, we describe the innovative design and calibration process of the new…

The authors examined the psychometric properties of the Counseling Competencies Scale (CCS; University of Central Florida Counselor Education Faculty, 2009), an instrument designed to assess trainee competencies as measured in their counseling skills, dispositions, and behaviors. There was strong internal consistency for the 4-factor model for…

A number of psychometricians have argued for the use of parallel analysis to determine the number of factors. However, parallel analysis must be viewed at best as a heuristic approach rather than a mathematically rigorous one. The authors suggest a revision to parallel analysis that could improve its accuracy. A Monte Carlo study is conducted to…

Accountability systems that measure student learning rather than student achievement have the potential to more accurately evaluate school quality. However, one methodological concern has remained surprisingly absent from discussions of value-added modeling. Standardized assessments that exhibit either positive or negative correlations between…

Verbal ability comprises receptive (understanding) and active (producing) facets. While the first (e.g. as literacy in PIRLS and PISA) is frequently analyzed in its relationship to further cognitive abilities and parental attributes the latter is rarely investigated. The present study using data from N=280 students aged 9 to 14 years investigated…

A new class of parametric models that generalize the multivariate probit model and the errors-in-variables model is developed to model and analyze ordinal data. A general model structure is assumed to accommodate the information that is obtained via surrogate variables. A hybrid Gibbs sampler is developed to estimate the model parameters. To…

Increasing college participation rates, and diversity in student population, is posing a challenge to colleges in their attempts to facilitate learners achieve their full academic potential. Learning analytics is an evolving discipline with capability for educational data analysis that could enable better understanding of learning process, and…

Cross-national comparisons of responses to survey items are often affected by response style, particularly extreme response style (ERS). ERS varies across cultures, and has the potential to bias inferences in cross-national comparisons. For example, in both PISA and TIMSS assessments, it has been documented that when examined within countries,…

The aim of this study was to develop the scale to assess irrational beliefs of parents and test its psychometric properties. The research sample was comprised of parents whose children were attending primary schools. The results from the factor analysis were used to determine two factors in the scale: Expectations and Perfectionism. To examine the…