To address the computational constraints of parameter estimation in the polytomous Cognitive Diagnosis Model (pCDM) in large-scale high data volume situations, this study proposes two two-stage polytomous attribute estimation methods: P_max and P_linear. The effects of the two-stage methods were studied via a Monte Carlo simulation study, and the…

To date, small sample problems with latent growth models (LGMs) have not received the amount of attention in the literature as related mixed-effect models (MEMs). Although many models can be interchangeably framed as a LGM or a MEM, LGMs uniquely provide criteria to assess global data-model fit. However, previous studies have demonstrated poor…

When subscores on a test are reported to the test taker, the appropriateness of reporting them depends on whether they provide useful information above what is provided by the total score. Subscores that fail to do so lack adequate psychometric quality and should not be reported. There are several methods for examining the quality of subscores,…

Along with the advent of MOOCs and other online learning platforms such as Khan Academy, the role of online education has continued to grow in relation to that of traditional on-campus instruction. Rather than tackle the problem of evaluating large educational units such as entire online courses, this paper approaches a smaller problem: exploring…

Open book assessment is not a new idea, but it does not seem to have gained ground in higher education. In particular, not much literature is available on open book examinations in mathematics and statistics in higher education. The objective of this paper is to investigate the appropriateness of open book assessments in a first-year business…

Using statewide longitudinal teacher survey data collected in 2009 and 2010, this study examined the characteristics of teacher evaluation used to determine performance-related pay (PRP), and the association between PRP and improvement in the practice of constructivist instruction. The study found that 10.9% of middle school mathematics teachers…

School districts and states across the Regional Educational Laboratory Mid-Atlantic Region and the country as a whole have been modifying their teacher evaluation systems to identify more effective and less effective teachers and provide better feedback to improve instructional practice. The new systems typically include components related to…

Maxwell, Cole, and Mitchell (2011) demonstrated that simple structural equation models, when used with cross-sectional data, generally produce biased estimates of meditated effects. I extend those results by showing how simple structural equation models can produce biased estimates of meditated effects when used even with longitudinal data. Even…

Heteronormativity, the concept that heterosexual sexuality is an institutionalized norm and a superior and privileged standard, is held firm when discourses of gender, sexualities and family form converge. In a study of heteronormative discourses in the context of early childhood education, teachers shared accounts of practices where genders,…

We propose a coefficient of agreement to assess the degree of concordance between two independent groups of raters classifying items on a nominal scale. This coefficient, defined on a population-based model, extends the classical Cohen's kappa coefficient for quantifying agreement between two raters. Weighted and intraclass versions of the…

How many students repeat a grade each year? How do retention rates vary across states and over time? Despite extensive research on the predictors and consequences of grade retention, there is no systematic way to quantify state-level retention rates; even national estimates rely on imperfect proxy measures. We present a conceptually simple…

For most individuals, housing is the largest consumption and investment item of their lifetime and, as a result, housing satisfaction is an important component of their quality of life. The purpose of this paper then is to investigate the determinants of individual housing satisfaction as a particular domain of satisfaction with life as a whole,…

Across many areas of psychology, concordance is commonly used to measure the (intragroup) agreement in ranking a number of items by a group of judges. Sometimes, however, the judges come from multiple groups, and in those situations, the interest is to measure the concordance between groups, under the assumption that there is some within-group…

The main purpose of the study was to ascertain the benefits of employing a hybrid evaluation approach to assessing a teacher education programme's objectives or intended outcomes. The benefits of employing the hybrid evaluation approach enacted through its evaluation survey component was seen in the fact that it acts as a guide for participants'…

Under item response theory, the characteristic curve methods (Haebara and Stocking-Lord methods) are used to link two ability scales from separate calibrations. The linking methods use their respective criterion functions that can be defined differently according to the symmetry- and distribution-related schemes. The symmetry-related scheme…