Systematic direct observations (SDOs) and behavior rating scales are integral to multimethod behavioral assessment approaches. The present study investigated the convergent validity of the Behavior Observation of Students in Schools (BOSS) form, a widely utilized SDO system, with the most frequently used teacher rating scales in schools, the…

Assessment is a topic of concern to all stakeholders in our educational system. Pattern Based Questions are an assessment tool which is an alternative to the standardized assessment tool, and they are based on generative learning pedagogy, which shows promise in engaging all learners and usefulness in teaching and learning but validity has not yet…

This study aimed to examine the validity and reliability evidence of Teacher Self-efficacy (TSE) scale (Tschannen-Moran & Hoy, 2001) for teacher in K-12 US schools. Particularly, our study gathered evidence for the internal structure validity, convergent validity, criterion validity and reliability of the TSES in US educational context. The…

Evidence-based assessment (EBA) requires that investigators employ scientific theories and research findings to guide decisions about what domains to measure, how and when to measure them, and how to make decisions and interpret results. To implement EBA, investigators need high-quality assessment tools along with evidence-based processes. We…

Purpose: In this study, we investigated the agreement between the 175-item Philadelphia Naming Test (PNT; Roach, Schwartz, Martin, Grewal, & Brecher, 1996) and a 30-item computer adaptive PNT (PNT-CAT; Fergadiotis, Kellough, & Hula, 2015; Hula, Kellough, & Fergadiotis, 2015) created using item response theory (IRT) methods. Method: The…

Cognitive diagnosis models (CDMs) are latent class multidimensional statistical models that help classify people accurately by using a set of discrete latent variables, commonly referred to as attributes. These models require a Q-matrix that indicates the attributes involved in each item. A potential problem is that the Q-matrix construction…

Rater-mediated assessments require the evaluation of the accuracy and consistency of the inferences made by the raters to ensure the validity of score interpretations and uses. Modeling rater response processes allows for a better understanding of how raters map their representations of the examinee performance to their representation of the…

The identification of rapid guessing is important to promote the validity of achievement test scores, particularly with low-stakes tests. Effective methods for identifying rapid guesses require reliable threshold methods that are also aligned with test taker behavior. Although several common threshold methods are based on rapid guessing response…

Purpose: The aims of this study were (a) to validate the wideband acoustic immittance (WAI) model developed by Myers et al. (2018a) in a new sample of neonates and (b) to develop a prediction model for diagnosing middle ear dysfunction in infants aged 6-18 months using wideband absorbance, controlling for the effect of age. Method: Tympanometry,…

Methods to generate random correlation matrices have been proposed in the literature, but very few instances exist where these correlation matrices are structured or where the statistical properties of the algorithms are known. By relying on the tetrad relation discovered by Spearman and the properties of the beta distribution, an algorithm is…

In educational practice, test results are used for several purposes. However, validity research is especially focused on the validity of summative assessment. This article aimed to provide a general framework for validating formative assessment. The authors applied the argument-based approach to validation to the context of formative assessment.…

The content validity ratio (CVR), which is suggested by Lawshe (1975), is a widely used index to quantify content validity. In this study, the Bayesian approach is used to determine the minimum number of experts required to agree an item is essential, and then the CVR is calculated.

Many psychometric measures yield data that are compatible with (a) an essentially unidimensional factor analysis solution and (b) a correlated-factor solution. Deciding which of these structures is the most appropriate and useful is of considerable importance, and various procedures have been proposed to help in this decision. The only fully…

We report the results of a convergent validity study examining the externalizing subscale (SRSS-E5, five items) of the adapted Student Risk Screening Scale for Internalizing and Externalizing (SRSS-IE 9) with the externalizing subscale of the Teacher Report Form (TRF) with two samples of K-12 students. Results of logistic regression and receiver…

The integration of technology in entrepreneurship arithmetic that uses realistic mathematic education as the basis into learning processes is instrumental in creating understanding and problem-solving abilities among students. However, until recently only a few technology-based learning media have been developed to accommodate the aforementioned…