Multidimensional measuring instruments are often used in behavioral, social, educational, marketing, and biomedical research. For these scales, the paper discusses how to find the optimal score based on their components that is associated with the highest possible reliability. Within the framework of structural equation modeling, an approach to…

Item response tree (IRTree) models are a flexible framework to control self-reported trait measurements for response styles. To this end, IRTree models decompose the responses to rating items into sub-decisions, which are assumed to be made on the basis of either the trait being measured or a response style, whereby the effects of such person…

Scoring high-dimensional assessments (e.g., > 15 traits) can be a challenging task. This paper introduces the multilabel neural network (MNN) as a scoring method for high-dimensional assessments. Additionally, it demonstrates how MNN can score the same test responses to maximize different performance metrics, such as accuracy, recall, or…

Measuring cognitive load is important in virtual learning environments (VLE). Thus, valid and reliable measures of cognitive load are important to support instructional design in VLE. Through three studies, we investigated the validity and reliability of Leppink's Cognitive Load Scale (CLS) and developed the extraneous cognitive load (EL)…

This paper reports an investigation into the psychometric properties of the COR-Advantage1.5 (COR-Adv1.5) assessment tool, a criterion-referenced observation-based instrument designed to assess the developmental abilities of children from birth through kindergarten. Using data from 8534 children participating in a state-funded preschool program…

A cross-national comparison was conducted between U.K. and U.S. higher education students on the Test Anxiety Measure for College Students (TAM-C). The TAM-C was administer to 1,776 U.K. and U.S. higher education students online. The results of tests of measurement invariance found the TAM-C invariant across country and gender. In addition,…

This study investigates the relationships among factor correlations, inter-item correlations, and the reliability estimates of subscores, providing a guideline with respect to psychometric properties of useful subscores. In addition, it compares subscore estimation methods with respect to reliability and distinctness. The subscore estimation…

The psychometric properties of a new, multidimensional measure of test anxiety, the Test Anxiety Measure for College Students (TAM-C), were examined in a sample of 720 undergraduate students. Results of confirmatory factor analyses provided support for a six-factor (Cognitive Interference, Physiological Hyperarousal, Social Concerns,…

Consultation is essential to the daily practice of school psychologists (National Association of School Psychologist, 2010). Successful consultation requires fidelity at both the consultant (implementation) and consultee (intervention) levels. We applied a multidimensional, multilevel conception of fidelity (Dunst, Trivette, & Raab, 2013) to a…

The purpose of this multistudy report was to adapt the Basic Psychological Need Satisfaction and Frustration Scale (BPNSFS) to the Italian context. Two studies were conducted. In Study 1, we investigated the dimensionality, reliability, and convergent and discriminant validity of the instrument in a sample of 544 participants (males = 41%) from 16…

The purpose of this study is to develop a multi-dimensional scale to measure students' awareness of key competencies for M-learning and to test its reliability and validity. The Key Competencies of Mobile Learning Scale (KCMLS) was determined via confirmatory factor analysis to have four dimensions: team collaboration, creative thinking, critical…

Appraisal of the readiness of teachers to accept and use mobile devices for classroom instruction is a critical step whenever an expectation exists that the devices will be used to enhance student learning. Designing professional development requires assessment of teachers' readiness and willingness to embrace mobile learning for their students.…

Observation of counsellor skills through a one-way mirror, video or audio recording followed by supervisors and peers feedback is common in counsellor training. The nature and extent of agreement between supervisor-peer dyads are unclear. Using a standard scale, supervisors and peers rated 32 interviews by psychology trainees observed through a…

Disability scholars have recently highlighted social work professional organizations' lagging pace in adopting disability advocacy within diversity agendas and have questioned the adequacy of disability content within accredited social work curricula. Amid growing concerns, measures to assess attitudes of social workers toward disability and…

Accurately measuring levels of technology proficiency in current and future classroom teachers are an important first step toward enhancing comfort level and confidence in integrating technology into the educational environment. The original Technology Proficiency Self-Assessment (TPSA) survey has maintained respectable psychometric properties for…