Multiple measures, such as multiple content domains or multiple types of performance, are used in various testing programs to classify examinees for screening or selection. Despite the popular usages of multiple measures, there is little research on classification consistency and accuracy of multiple measures. Accordingly, this study introduces an…

Decision consistency (DC) is the reliability of a classification decision based on a test score. In professional credentialing, the decision is often a high-stakes pass/fail decision. The current methods for estimating DC are computationally complex. The purpose of this research is to provide a computationally and conceptually simple method for…

At present, the widespread use of online education platforms has attracted the attention of more and more people. The application of AI technology in online education platform makes multidimensional evaluation of students' ability become the trend of intelligent education in the future. Currently, most existing studies are based on traditional…

A method for evaluating the validity of multicomponent measurement instruments in heterogeneous populations is discussed. The procedure can be used for point and interval estimation of criterion validity of linear composites in populations representing mixtures of an unknown number of latent classes. The approach permits also the evaluation of…

The significant amount of information available on the web has led to difficulties for the learner to find useful information and relevant resources to carry out their training. The recommender systems have achieved significant success in the area of e-commerce, they still have difficulties in formulating relevant recommendations on e-learning…

Question classification is a key point in many applications, such as Question Answering (QA, e.g., Yahoo! Answers), Information Retrieval (IR, e.g., Google search engine), and E-learning systems (e.g., Bloom's tax. classifiers). This paper aims to carry out a systematic review of the literature on automatic question classifiers and the technology…

When cut scores for classifications occur on the total score scale, popular methods for estimating classification accuracy (CA) and classification consistency (CC) require assumptions about a parametric form of the test scores or about a parametric response model, such as item response theory (IRT). This article develops an approach to estimate CA…

The authors offer a classification technique to make a quantitative skills rubric more operational, with the groupings of multiple-choice questions to match the student learning levels in knowledge, calculation, quantitative reasoning, and analysis. The authors applied this classification technique to the mid-term exams of an introductory finance…

This study explored the impact of partial credit scoring of one type of innovative items (multiple-response items) in a computerized adaptive version of a large-scale licensure pretest and operational test settings. The impacts of partial credit scoring on the estimation of the ability parameters and classification decisions in operational test…

Categorization is one of the fundamental building blocks of cognition, and the study of categorization is notable for the extent to which formal modeling has been a central and influential component of research. However, the field has seen a proliferation of noncomplementary models with little consensus on the relative adequacy of these accounts.…

To compare two modes of administration (self-administered; by interviewer) and two response options format (using words; images of "facial-expressions") of the first question of SF-36 (Q1SF-36), and to test its validity. We included 825 participants (20-90 years). Q1SF-36, using words or images, was included in a global questionnaire interview and…

In multilevel modeling, group-level variables (L2) for assessing contextual effects are frequently generated by aggregating variables from a lower level (L1). A major problem of contextual analyses in the social sciences is that there is no error-free measurement of constructs. In the present article, 2 types of error occurring in multilevel data…

The student full-time equivalent (FTE) measure has a long history in U.S. postsecondary education. Credit hours, contact hours, and their derivative FTE have been used as proxies for both student and faculty effort. FTE ultimately became a core measure for planning, evaluating and assessing human resource allocation within higher education.…

The aim of our study was to develop a graphical tool that can be used in addition to standard statistical criteria to support decisions on the number of classes in explorative categorical latent variable modeling for rehabilitation research. Data from two rehabilitation research projects were used. In the first study, a latent profile analysis was…

This preliminary study described fourth grade students verbally solving a mathematics problem using a think-aloud protocol. Comments in the think aloud were categorized according to type (e.g., paraphrases and elaborations) and facilitative nature (i.e., whether the comments facilitated correct solution of the problem). Amount of the students'…