Sociologists increasingly face choices among competing algorithms that represent reasonable approaches to the same task, with little guidance in choosing among them. We develop a strategy that uses simulated data to identify the conditions under which different methods perform well and applies what is learned from the simulations to predict which…

Latent class analysis (LCA) refers to techniques for identifying groups in data based on a parametric model. Examples include mixture models, LCA with ordinal indicators, and latent class growth analysis. Despite its popularity, there is limited guidance with respect to decisions that must be made when conducting and reporting LCA. Moreover, there…

This paper explores the efficacy of ChatGPT, a generative artificial intelligence in educational contexts, particularly concerning its potential to assist students in overcoming academic challenges while highlighting its limitations. ChatGPT is suitable for solving general problems. When a student comes across academic challenges, ChatGPT may…

Categorical growth models describe examinee growth in terms of performance-level category transitions, which implies that some percentage of examinees will be misclassified. This paper introduces a new procedure for estimating the classification accuracy of categorical growth models, based on Rudner's classification accuracy index for item…

The continuous testing framework, where both successful and unsuccessful examinees have to demonstrate continued proficiency at frequent prespecified intervals, is a framework that is used in noncognitive assessment and is gaining in popularity in cognitive assessment. Despite the rigorous advantages of this framework, this paper demonstrates that…

Takers of educational tests often receive proficiency levels instead of or in addition to scaled scores. For example, proficiency levels are reported for the Advanced Placement (AP®) and U.S. Medical Licensing examinations. Technical difficulties and other unforeseen events occasionally lead to missing item scores and hence to incomplete data on…

Cognitive learning complexity identification of assessment questions is an essential task in the domain of education, as it helps both the teacher and the learner to discover the thinking process required to answer a given question. Bloom's Taxonomy cognitive levels are considered as a benchmark standard for the classification of cognitive…

This article considers psychometric properties of composite raw scores and transformed scale scores on mixed-format tests that consist of a mixture of multiple-choice and free-response items. Test scores on several mixed-format tests are evaluated with respect to conditional and overall standard errors of measurement, score reliability, and…

The English Resultative Construction (ERC) is a satellite-framed structure with no identical equivalent in Spanish. In a series of studies, we analyzed and compared recognition (acceptability judgment task) and comprehension (sentence comprehension task) of three ERC subtypes with the English Depictive Construction (EDC) (which has a Spanish…

More than three decades after their introduction, diagnostic classification models (DCM) do not seem to have been implemented in educational systems for the purposes they were devised. Most DCM research is either methodological for model development and refinement or retrofitting to existing nondiagnostic tests and, in the latter case, basically…

The significant amount of information available on the web has led to difficulties for the learner to find useful information and relevant resources to carry out their training. The recommender systems have achieved significant success in the area of e-commerce, they still have difficulties in formulating relevant recommendations on e-learning…

Assessing global interrater agreement is difficult as most published indices are affected by the presence of mixtures of agreements and disagreements. A previously proposed method was shown to be specifically sensitive to global agreement, excluding mixtures, but also negatively biased. Here, we propose two alternatives in an attempt to find what…

Machine learning (ML) algorithms have proven highly accurate for identifying Randomized Controlled Trials (RCTs) but are not used much in practice, in part because the best way to make use of the technology in a typical workflow is unclear. In this work, we evaluate ML models for RCT classification (support vector machines, convolutional neural…

Cuisine and restaurants are powerful tools for cultural, social and tourist image-building, and projection for tourist promotion, particularly in the case of major tourist places and destinations which boast a well-deserved, long-standing history and reputation for gastronomical beacons. When menus are not properly translated (or transcreated)…

The aim of this research is to determine classification in which the level of accuracy in Turkish universities rankings is detected by the international assessments according to the independent variables PhD students ratio, the number of students per faculty member and the article scores. The data of research were obtained from University Ranking…