This paper describes the design and evaluation of the Organic chemistry Representational Competence Assessment (ORCA). Grounded in Kozma and Russell's representational competence framework, the ORCA measures the learner's ability to "interpret," "translate," and "use" six commonly used representations of molecular…

The aim of the study is to develop an achievement test consisting of the questions in verbal intelligence games whose validity and reliability have been ensured and which are in accordance with the learning outcomes of the states of substance and knowing the properties of substance via the five senses taking place in the unit "Let's Know…

e-Textbooks and e-learning technologies have become ubiquitous in college and university courses as faculty seek out ways to provide more engaging, flexible and customizable learning opportunities for students. However, the same technologies that support learning can serve as a source of frustration. Research on frustration with technology is…

Rasch testlet and bifactor models are two measurement models that could deal with local item dependency (LID) in assessing the dimensionality of reading comprehension testlets. This study aimed to apply the measurement models to real item response data of the Iranian EFL reading comprehension tests and compare the validity of the bifactor models…

In the current study, we aimed to develop a reliable and valid scale to address individual cognitive load types. Existing scale development studies involved limited number of items without adequate convergent, discriminant and criterion validity checks. Through a multistep correlational study, we proposed a three-factor scale with 13 items to…

This study was conducted to create a reliable and valid low- to medium-inference, multidimensional measure of instructor clarity from seminal work across several academic fields. Five hundred and sixty six students responded to an initial pool of 87 items and were split into two samples to investigate the factor structure of the new measurement…

The aim of this study is to develop a valid and reliable instrument to assess why physics courses are perceived as one of the most difficult courses among high school students and to investigate the reasons why students have difficulty in learning physics through this scale. This study includes the development and validation studies of the…

One of the fundamental problems in language testing is the lack of adequate generalizability between what a test is measuring and what fulfills the learners' real world language use needs. It is important to recognize that no matter how precise a test measures a construct, if the way that a construct is defined and the way that test tasks are…

Working under classical test theory (CTT) and item response theory (IRT) frameworks, this study investigated psychometric properties of the Revised Purdue Spatial Visualization Tests: Visualization of Rotations (Revised PSVT:R). The original version, the PSVT:R was designed by Guay (1976) to measure spatial visualization ability in…

This study investigated the psychometrics of the "Diagnostic Evaluation of Language Variation-Screening Test" (DELV-S) test using confirmatory factor analysis, item response theory, and differential item functioning (DIF). Responses from 1,764 students in kindergarten through second grade were used in the study, with results indicating…

The factor differentiation hypothesis suggests that the factor structure of a set of tests tends to differentiate over time, becoming more complex and articulated. This experimental study provides evidence confirming that hypothesis. (Author/JKS)

To study the relationships among figural creativity, intelligence, and personality, 196 fourth, fifth, and sixth grade boys and girls were given a battery of 14 tests. Teacher ratings of creativity and independence, grade point averages, art grades, and IQ scores were also obtained. It was hypothesized that a unitary trait of…

A 67-item Assessment Practices Inventory (API) was administered to 311 inservice teachers. The application of principal components analysis to the data yielded a 6-factor solution that explained 64% of the variance. The Rasch rating scale model was applied to the API to estimate item calibrations. The factor analyzed assessment categories were…

As a measure of musical aptitude, a new 90-item Pitch Discrimination Test was developed, and its internal structure was examined. Each of the three sections of the test measures an individual's aptitude for pitch discrimination in a different frequency range using square-wave tones generated by a personal computer. A total of 1,303 examinees,…