Studies based on response processes of individuals can provide information that supports the assessment and increases the validity of the items in the scale or tests. The purpose of this study is to present the extent to which the student response processes are effective in identifying and developing the characteristics of the items in an…

Assessing job applicants' general mental ability online poses psychometric challenges due to the necessity of having brief but accurate tests. Recent research (Myszkowski & Storme, 2018) suggests that recovering distractor information through Nested Logit Models (NLM; Suh & Bolt, 2010) increases the reliability of ability estimates in…

The objective of this study was to examine the construct validity and bias of a child health interview (CHI) instrument to assess young children's food and activity preferences. A quantitative study examining the construct validity and bias of a young child health interview instrument using confirmatory factor analysis (CFA) and multi-group CFA…

Under the framework of item response theory (IRT) and generalizability (G-) theory, this study examined the effects of item difficulty on rating reliability and construct validity on both the constructed-response (CR) items and essay items on English examinations. The data collected for this study were students' scores and responses on the two…

The aim of the study was to determine whether there is a relationship between students' answers to geography questions framed according to the factual and conceptual levels of the knowledge dimension of the Revised Bloom's Taxonomy. The study used a correlational survey design. The data were gleaned from the answers that 52 students studying…

This study conducted a development and validation of a vignette-based grit scale (Grit-V). The purpose was to determine if the use of vignettes provided more validity evidence than short simple-sentence item endorsements. The data were gathered from a sample population of undergraduate students from The University of Alabama. Focus group data were…

There is a consensus that the items proposed by the Program for International Student Assessment (PISA) program allow us to focus on the outcomes of the processes of appropriation and transformation of learning tools at the end of compulsory schooling, particularly regarding the key competencies for lifelong learning and citizenship in digital…

This article discusses regression effects that are commonly observed in Angoff ratings where panelists tend to think that hard items are easier than they are and easy items are more difficult than they are in comparison to estimated item difficulties. Analyses of data from two credentialing exams illustrate these regression effects and the…

Energy and matter are fundamental, yet challenging concepts in middle school chemistry due to their abstract, unobservable nature. Although it is important for science teachers to elicit a range of students' ideas to design and revise their instruction, capturing such varied ideas using traditional assessments consisting of multiple-choice items…

Background: The inaccurate estimation of language difficulties by teachers suggests the benefit of a short-language measure that could be used to support their decisions about who requires referral to a speech-language therapist. While the literature indicates the potential for the development of a short-language measure, evidence is lacking about…

The aim of this study is to determine the level of achievement of students participating in Programme for International Student Assessment (PISA) 2003 and PISA 2012 tests in Turkey according to questions in the mathematical literacy test. This study is a descriptive survey. Within the scope of the study, the mathematical literacy test items were…

To remove cultural bias is critical for the legitimacy of Programme for International Student Assessment (PISA) as an internationally reliable academic assessment. Since its inception, PISA has made extensive effort to address this issue by putting in place a range of methodological and procedural measures to ensure its test fairness. This study…

Though proficiency with computation is highly emphasized in national mathematics standards, students with mathematics difficulty (MD) continue to struggle with computation. To learn more about the differences in computation error patterns between typically achieving students and students with MD, we assessed 478 third-grade students on a measure…

The test of understanding of vectors (TUV) is a multiple-choice test that was recently developed to assess student understanding of vector concepts required in introductory physics courses at the university level. In this study, the TUV was administered to 889 first-year students at the University of Zagreb. The Rasch model was used to evaluate…

The Discrete Option Multiple Choice (DOMC) item format was introduced by Foster and Miller (2009) with the intent of improving the security of test content. However, by changing the amount and order of the content presented, the test taking experience varies by test taker, thereby introducing potential fairness issues. In this paper we…