Using item-response theory to model rater effects provides an alternative solution for rater monitoring and diagnosis, compared to using standard performance metrics. In order to fit such models, the ratings data must be sufficiently connected in order to estimate rater effects. Due to popular rating designs used in large-scale testing scenarios,…

As assessments move from traditional paper-pencil administration to computer-based administration, many testing programs are incorporating alternative item types (AITs) into assessments with the goals of measuring higher-order thinking, offering insight into problem-solving, and representing authentic real-world tasks. This paper explores multiple…

Objectively Structured Clinical/Practical Examination (OSCE/OSPE) has been the backbone of the assessment system of graduate medical education for over three decades. We have developed an electronic Objectively Structured Practical Examination (e-OSPE) in Medical Biochemistry using the freely available Google forms to mitigate the academic…

Item positions in educational assessments are often randomized across students to prevent cheating. However, if altering item positions results in any significant impact on students' performance, it may threaten the validity of test scores. Two widely used approaches for detecting position effects -- logistic regression and hierarchical…

This technical assistance paper provides policy and guidance to individuals with test administration responsibilities in adult education programs. The Florida assessment policies and guidelines presented in this technical assessment paper are appropriate for state and federal reporting. Therefore, guidance and procedures regarding the selection…

Little attention has been paid to the question about generality versus modularity of the learning potential (LP). The main research question of our study was: Is the students' LP established with the help of a dynamic assessment of their English as a foreign language (EFL) oral proficiency general enough to predict their subsequent EFL reading and…

Aviation English proficiency is a core competency in the global air traffic controller profession. There is, however, growing concern about the current ineffective paper-based assessment methods and the severe lack of interactive online testing for such a critical profession, one that should be ideally assessed in an authentic task and situation…

This technical assistance paper provides policy and guidance to individuals with test administration responsibilities in adult education programs. The Florida assessment policies and guidelines presented in this paper are appropriate for state and federal reporting. Therefore, guidance and procedures regarding the selection and use of appropriate…

This technical assistance paper provides policy and guidance to individuals with test administration responsibilities in adult education programs. Rule 6A-6.014, Florida Administrative Code (F.A.C.), titled, General Requirements for Adult General Education Programs, requires all adult education programs to report all student measurable educational…

Due to the unquestionable roles of technology in language classes, it might be necessary to use computers in assessing language knowledge. This study aimed to examine how computers may be used to assess language ability of [English for Specific Purposes] ESP students. Sixty computer-major university students at Abadan University are the…

The Bologna Declaration brought reforms into higher education that imply changes in teaching methods, didactic materials and textbooks, infrastructures and laboratories, etc. Statistics and mathematics are disciplines that traditionally have the worst success rates, particularly in non-mathematics core curricula courses. This research project,…

Purpose: To examine whether students have higher retention rates of material when they participate in online quizzes or online alternative student-centered assignments on the material presented in the F2F class. Design/methodology/approach: Reviews the literature; and analyzes data from the implementation of both types of assessment for the online…

Indicators of current issues and concerns in the assessment of science teaching and learning outcomes are discussed. The greatest public attention to science test scores is devoted to scores from assessments that are external to schools, including national assessments such as the National Assessment of Educational Progress (NAEP), international…