Exams have traditionally dominated assessment in higher education. Yet, we still do not know if they are authentic assessment, especially in an environment of rapid demographic changes within higher education and evolving perceptions of authenticity. This work offers a method to measure exam authenticity, defined as the overlap between exams and…

We employed qualitative research methods to examine student learning in context during a teacher's unit on 1920s-Great Depression in an 11th grade United States & Virginia History class in a standards-based setting with a high-stakes end-of-course test. We focused on four focal students (all of whom were classified as English learners at some…

Rubric scoring has been gaining traction as an emergent method to assess spoken-language interpreting, with two of the most well-known methods being rating scale-based holistic and analytic scoring. While the former provides a single global score, the latter generates separate scores on different dimensions of interpreting performance. Despite the…

The present study was executed with the purpose of validating ELT Certificate Lesson Observation and Report Task (ELTC-LORT), which was developed by China Language Assessment to certify China's EFL teachers by performance-based testing. The ELT Certificate has high-stakes considering its impacts on candidates' recruitment, ELT in China and quality…

Background: Several different measures have been proposed to solve persistent validity problems, such as high task-sampling variability, in the assessment of students' expertise in 'doing science'. Such measures include working with a-priori progression models, using standardised item shells and rating manuals, augmenting the number of tasks per…

Informed by the ideology of 'deliverology', performance measurement has become a core component of how English schools are held accountable for the quality of their provision. A wealth of research conducted in diverse national contexts where this approach has been influential has suggested that the unintended harms it generates -- including a…

The purpose of this study was to evaluate the psychometric quality (i.e., validity and reliability) of a rating scale to assess pre-service teachers' lesson plan development in the context of secondary-level music performance classrooms. The research questions that guided this study include: (1) What items demonstrate acceptable model fit for the…

The purpose of this study was to develop a valid and reliable rubric to be used for the evaluation of large ensemble wind band performances. The guiding questions for this study were: (a) what are the psychometric qualities (i.e., reliability and validity) of the scale developed to assess wind band ensemble performance at the high school level?…

The aim of the research is to improve a valid and reliable attributing scale which identifies authentic learning environments and evaluation attributes of the science teacher candidates. The study has been designed on the base of validity and reliability of the scale developed to evaluate the authentic learning environments. The research group is…

Numerous well-validated academic progress monitoring tools are used in schools, but there are fewer behavioral progress monitoring measures available. Some brief behavior rating scales have been shown to be effective in monitoring students' progress, but most focus only on students' social skills and do not address critical academic-related…

Numerous well validated academic progress monitoring tools are used in schools, but there are fewer behavioral progress monitoring measures available. Some brief behavior rating scales have been shown to be effective in monitoring students' progress, but most focus only on students' social skills and do not address critical academic-related…

Subconsciously, experienced teachers make use of situated knowledge: knowledge that is connected to, and arises from, the interactions between the physical environment where the action takes place and a material body acting in that environment. Since situated knowledge is important in day-to-day teaching to solve incidents, it should be taught in…

As a property of test scores, reliability/dependability constitutes an important psychometric consideration, and it underpins the validity of measurement results. A review of interpreter certification performance tests (ICPTs) reveals that (a) although reliability/dependability checking has been recognized as an important concern, its theoretical…

Standardized achievement tests that are used for assessment and accountability purposes may not provide reliable and valid outcomes for English language learners (ELLs) because extraneous sources may confound the outcome of assessments for these students. Performance assessments, by contrast, may offer opportunities for these students to present a…

Describes the construction of assessments on inclines and friction from blueprints--or shells--which address the tasks of planning, hands-on, analysis, and application. Examines the reliability and validity of the assessments as well as the comparability of the assessments generated with the shell. Contains 48 references. (Author/WRM)