This paper reports on a systematic literature review to understand better methodologies and data collection tools used to judge student teaching effectiveness, ways in which validity and reliability are considered, the processes involved in assessing new teaching effectiveness within teacher education programmes, and how evaluation and results are…

This article reports the development and validation of the new Process and Outcomes from Service-Learning (POSL) questionnaire, a self-report measure that assesses students' service-learning experiences as well as their attainment of a comprehensive set of intended service-learning outcomes. The study involved three phases: (a) construct…

Many employers state that they expect college graduates to have "soft" or domain-general skills like critical thinking, and universities claim to teach these skills. To prove colleges are delivering on their promise--and to demonstrate that employers are picking the best personnel fairly--colleges, students, and employers need a valid…

Purpose: The study was aimed at measuring farmers' helpline services quality in India using a standardized multi-factor scale (HELPQUAL) developed as part of this study. Design/methodology/approach: The present study is based on 360 farmers' and 45 experts' responses gathered using telephonic interviews and mailed questionnaires during the year…

Shifting focus of asocial language tests toward social considerations recalls their ideological basis (Mirhosseini, De Costa, 2020). The recurrent exposure to and involvement in discursive constructions of high stakes' contents, may bring along certain sociocultural conceptualizations and values by test audiences (van Dijk, 1998). Thus, unless a…

The present study is part of a larger mixed methods project that investigated the speaking section of the Advanced Placement (AP) Japanese Language and Culture Exam. It investigated assumptions for the evaluation inference through a content analysis of test taker responses. Results of the content analysis were integrated with those of a many-facet…

In 2016, with mounting pressure from parents, educators, and other stakeholders around the state pushing back against the volume of standardized tests students are required to take, the Texas Education Agency introduced the Texas Writing Pilot. This pilot was designed to study the feasibility of creating an alternative writing assessment that…

This study is a content analysis of action research articles in the field of education which were published in Turkish journals and indexed by SSCI and ULAKBIM databases. Therefore, 80 articles were examined. The data was collected through a form developed by the researchers. The articles were analyzed according to the theme and code list provided…

Despite the popularity of the TOEIC in the Korean society for over 30 years, few studies have investigated the understanding and usage of TOEIC scores in the Korean context. This research gap needs to be filled to provide test users with useful information in the Korean context. Using an argument-based approach to validation, this study…

One of the substantive changes in the 2014 Standards for Educational and Psychological Testing was the elevation of fairness in testing as a foundational element of practice in addition to validity and reliability. Previous research indicates that testing practices often do not align with professional standards and guidelines. Therefore, to raise…

Purpose: The purpose of this document analysis study was to examine current teacher evaluation systems, understand current practices, and determine whether the instrumentation is a valid measure of teaching quality as reflected in teacher behavior and effectiveness specific to physical education (PE). Method: An interpretive document analysis…

In recent years, large-scale international assessments have been increasingly used to evaluate and compare the quality of education across regions and countries. However, measurement variance between different versions of these assessments often posts threats to the validity of such cross-cultural comparisons. In this study, we investigated the…

The purpose of this study was to design an instrument for five- to six-year-old children to help measure their verbal reasoning skills and assess the validity and reliability of the resulting instrument. For this purpose, the researchers have created the Younger Children Verbal Reasoning Test (YCVR-test) and a control instrument, which have been…

Our study addresses the need for new approaches to prepare novice elementary teachers to teach both science and engineering, and for new tools to measure how well those approaches are working. This in particular would inform the teacher educators of the extent to which novice teachers are developing expertise in facilitating their students'…

Open-ended (OE) items are widely used to gather data on student performance in international achievement studies. However, several factors may threaten validity when using such items. This study examined Finnish coders' opinions about threats to validity when coding responses to OE items in the PISA 2012 problem-solving test. A total of 6…