In this study, we examined the scoring and generalizability assumptions of an explicit instruction (EI) special education teacher observation protocol using many-faceted Rasch measurement (MFRM). Video observations of classroom instruction from 48 special education teachers across four states were collected. External raters (n = 20) were trained…

In this study, we examined the scoring and generalizability assumptions of an Explicit Instruction (EI) special education teacher observation protocol using many-faceted Rasch measurement (MFRM). Video observations of classroom instruction from 48 special education teachers across four states were collected. External raters (n = 20) were trained…

This study searched for open-source semantic similarity tools and evaluated their effectiveness in automated content scoring of fact-based essays written by English-as-a-Foreign-Language (EFL) learners. Fifty writing samples under a fact-based writing task from an academic English course in a Japanese university were collected and a gold standard…

Objective: To construct a needs assessment instrument for older people using a standardized terminology (International classification of functioning, disability, and health [ICF]) and assess its psychometrical properties. Method: An instrument was developed comprising questions to older people regarding their perceived care needs. The instrument's…

The purpose of this study was to evaluate the psychometric quality (i.e., validity and reliability) of a rating scale to assess pre-service teachers' lesson plan development in the context of secondary-level music performance classrooms. The research questions that guided this study include: (1) What items demonstrate acceptable model fit for the…

As a property of test scores, reliability/dependability constitutes an important psychometric consideration, and it underpins the validity of measurement results. A review of interpreter certification performance tests (ICPTs) reveals that (a) although reliability/dependability checking has been recognized as an important concern, its theoretical…

Listening to young children's voices is an issue with increasing relevance for many researchers in the field of early childhood research. At the same time, teachers and researchers are faced with challenges to provide children with possibilities to express their notions, and to find ways of comprehending children's voices. In our research we aim…

In this study, 7th grade students were observed completing a series of lessons in an online science course to explore their thinking and strategies for: (1) using curriculum resources for learning, (2) developing thinking and strategies for self-assessing "assessment readiness," and (3) exploring the relationship between resource use and…

Two studies explored the technical adequacy of various measures of advanced phonics skills. In Study 1, the advanced phonics measures consisted of pseudowords, real words, or a combination of both. Participants included 39 students in the third grade. Test-retest correlations for all measures were above 0.8 and interrater reliability was high.…

This paper describes the second year of a multi-year study on the implementation of Peer Instruction and PeerWise-inspired pedagogies in a physics methods course in a teacher education program at a large research university in Western Canada. In the first year of this study, Peer Instruction was implemented consistently in the physics methods…

The purpose of this research was to investigate the impact of immediate feedback through bug-in-ear eCoaching on early childhood special education pre-service teachers' use of communication strategies using an activity-based intervention approach. Three early childhood special education pre-service teachers participated in this study. A…

Collaborative Strategic Reading (CSR) is a set of instructional strategies designed to improve the reading comprehension of students with diverse abilities (Klingner and Vaughn 1996). Teachers implement CSR at the classroom level using scaffolded instruction to guide students in the independent use of four comprehension strategies; students apply…

Research nationally and internationally found that technical graduates are lacking in employability skills. As employability skills are crucial in outcome-based education, the main goal of this research is to develop an Employability Skill Assessment Tool to help students and lecturers produce competent graduates in employability skills needed by…

A protocol for analyzing the activity structure of a classroom lesson was developed and field tested. The protocol can be completed on site by a person serving as both observer and analyst. Validity of the protocol was established by reference to the large body of qualitative research on activity structure and the analysis of teaching. The…

This paper reports the results from an investigation of a method for systematic development of a procedure for assessing the administrator and instructional leader roles in implementation of an innovative school program. The purpose of the study was to design and field-test a feasible and useful approach to examining the degree of…