Publication Date
| In 2025 | 0 |
| Since 2024 | 0 |
| Since 2021 (last 5 years) | 1 |
| Since 2016 (last 10 years) | 5 |
| Since 2006 (last 20 years) | 8 |
Descriptor
| Generalizability Theory | 11 |
| Interrater Reliability | 6 |
| Reliability | 4 |
| Scoring | 4 |
| Teacher Evaluation | 4 |
| Validity | 4 |
| Classroom Observation… | 3 |
| Foreign Countries | 3 |
| Scores | 3 |
| Scoring Rubrics | 3 |
| Teacher Attitudes | 3 |
| More ▼ | |
Source
Author
| Crawford, Angela R. | 2 |
| Johnson, Evelyn S. | 2 |
| Moylan, Laura A. | 2 |
| Zheng, Yuzhu | 2 |
| Ahn, Soyeon | 1 |
| Ames, Allison J. | 1 |
| Bartlett, Lesley Erin | 1 |
| Bennett, Randy Elliot | 1 |
| Cankoy, Osman | 1 |
| Cheng, Albert | 1 |
| Duffy, Ashlee Mills | 1 |
| More ▼ | |
Publication Type
| Tests/Questionnaires | 11 |
| Reports - Research | 8 |
| Journal Articles | 6 |
| Reports - Evaluative | 2 |
| Dissertations/Theses -… | 1 |
| Speeches/Meeting Papers | 1 |
Education Level
| Higher Education | 3 |
| Elementary Education | 2 |
| Postsecondary Education | 2 |
| Adult Education | 1 |
| Elementary Secondary Education | 1 |
| Secondary Education | 1 |
Audience
Location
| Alabama | 1 |
| Australia | 1 |
| Canada | 1 |
| China (Beijing) | 1 |
| Cyprus | 1 |
| Hong Kong | 1 |
| Illinois | 1 |
| Mexico | 1 |
| Taiwan | 1 |
| United States | 1 |
Laws, Policies, & Programs
Assessments and Surveys
| Test of English as a Foreign… | 1 |
What Works Clearinghouse Rating
Evaluating an Explicit Instruction Teacher Observation Protocol through a Validity Argument Approach
Peer reviewed
Direct linkJohnson, Evelyn S.; Zheng, Yuzhu; Crawford, Angela R.; Moylan, Laura A. – Journal of Experimental Education, 2022
In this study, we examined the scoring and generalizability assumptions of an explicit instruction (EI) special education teacher observation protocol using many-faceted Rasch measurement (MFRM). Video observations of classroom instruction from 48 special education teachers across four states were collected. External raters (n = 20) were trained…
Descriptors: Direct Instruction, Teacher Education, Classroom Observation Techniques, Validity
Evaluating an Explicit Instruction Teacher Observation Protocol through a Validity Argument Approach
Download full textJohnson, Evelyn S.; Zheng, Yuzhu; Crawford, Angela R.; Moylan, Laura A. – Grantee Submission, 2020
In this study, we examined the scoring and generalizability assumptions of an Explicit Instruction (EI) special education teacher observation protocol using many-faceted Rasch measurement (MFRM). Video observations of classroom instruction from 48 special education teachers across four states were collected. External raters (n = 20) were trained…
Descriptors: Direct Instruction, Teacher Evaluation, Classroom Observation Techniques, Validity
Cankoy, Osman; Özder, Hasan – EURASIA Journal of Mathematics, Science & Technology Education, 2017
The aim of this study is to develop a scoring rubric to assess primary school students' problem posing skills. The rubric including five dimensions namely solvability, reasonability, mathematical structure, context and language was used. The raters scored the students' problem posing skills both with and without the scoring rubric to test the…
Descriptors: Generalizability Theory, Elementary School Students, Foreign Countries, Problem Solving
Marshall, Margaret J.; Duffy, Ashlee Mills; Powell, Stephen; Bartlett, Lesley Erin – International Journal of ePortfolio, 2017
An ePortfolio Assessment Institute (AI) structured as a faculty development opportunity was undertaken to increase faculty confidence in teaching and assessing ePortfolios and to collect reliable data about student performance on four learning outcomes associated with an institutionwide ePortfolio initiative. Faculty raters participated in the…
Descriptors: Electronic Publishing, Portfolio Assessment, Faculty Development, Data Collection
Han, Chao – Language Assessment Quarterly, 2016
As a property of test scores, reliability/dependability constitutes an important psychometric consideration, and it underpins the validity of measurement results. A review of interpreter certification performance tests (ICPTs) reveals that (a) although reliability/dependability checking has been recognized as an important concern, its theoretical…
Descriptors: Foreign Countries, Scores, English, Chinese
Sporte, Susan E.; Jiang, Jennie Y.; Luppescu, Stuart – Society for Research on Educational Effectiveness, 2014
Starting in 2012-13, researchers have worked in partnership with Chicago Public Schools (CPS) and the Chicago Teachers Union (CTU) to study implementation of Chicago's new teacher evaluation system: Recognizing Educators Advancing Chicago's Students (REACH). This paper presents findings as well as experiences from the collaboration with CPS and…
Descriptors: Teacher Evaluation, Evaluators, Reliability, Teacher Attitudes
Ahn, Soyeon; Ames, Allison J.; Myers, Nicholas D. – Review of Educational Research, 2012
The current review addresses the validity of published meta-analyses in education that determines the credibility and generalizability of study findings using a total of 56 meta-analyses published in education in the 2000s. Our objectives were to evaluate the current meta-analytic practices in education, identify methodological strengths and…
Descriptors: Inferences, Meta Analysis, Educational Practices, Research Methodology
Cheng, Albert – Online Submission, 2012
The Common Core State Standards Initiative is the latest development in a long history of standards-based-reform in the United States. As of November 4, 2011, 46 states and the District of Columbia have adopted new curricular standards, called the Common Core State Standards (CCSS). These states and the District of Columbia are now implementing…
Descriptors: State Standards, Academic Achievement, Educational Change, Teacher Attitudes
Lee, Yong-Won; Kantor, Robert – ETS Research Report Series, 2005
Possible integrated and independent tasks were pilot tested for the writing section of a new generation of TOEFL® (Test of English as a Foreign Language™) examination. This study examines the impact of various rating designs as well as the impact of the number of tasks and raters on the reliability of writing scores based on integrated and…
Descriptors: Language Tests, English (Second Language), Second Language Learning, Writing Tests
Bennett, Randy Elliot; Rock, Donald A. – 1993
Formulating-Hypotheses (F-H) items present a situation and ask the examinee to generate as many explanations for it as possible. This study examined the generalizability, validity, and examinee perceptions of a computer-delivered version of the task. Eight F-H questions were administered to 192 graduate students. Half of the items restricted…
Descriptors: Computer Assisted Testing, Difficulty Level, Generalizability Theory, Graduate Students
Teddlie, Charles; And Others – 1990
The results are provided of an initial analysis of the reliability (generalizability) of the System for Teaching and Learning Assessment and Review (STAR) as a comprehensive measure of classroom teaching and learning for making teacher certification decisions. The STAR contains 140 indicators of teacher effectiveness and student learning, which…
Descriptors: Beginning Teachers, Classroom Observation Techniques, Elementary School Teachers, Elementary Secondary Education
