NotesFAQContact Us
Collection
Advanced
Search Tips
Publication Date
In 20250
Since 20240
Since 2021 (last 5 years)0
Since 2016 (last 10 years)9
Since 2006 (last 20 years)26
Audience
Laws, Policies, & Programs
What Works Clearinghouse Rating
Showing 1 to 15 of 27 results Save | Export
Peer reviewed Peer reviewed
Direct linkDirect link
Jacobson, Miriam R.; Whyte, Cristina E.; Azzam, Tarek – American Journal of Evaluation, 2018
Evaluators can work with brief units of text-based data, such as open-ended survey responses, text messages, and social media postings. Online crowdsourcing is a promising method for quantifying large amounts of text-based data by engaging hundreds of people to categorize the data. To further develop and test this method, individuals were…
Descriptors: Mixed Methods Research, Evaluation Methods, Comparative Analysis, Feedback (Response)
Welch-Carre, Elizabeth – ProQuest LLC, 2017
A search on Amazon revealed more than 6,000 books related to leadership development. The Business Source database has more than 700 articles with the word leadership in the title, published between 2005 and 2015. This suggests that leadership is a topic in which many are interested. Clearly, leadership makes a difference in an organization's…
Descriptors: Hospitals, Leadership Effectiveness, Leadership Training, Reports
Ballard, Laura – ProQuest LLC, 2017
Rater scoring has an impact on writing test reliability and validity. Thus, there has been a continued call for researchers to investigate issues related to rating (Crusan, 2015). Investigating the scoring process and understanding how raters arrive at particular scores are critical "because the score is ultimately what will be used in making…
Descriptors: Evaluators, Schemata (Cognition), Eye Movements, Scoring Rubrics
Peer reviewed Peer reviewed
Direct linkDirect link
Norris, Jason; van der Mars, Hans; Kulinna, Pamela; Amrein-Beardsley, Audrey; Kwon, Jayoun; Hodges, Michael – Physical Educator, 2017
Purpose: The purpose of this study was to develop a better understanding of current PE teachers' perceptions of teacher evaluation systems. Method: A mixed methods approach was used and two sources of data collection were used: (a) a short survey of PE teachers (n = 22) in one urban school district and (b) a formal semistructured interview with 10…
Descriptors: Physical Education, Physical Education Teachers, Semi Structured Interviews, Academic Achievement
Peer reviewed Peer reviewed
Direct linkDirect link
Hall, Jori N. – New Directions for Evaluation, 2013
Mixed methods evaluation has a long-standing history of enhancing the credibility of evaluation findings. However, using mixed methods in a utilitarian way implicitly emphasizes convenience over engaging with its philosophical underpinnings (Denscombe, 2008). Because of this, some mixed methods evaluators and social science researchers have been…
Descriptors: Evaluators, Mixed Methods Research, Evaluation Methods, Pragmatics
Peer reviewed Peer reviewed
Direct linkDirect link
Trace, Jonathan; Janssen, Gerriet; Meier, Valerie – Language Testing, 2017
Previous research in second language writing has shown that when scoring performance assessments even trained raters can exhibit significant differences in severity. When raters disagree, using discussion to try to reach a consensus is one popular form of score resolution, particularly in contexts with limited resources, as it does not require…
Descriptors: Performance Based Assessment, Second Language Learning, Scoring, Evaluators
Peer reviewed Peer reviewed
PDF on ERIC Download full text
Han, Turgay – International Journal of Progressive Education, 2017
The aim of this study is to examine the variability in and reliability of scores assigned to different quality EFL compositions by EFL instructors and their rating behaviors. Using a mixed research design, quantitative data were collected from EFL instructors' ratings of 30 compositions of three different qualities using a holistic scoring rubric.…
Descriptors: English (Second Language), Writing Evaluation, Scores, Expertise
Peer reviewed Peer reviewed
Direct linkDirect link
Kraft, Matthew A.; Gilmour, Allison F. – Educational Researcher, 2017
In 2009, the New Teacher Project's "The Widget Effect" documented the failure of U.S. public school districts to recognize and act on differences in teacher effectiveness. We revisit these findings by compiling teacher performance ratings across 24 states that adopted major reforms to their teacher evaluation systems. In the vast…
Descriptors: Teacher Evaluation, Evaluation Methods, Teacher Attitudes, School Districts
Peer reviewed Peer reviewed
Direct linkDirect link
Yu, Fu-Yun; Sung, Shannon – Interactive Learning Environments, 2016
This study examined the effects of identity revelation and concealment on the number of times students' work was assessed in an online peer assessment context. It also examined the underlying reasons guiding the assessor's targeting behavior. Two fifth-grade classes participated. The one-group pretest-posttest experimental research design coupled…
Descriptors: Foreign Countries, Elementary School Students, Grade 5, Student Evaluation
Peer reviewed Peer reviewed
Direct linkDirect link
Yan, Xun – Language Testing, 2014
This paper reports on a mixed-methods approach to evaluate rater performance on a local oral English proficiency test. Three types of reliability estimates were reported to examine rater performance from different perspectives. Quantitative results were also triangulated with qualitative rater comments to arrive at a more representative picture of…
Descriptors: Mixed Methods Research, Language Tests, Oral Language, Language Proficiency
Peer reviewed Peer reviewed
Direct linkDirect link
Chahine, Saad; Holmes, Bruce; Kowalewski, Zbigniew – Advances in Health Sciences Education, 2016
The Objective Structured Clinical Exam (OSCE) is a widely used method of assessment in medical education. Rater cognition has become an important area of inquiry in the medical education assessment literature generally, and in the OSCE literature specifically, because of concerns about potential compromises of validity. In this study, a novel…
Descriptors: Medical Education, Licensing Examinations (Professions), Evaluators, Medical Students
Peer reviewed Peer reviewed
Direct linkDirect link
Collins, Kathleen M. T.; Onwuegbuzie, Anthony J. – New Directions for Evaluation, 2013
The goal of this chapter is to recommend quality criteria to guide evaluators' selections of sampling designs when mixing approaches. First, we contextualize our discussion of quality criteria and sampling designs by discussing the concept of interpretive consistency and how it impacts sampling decisions. Embedded in this discussion are…
Descriptors: Sampling, Mixed Methods Research, Evaluators, Q Methodology
Peer reviewed Peer reviewed
Direct linkDirect link
Bell, Sheena – Journal of Research in Special Educational Needs, 2013
In this paper, the results of an investigation into the training needs and expectations of participants of professional development training for specialist teachers and assessors of learners with literacy difficulties and dyslexia are discussed and analysed. The methodology includes both qualitative and quantitative data which were collected over…
Descriptors: Faculty Development, Dyslexia, Specialists, Evaluators
Peer reviewed Peer reviewed
Direct linkDirect link
Cheng, Liying; Fox, Janna – Language Teaching, 2013
This paper reviews a selected sample of 24 doctoral dissertations in language assessment (broadly defined), completed between 2006 and 2011 in Canadian universities. These dissertations fall into five thematic categories: 1) reliability, validity and factors affecting test performance; 2) washback (impact) and ethics; 3) raters, rating and rating…
Descriptors: Foreign Countries, Doctoral Dissertations, Mixed Methods Research, Language Research
Peer reviewed Peer reviewed
Direct linkDirect link
Youn, Soo Jung – Language Testing, 2015
This study investigates the validity of assessing L2 pragmatics in interaction using mixed methods, focusing on the evaluation inference. Open role-plays that are meaningful and relevant to the stakeholders in an English for Academic Purposes context were developed for classroom assessment. For meaningful score interpretations and accurate…
Descriptors: Second Language Learning, Pragmatics, Validity, Mixed Methods Research
Previous Page | Next Page ยป
Pages: 1  |  2