NotesFAQContact Us
Collection
Advanced
Search Tips
Audience
Researchers3
Location
Canada1
Laws, Policies, & Programs
Assessments and Surveys
Personal Orientation Inventory1
What Works Clearinghouse Rating
Showing 1 to 15 of 27 results Save | Export
Peer reviewed Peer reviewed
Direct linkDirect link
Yuan Tian; Xi Yang; Suhail A. Doi; Luis Furuya-Kanamori; Lifeng Lin; Joey S. W. Kwong; Chang Xu – Research Synthesis Methods, 2024
RobotReviewer is a tool for automatically assessing the risk of bias in randomized controlled trials, but there is limited evidence of its reliability. We evaluated the agreement between RobotReviewer and humans regarding the risk of bias assessment based on 1955 randomized controlled trials. The risk of bias in these trials was assessed via two…
Descriptors: Risk, Randomized Controlled Trials, Classification, Robotics
Albert M. Jimenez; Sally J. Zepeda – Sage Research Methods Cases, 2017
The work presented in this case study results from a study conducted in 2012-2014 examining a newly created teacher evaluation system to determine the inter-rater reliability of the classroom observation instrument. The teacher evaluation system was the result of a partnership between the school district and the university in the same city…
Descriptors: Case Studies, Interrater Reliability, Teacher Evaluation, Observation
Peer reviewed Peer reviewed
Direct linkDirect link
Dockray, Samantha; Grant, Nina; Stone, Arthur A.; Kahneman, Daniel; Wardle, Jane; Steptoe, Andrew – Social Indicators Research, 2010
Measurement of affective states in everyday life is of fundamental importance in many types of quality of life, health, and psychological research. Ecological momentary assessment (EMA) is the recognized method of choice, but the respondent burden can be high. The day reconstruction method (DRM) was developed by Kahneman and colleagues ("Science,"…
Descriptors: Employed Women, Quality of Life, Evaluation Methods, Psychological Patterns
Peer reviewed Peer reviewed
Direct linkDirect link
Hagermoser Sanetti, Lisa M.; Kratochwill, Thomas R. – School Psychology Review, 2009
Treatment integrity (also referred to as "treatment fidelity," "intervention integrity," and "procedural reliability") is an important methodological concerning both research and practice because treatment integrity data are essential to making valid conclusions regarding treatment outcomes. Despite its relationship to validity, treatment…
Descriptors: Intervention, Research Methodology, Models, Validity
Peer reviewed Peer reviewed
Direct linkDirect link
McLeod, Bryce D.; Southam-Gerow, Michael A.; Weisz, John R. – School Psychology Review, 2009
This special series focused on treatment integrity in the child mental health and education field is timely. The articles do a laudable job of reviewing (a) the current status of treatment integrity research and measurement, (b) existing conceptual models of treatment integrity, and (c) the limitations of prior research. Overall, this thoughtful…
Descriptors: Evaluation Research, Children, Intervention, Research Methodology
Peer reviewed Peer reviewed
Taylor, Erwin K.; Griess, Thomas – Personnel Psychology, 1976
In most selection validation research, only the upper and lower tails of the criterion distribution are used, often yielding misleading or incorrect results. Provides formulas and tables which enable the researcher to account more accurately for the distribution of criterion within the middle range of population. (Author/RW)
Descriptors: Evaluation Methods, Measurement Techniques, Predictive Validity, Reliability
Hedge, Jerry W.; Laue, Frances J. – 1988
The ability of individuals to make accurate judgments about others is examined and literature on this subject is reviewed. A wide variety of situational factors affects the appraisal of performance. It is generally accepted that the purpose of the appraisal influences the accuracy of the appraiser. The instrumentation, or tools, available to the…
Descriptors: Evaluation Criteria, Evaluation Methods, Evaluation Problems, Performance Factors
Peer reviewed Peer reviewed
Furlong, Michael J.; Wampold, Bruce E. – Psychology in the Schools, 1981
To guide the unbiased process of visual inference, a four-step model is presented for the assessment of reliability, intervention effect, meaningfulness, and generalizability. A Visual Inference Checklist (VIC) systematizes this assessment process. (Author)
Descriptors: Bias, Data Analysis, Evaluation Methods, Identification
Peer reviewed Peer reviewed
Carroll, Kathleen M. – Psychological Assessment, 1995
Three types of methodological issues particularly salient in research involving the assessment of substance use or abuse are discussed with strategies for avoiding problems: (1) the reliability and validity of methods; (2) the variability and episodic course of substance use; and (3) the heterogeneity of individuals with substance use disorders.…
Descriptors: Clinical Diagnosis, Evaluation Methods, Psychological Studies, Reliability
Peer reviewed Peer reviewed
Marks, Stephen E.; And Others – Journal of Counseling Psychology, 1973
The authors of this article contend that the Guinan and Foulds study was inadequately designed and executed, and the results indicate little of the "usefulness" of the test, much less illuminate the important hypothesis central to the investigation. Specific suggestions for further research in marathon group evaluation are made. (Author)
Descriptors: Evaluation Methods, Group Counseling, Measurement Techniques, Reliability
Peer reviewed Peer reviewed
Direct linkDirect link
Schulte, Ann C.; Easton, Julia E.; Parker, Justin – School Psychology Review, 2009
Documenting treatment integrity is an important issue in research and practice in any discipline concerned with prevention and intervention. However, consensus concerning the dimensions of treatment integrity and how they should be measured has yet to emerge. Advances from three areas in which significant treatment integrity work has taken…
Descriptors: Substance Abuse, Prevention, Outcomes of Treatment, School Psychology
Peer reviewed Peer reviewed
Direct linkDirect link
Gresham, Frank M. – School Psychology Review, 2009
The concept of treatment integrity cuts across a diversity of fields involved with providing treatments or interventions to individuals. In medical treatments, the concept of "treatment compliance" or "treatment adherence" is an important and problematic issue. In the field of nutrition, the concept of "dietary adherence" is important for…
Descriptors: Program Implementation, Psychometrics, Definitions, Intellectual Disciplines
Kieren, Dianne K.; Hurlbut, Nancy L. – 1986
The family is an obvious group for whom problem solving effectiveness holds importance. Problem solving interaction refers to the manner in which the behavior of family members is organized to resolve situations in which there is an unachieved but attainable goal, and the means to overcoming the barriers to achieving the goal are not apparent, but…
Descriptors: Evaluation Methods, Family Life, Family Relationship, Family (Sociological Unit)
Rossiter, Charles M., Jr.; And Others – 1972
The authors question Burgoon's assumption that the acquisition of grades and the achievement of course goals are highly positively correlated. The major criticisms of Burgoon's study concern use of grades as measurements of success and the nature of the experimental population. The use of grades is criticized on the grounds that disparity existed…
Descriptors: Academic Achievement, Behavior, Communication (Thought Transfer), Evaluation Methods
Gage, N. L. – 1978
This paper reviews the reliability of several efforts by educational researchers to determine variables in teacher behavior that influence student attitudes and achievement. In particular, works by Rosenshine (1971), Dunkin and Biddle (1974), and Rosenshine and Furst (1970) are examined and evaluated in terms of research criteria developed by…
Descriptors: Academic Achievement, Educational Research, Evaluation Methods, Reliability
Previous Page | Next Page ยป
Pages: 1  |  2