Descriptor
| Generalizability Theory | 6 |
| Reliability | 6 |
| Scores | 4 |
| English (Second Language) | 2 |
| Second Language Learning | 2 |
| Speech | 2 |
| Test Construction | 2 |
| Test Items | 2 |
| Validity | 2 |
| Writing Tests | 2 |
| Ability | 1 |
| More ▼ | |
Source
Author
| Kantor, Robert | 2 |
| Lee, Yong-Won | 2 |
| Mollaun, Pam | 2 |
| Brennan, Robert L. | 1 |
| Ellett, Chad D. | 1 |
| Frisbie, David A. | 1 |
| Lee, Guemin | 1 |
| Newman, Larry S. | 1 |
| Wang, Ning | 1 |
| Wiser, Randall F. | 1 |
Publication Type
| Numerical/Quantitative Data | 6 |
| Speeches/Meeting Papers | 5 |
| Reports - Research | 4 |
| Reports - Evaluative | 2 |
Education Level
Audience
Location
| Louisiana | 1 |
Laws, Policies, & Programs
Assessments and Surveys
| Test of English as a Foreign… | 2 |
What Works Clearinghouse Rating
Download full textLee, Guemin; Frisbie, David A. – 1997
Previous studies have indicated that the reliability of test scores composed of testlets might be overestimated by conventional item-based reliability estimation methods (R. Thorndike, 1953; A. Anastasi, 1988; S. Sireci, D. Thissen, and H. Wainer, 1991; H. Wainer and D. Thissen, 1996). This study used generalizability theory to investigate the…
Descriptors: Estimation (Mathematics), Generalizability Theory, Reliability, Scores
Brennan, Robert L. – 1993
Not infrequently, investigators assume that reliability for groups is greater than reliability for persons, or that the error variance for groups is less than that for persons. Using generalizability theory, it is shown that this "conventional wisdom" is not necessarily true. Examples are provided from the course-evaluation and the…
Descriptors: Comparative Analysis, Course Evaluation, Generalizability Theory, Measurement Techniques
Wang, Ning; Wiser, Randall F.; Newman, Larry S. – 1999
Job analysis has played a fundamental role in developing and validating licensure and certification examinations, but research on what constitutes reliable and valid job analysis data is lacking. This paper examines the reliability and validity of job analysis survey results. Generalizability theory and the multi-facet Rasch item response theory…
Descriptors: Generalizability Theory, Goodness of Fit, Item Response Theory, Job Analysis
Lee, Yong-Won; Kantor, Robert; Mollaun, Pam – 2002
This paper reports the results of generalizability theory (G) analyses done for new writing and speaking tasks for the Test of English as a Foreign Language (TOEFL). For writing, a special focus was placed on evaluating the impact on the reliability of the number of raters (or ratings) per essay (one or two) and the number of tasks (one, two, or…
Descriptors: English (Second Language), Generalizability Theory, Reliability, Scores
Lee, Yong-Won; Kantor, Robert; Mollaun, Pam – 2002
This study examines the score dependability of writing and speaking assessments from the Test of English as a Foreign Language (TOEFL) from the perspectives of univariate and multivariate generalizability theory (G-theory) and presents the findings of three separate G-theory studies. For writing, the focus was on evaluating the impact on…
Descriptors: Ability, English (Second Language), Generalizability Theory, Item Bias
Ellett, Chad D.; And Others – 1991
This paper presents the results of ongoing analyses of the reliability of the System for Teaching and Learning Assessment and Review (STAR) as a comprehensive measure of classroom teaching and learning for making teacher certification decisions. Focus was on the effects of high stakes assessment conditions for certification on the generalizability…
Descriptors: Classroom Observation Techniques, Educational Indicators, Elementary School Teachers, Evaluation Criteria
