ERIC Number: EJ1028878
Record Type: Journal
Publication Date: 2014-Feb
Pages: 11
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0036-6803
EISSN: N/A
Available Date: N/A
A Comparison of TIMSS Items Using Cognitive Domains
Nixon, Ryan S.; Barth, Katie N.
School Science and Mathematics, v114 n2 p65-75 Feb 2014
The results of international assessments such as the Trends in International Mathematics and Science Study (TIMSS) are often reported as rankings of nations. Focusing solely on national rank can result in invalid inferences about the relative quality of educational systems that can, in turn, lead to negative consequences for teachers and students. This study seeks an alternative data analysis method that allows for improved inferences about international performance on the TIMSS. In this study, four classroom teachers categorized a sample of TIMSS items by the cognitive domains of knowing and applying using the definitions provided by the "TIMSS 2011 Assessment Frameworks." Items of different cognitive domains were analyzed separately. This disaggregation allowed for more valid inferences to be made about student performance. Results showed almost no significant difference between the performance of U.S. students and the students of five other nations. Additionally, no differences were observed in U.S. students' performance on knowing items and applying items, although students from some sample nations performed significantly better on knowing items. These results suggest that policy makers, educators, and citizens should be cautious when interpreting the results of TIMSS rank tables.
Descriptors: Comparative Analysis, Test Items, Data Analysis, Inferences, Foreign Countries, Achievement Tests, Cognitive Ability, Academic Achievement, Science Achievement, Mathematics Achievement, Cross Cultural Studies, Cultural Differences
Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: cs-journals@wiley.com; Web site: http://www.wiley.com/WileyCDA
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Trends in International Mathematics and Science Study
Grant or Contract Numbers: N/A
Author Affiliations: N/A