Amazon Mechanical Turk (MTurk) is a crowdsourcing website that has become a popular participant recruitment tool in social science research. MTurk provides access to a large, diverse, and inexpensive pool of willing participants, and the unique clinical characteristics of MTurk participants may be of particular interest to rehabilitation…

Although International Association for the Evaluation of Educational Achievement-pioneered international large-scale assessment (ILSA) of education is now a well-established science, non-practitioners and many users often substantially misunderstand how large-scale assessments are conducted, what questions and challenges they are designed to…

This discussion constructs a survey data quality strategy for institutional researchers in higher education in light of total survey error theory. It starts with describing the characteristics of institutional research and identifying the gaps in literature regarding survey data quality issues in institutional research and then introduces the…

This guide is designed to help researchers make sure that their research reports include enough information about study measures so that readers can assess the quality of the study's methods and results. The guide also provides examples of write-ups about measures and suggests resources for learning more about these topics. The guide assumes…

This paper intends to construct a survey data quality strategy for institutional researchers in higher education in light of total survey error theory. It starts with describing the characteristics of institutional research and identifying the gaps in literature regarding survey data quality issues in institutional research. Then it is followed by…

The "PISA 2009 Technical Report" describes the methodology underlying the PISA 2009 survey. It examines additional features related to the implementation of the project at a level of detail that allows researchers to understand and replicate its analyses. The reader will find a wealth of information on the test and sample design,…

There has recently been a tremendous increase in the quantity of research published in gerontology. While the increase in the quantity of research has been regarded positively by gerontologists, there has been little discussion or evaluation of the quality of the research. Two articles that appeared in 1975 were both very critical of…

This report describes the methods and procedures used for the 1999 National Study of Postsecondary Faculty (NSOPF:99). As did the first 2 cycles of this survey, NSOPF:99 serves the continuing need for data on faculty and other instructional personnel. NSOPF:99 used a sample of 960 institutions and 28,576 full- and part-time faculty employed at…

The National Science Concept Learning Study represented one of the largest and the most extensive surveys of its kind undertaken in Taiwan in recent years. A total of 36,093 students from the sixth, eighth, ninth, and eleventh grades participated in the main study. This paper provides the background information about the sampling and booklet…

The Pell Grant Quality Control Study of 1982-83 was designed to identify program error rate, to measure the impact of increased validation activity, and to propose corrective actions to reduce the misallocation of program funds. A sample of approximately 4,000 students was drawn from a stratified random sample of 317 participating institutions.…

The Third International Mathematics and Science Study (TIMSS) is the most ambitious study conducted by the International Association for the Evaluation of Educational Achievement to date. TIMSS developed and administered tests and questionnaires in three student populations to study achievement in participating countries and the factors associated…

The type, number, and scope of errors on Basic Educational Opportunity Grant (BEOG) program applications were estimated in a replication of a 1976-1977 Internal Revenue Service (IRS) Comparison Study. Information reported on BEOG applicants and IRS income tax returns was compared for various categories of applicants. The study provides information…

The Third International Mathematics and Science Study (TIMSS) developed and administered tests and questionnaires in three student populations to document the quality of mathematics and science education in 45 participating countries. Study design, instrument development, and research procedures were achieved through a complex collaborative…

This volume describes the technical aspects of TIMSS 2003 and summarizes the main activities involved in the development of the data collection instruments, the data collection itself, and the analysis and reporting of the data. The thirteen chapters contained herein are: (1) Overview of TIMSS 2003 (Michael O. Martin and Ina V. S. Mullis); (2)…

Research and instructional role strains are identified, based on the use of large-scale mail surveys for college self-study that are used to teach introductory research methodology. The two organizational hierarchies, the research model and the instructional model, are examined. Experiences at Northwestern University, Northeastern Illinois…