Sample size and statistical power are important factors to consider when planning a research synthesis. Power analysis methods have been developed for fixed effect or random effects models, but until recently these methods were limited to simple data structures with a single, independent effect per study. Recent work has provided power…

This case study aims to shed light on the methodological aspects of using a qualitative survey as the main data collection instrument to study prospective teachers' meaning-making process while learning about research methods and conducting their own projects. Particular attention is paid to the design and administration challenges of the…

This guide offers a comprehensive handbook to scientific research methodology and experimental design, specifically for novice MA and PhD researchers in Education and Language Learning (TESOL/TEFL). It establishes scientific research as a systematic, objective inquiry focused on identifying cause-and-effect relationships through empirical data.…

Students as partners (SaP) is becoming an increasingly common notion in higher education , but we continue to grapple with questions around how to best involve our students with the work we do as educators. Queries around responsibility, accountability and trust are raised when considering SaP. Participatory action research is presented from an…

Educators and researchers strive to build policies and practices on data and evidence, especially on academic achievement scores. When assessment scores are inaccurate for specific student populations or when scores are inappropriately used, even data-driven decisions will be misinformed. To maximize the impact of the research-practice-policy…

The use of singular methodologies has dominated emotional and behavioral disorder (EBD) intervention research, and by extension, the field has not deployed mixed-methods research (MMR). The purpose of this article is to provide an overview of MMR and demonstrate its utility for conducting EBD intervention research. The basic tenants and design…

This paper describes instruments designed to use multimedia to study at scale the instructional decisions that mathematics teachers make as well as teachers' recognition of elements of the context of their work that might influence those decision. This methodological contribution shows how evidence of constructs like instructional norm and…

Packed with new topics that reflect today's challenges, the Sixth Edition of the bestselling "How to Conduct Surveys" guides readers through the process of developing their own rigorous surveys and evaluating the credibility and transparency of surveys created by others. Offering practical, step-by-step advice and written in the same…

This manual has been produced to familiarize data users with the design, and the procedures followed for data collection and processing, in the base year and first follow-up of the High School Longitudinal Study of 2009 (HSLS:09), with emphasis on the first follow-up. It also provides the necessary documentation for use of the public-use data…

The manual that accompanies these appendices was produced to familiarize data users with the design, and the procedures followed for data collection and processing, in the base year and first follow-up of the High School Longitudinal Study of 2009 (HSLS:09), with emphasis on the first follow-up. It also provides the necessary documentation for use…

The reflective and interrogative processes required for developing effective qualitative research questions can give shape and direction to a study in ways that are often underestimated. Good research questions do not necessarily produce good research, but poorly conceived or constructed questions will likely create problems that affect all…

In the context of intensifying accountability for academic work internationally, there are increasing pressures on individual supervisors, departments and universities to evaluate the quality of doctoral supervision. Existing evaluation tools are focused at departmental rather than individual level and are mostly quantitative. Evaluation for…

This report describes a web-based assessment design tool, the Assessment Design and Delivery System (ADDS), that provides teachers both a structure and the resources required to develop and use quality assessments. The tool is applicable across subject domains. The heart of the ADDS is an assessment design workspace that allows teachers to…

The current pace of technological advance has provided an unprecedented opportunity to use innovative simulated tasks in computerized assessment. A primary challenge for the successful use of innovation in assessment rests with the application of sound principles of design to produce a valid assessment. An additional challenge is to maximize the…

This document provides some examples of questions that might be asked about research design and analysis, or that might be used in test construction. The accompanying answers form a basic discussion of research design and analysis techniques. Short-answer constructed response answers are provided for questions about: (1) control in an experiment;…