Across the world, teacher quality has come to be recognised as one of the most important variables affecting student outcomes; consequently, the regulation of entry into the profession is the subject of iterative review. The traditional 'one-off' interview, involving an interviewee and two or more interviewers, is a common, but not unproblematic,…

Response process validity evidence can provide researchers with insight into how and why participants interpret items on instruments such as tests and questionnaires. In chemistry education research literature and the social sciences more broadly, response process validity evidence has been used and reported in a variety of ways. This paper's…

Researchers need to know what is an appropriate sample size for interview work, but how does one decide upon an acceptable number of people to interview? This question is not relevant to case study work where one would typically interview every member of a case, or in situations where it is both desirable and feasible to interview all target…

Mathematics education researchers frequently use task-based interviews to gain insight into mathematicians' practice. However, there are a number of factors that should prevent mathematics educators from extrapolating how individual mathematicians respond to researcher-generated tasks in laboratory conditions, to how mathematicians practice their…

In this digital ITEMS module, Dr. Jacqueline Leighton and Dr. Blair Lehman review differences between think-aloud interviews to measure problem-solving processes and cognitive labs to measure comprehension processes. Learners are introduced to historical, theoretical, and procedural differences between these methods and how to use and analyze…

Hermeneutic phenomenologists propose that researchers inescapably bring themselves into their research because interpretation must inevitably be influenced by their contexts and pre-understandings. They propose that interpretation is a dynamic and active part of the construction of a text's meaning, and involvement in this construction process…

Cognitive interviewing (CI) is a method to identify sources of confusion in assessment items and to assess validity evidence on the basis of content and response processes. We introduce readers to CI and describe a process for conducting such interviews and analyzing the results. Recommendations for best practice are provided.

The Hope Scale is an 11-item teacher-rating instrument designed to help identify academic and social components of giftedness. It provides insights from teachers who work with students on a daily basis, which may differ from the type of information yielded through achievement and ability tests. The Hope Scale development was made possible by the…

This chapter provides a guide to research logistics and ethics in studying immigrant families. The authors outline major pragmatic issues in research design and data collection to which all scholars must attend, although current practices often do not respond to the idiosyncratic issues related to vulnerable immigrant populations (e.g.,…

In this interview, JD Brown reflects on language testing/assessment. He suggests that language testing can be seen as a continuum with hard core positivist approaches at one end and post modernist interpretive perspectives at the other, and also argues that norm referencing (be it proficiency, placement, or aptitude testing) and criterion…

In this "FastFacts," a state asks the Center on Enhancing Early Learning Outcomes (CEELO) to recommend experts in the field of assessing young children who are English Language Learners (ELL) to train administrators and psychologists working in district preschool programs for young children with special needs? This is particularly…

In this article, nine mathematicians were interviewed about their why and how they presented proofs in their advanced mathematics courses. Key findings include that: (1) the participants in this study presented proofs not to convince students that theorems were true but for reasons such as conveying understanding and illustrating methods, (2)…

Learning progressions represent a set of skills or pieces of knowledge ordered sequentially from least to most complex. This sequence can guide instruction as well as assessment content. This paper describes several useful methods for validating learning progressions including validating the relationship between the progression and student…

Life sciences faculty agree that developing scientific literacy is an integral part of undergraduate education and report that they teach these skills. However, few measures of scientific literacy are available to assess students' proficiency in using scientific literacy skills to solve scenarios in and beyond the undergraduate biology classroom.…

This report introduces the "WorkFORCE"™ Assessment for Job Fit, a personality assessment utilizing the "FACETS"™ core capability, which is based on innovations in forced-choice assessment and computer adaptive testing. The instrument is derived from the fivefactor model (FFM) of personality and encompasses a broad spectrum of…