This article proposes a Boolean approach to representing and analyzing interobserver agreement in dichotomous coding. Building on the notion that observations are samples of a universe of observations, it submits that coding can be viewed as a process in which observers sample pieces of evidence on constructs. It distinguishes between formal and…

Systematic searching aims to find all possibly relevant research from multiple sources, the basis for an unbiased and comprehensive evidence base. Along with bibliographic databases, systematic reviewers use a variety of additional methods to minimise procedural bias. Citation chasing exploits connections between research articles to identify…

This paper uses evidence-centered assessment design (ECD) to structure and analyze a laboratory activity where students collect and represent titration curve data to determine acid strength in terms of molarity and dissociation constant. Following principles of multidimensional learning, the activity prompts students to demonstrate knowledge of…

Many classroom units and lessons are now organized around engaging students in developing claims and evidence. An aspect of teachers' work that is understudied is how teachers manage the complexity inherent in navigating between claims and empirical data. In other words, what do teachers do when students do not see what they are "supposed…

Coding is a process of assigning meaning to a given piece of evidence. Evidence may be found in a variety of data types, including documents, research interviews, posts from social media, conversations from learning platforms, or any source of data that may provide insights for the questions under qualitative study. In this study, we focus on text…

Three experiments examined whether 4- and 5-year-olds can explicitly revise uncertain beliefs in light of disconfirming evidence. We considered 2 factors that might influence belief revision: (a) the type and variability of evidence provided, and (b) whether children generated an explanation of their initial hypothesis. When provided with limited…

We evaluate the extent to which ePortfolios can be used to assess applied and collaborative learning and academic identity among community college students from underrepresented minority groups who participated in a summer research program. Thirty-eight students were evaluated by their research sponsor and two or three naïve faculty evaluators.…

While many innovative teaching strategies exist, integration into undergraduate science teaching has been frustratingly slow. This study aims to understand the low uptake of research-based instructional innovations by studying 21 successful implementations of the Student Centered Active Learning with Upside-down Pedagogies (SCALE-UP) instructional…

Purpose: English learner (EL) education policy has long directed schools to address EL students' linguistic "and" academic development without furthering inequity or segregation. The recent Every Student Succeeds Act reauthorization expresses a renewed focus on evidence of equity, effectiveness, and opportunity to learn. We propose that…