The standard scoring of the CLASS PreK produces three domain scores that are widely used in research, practice and policy. Despite these domains being based on developmental theory and research, limited empirical evidence exists for the three-domain structure as operationalized in the CLASS PreK. Using the 2009 and 2014 Head Start Family and Child…

This chapter focuses on IR's role in coordinating a pilot of the Degree Qualifications Profile (DQP) for assessment in a new master's degree program and provides guidance on frameworks that can be used, important technical considerations, and ways IR can be involved to advance the use of rubrics as a primary program assessment tool.

Automated scoring models were trained and evaluated for the essay task in the "Praxis I"® writing test. Prompt-specific and generic "e-rater"® scoring models were built, and evaluation statistics, such as quadratic weighted kappa, Pearson correlation, and standardized differences in mean scores, were examined to evaluate the…

Anxiety disorders are among the most prevalent mental disorders among school-age children and can lead to impaired academic and social functioning (Keeley & Storch, 2009). Unfortunately, anxiety disorders in this population are often undetected (Herzig-Anderson, Colognori, Fox, Stewart, & Warner, 2012). The availability of psychometrically…

This paper argues for the replication of two studies, both of which consider feedback and working memory. In the first part of this paper, we discuss the role of interaction-based research and working memory research in second language acquisition research. We then describe two studies that have unified these two areas in recent published articles…

The purpose of this study is to analyse the feasibility of an evidential reasoning (ER) method for portfolio assessments and comparison of the results found with those based on a traditional holistic judgement. An ER approach has been incorporated into portfolio assessment of an undergraduate engineering design course delivered as a project-based…

The growth of competency-based education in an online environment requires the development and measurement of quality competency-based courses. While quality measures for online courses have been developed and standardized, they do not directly align with emerging best practices and principles in the design of quality competency-based online…

This paper presents a method for equating writing assessments using pairwise comparisons which does not depend upon conventional common-person or common-item equating designs. Pairwise comparisons have been successfully applied in the assessment of open-ended tasks in English and other areas such as visual art and philosophy. In this paper,…

The Angoff method requires experts to view every item on the test and make a probability judgment. This can be time consuming when there are large numbers of items on the test. In this study, a G-theory framework was used to determine if a subset of items can be used to make generalizable cut-score recommendations. Angoff ratings (i.e.,…

In a fast-paced, technology-driven world, the age-old custom and etiquette of writing a thank-you note may often be forgotten. Educators need to provide students with the opportunity to master this important professional skill. One might assume that undergraduate biology students have mastered the art of crafting a thoughtful and articulate…

An argument is presented that the quest for quality teaching and learning in MOOCs should not be limited to merely demonstrating that these innovative learning environments have the same levels of effectiveness as traditional educational approaches (e.g., classroom instruction), but rather that they can exactly go beyond current levels of impact.…

The "Clinical Evaluation of Language Fundamentals-Fifth Edition" (CELF-5; Wiig, Semel, & Secord, 2013) is a recently updated battery of tests designed to assess, diagnose, and measure changes in language and communication in individuals 5 to 21 years of age. Designed to identify language strengths and weaknesses, determine service…

This article details the "journey box" project process enacted by two elementary preservice teacher cohorts. Engaging in activities and projects that promote a sense of investment in not only consuming but producing historical narratives, preservice teachers potentially become interested in sharing this type of learning with their…

Most doctoral students are novice researchers and may not possess the skills to effectively conduct a comprehensive review of the literature and frame a problem designed to conduct original research. Students need proper training and tools necessary to critically evaluate, synthesize and organize literature. The purpose of this concurrent mixed…

The construct map is a promising tool for organizing the data standard-setting panelists interpret. The challenge in applying construct maps to standard-setting procedures will be the judicious selection of data to include within this organizing framework. Therefore, this commentary focuses on decisions about what to include in the construct map.…