Assessment rubrics intend to make criteria explicit to students. However, an understanding of assessment criteria requires tacit knowledge about which students may not be aware. The lack of such knowledge is notable in undergraduate health science students taking a compulsory course in the social sciences. This study performed a content analysis…

Physics faculty care about their students learning physics content. In addition, they usually hope that their students will learn some deeper lessons about thinking critically and scientifically. They hope that as a result of taking a physics class, students will come to appreciate physics as a coherent and logical method of understanding the…

Memory for verbal material improves when words form familiar chunks. But how does the improvement due to chunking come about? Two possible explanations are that the input might be actively recoded into chunks, each of which takes up less memory capacity than items not forming part of a chunk (a form of data compression), or that chunking is based…

Today's society is highly visual, imposing the use of respective practices in Higher Education; under this scope the importance of images and multimedia alters the way 21st digital literacy is perceived. As technology advances, it is important for education professionals to learn how to read visuals through practicing and analyzing techniques, but…

In this study, the efficiency of various random sampling methods to reduce the number of items rated by judges in an Angoff standard-setting study was examined and the methods were compared with each other. Firstly, the full-length test was formed by combining Placement Test 2012 and 2013 mathematics subsets. After then, simple random sampling…

This study was conducted to develop the Measure of Gender Exploration and Commitment (MGEC), a school counseling and training tool. The MGEC assesses one's gender exploration and commitment and was normed with a national sample of school counselors. Developing the MGEC involved (a) conducting a literature review, (b) modifying items, and (c)…

In this study, we investigated factors that influence raters' application of the scoring criteria of an Explicit Instruction (EI) observation protocol using many-faceted Rasch measurement (MFRM) and think aloud analysis. Specifically, we investigated the extent to which raters are able to consistently represent the scoring criteria in the EI…

The State Capacity Assessment (SCA) was developed to assess the impact and presence of efforts to build strong foundations needed to adopt, sustain, and scale effective practices so that they lead to positive outcomes. In use, the SCA assesses the extent to which an agency invests in and aligns system components to support use of best practices,…

This study identified some factors associated with teachers' knowledge and beliefs that are related to scoring mathematics constructed-response (CR) assessment tasks. Five groups of teachers (n = 274) who either had different teaching experiences or had different cultural beliefs about teaching and learning mathematics were selected to score 28…

Researchers have found numerous differences in the approaches raters take to the complex task of essay rating including differences when rating native (L1) and non-native (L2) English writing. Yet less is known about raters' reading practices while scoring those essays. This small-scale study uses eye-tracking technology and reflective protocols…

In this paper, we analyze mathematics lessons using the Classroom Assessment Scoring System (CLASS), a standardized observation protocol that suggests that high-quality lessons are distinguished by the tenor and frequency of classroom interactions. Because the CLASS focuses on interactions, rather than the specifics of content teaching, it can be…

We present a microservice architecture for large-scale automated scoring applications. Our architecture builds on the open-source Apache Storm framework and facilitates the development of robust, scalable automated scoring applications that can easily be extended and customized. We demonstrate our architecture with an application for automated…

A key part of determining cut-scores when performing Angoff standard setting is utilizing equating methods to place standard-setting ratings onto the scale used to report scores to examinees. This article describes three equating methods that can be employed to place Angoff ratings onto the scale used to report scores to examinees when applying…

Rationale is presented for the derivation of a new measure of stressful life events for use with students [the Negative Life Events Scale for Students (NLESS)]. Ten stressful life events questionnaires were reviewed, and the more than 600 items mentioned in these scales were culled based on the following criteria: (a) only long-term and unpleasant…

This study showed extent of rigor at North Louisiana school sites using a Likert Scale questionnaire and observation rubric, derived from the Rigor/Relevance Framework and COMPASS rubric, respectively. Cognitive thinking is highly regarded by educators and employers in a global economy as students use it to infer, connect, and apply knowledge to…