Assessment is a topic of concern to all stakeholders in our educational system. Pattern Based Questions are an assessment tool which is an alternative to the standardized assessment tool, and they are based on generative learning pedagogy, which shows promise in engaging all learners and usefulness in teaching and learning but validity has not yet…

In the last twenty-five years, the discussion surrounding validity evidence has shifted both in language and scope, from the work of Messick and Kane to the updated Standards for Educational and Psychological Testing. However, these discussions haven't necessarily focused on best practices for different types of instruments or assessments, taking…

To developed an educational tool for an online OSCE to evaluate the practice readiness of the fourth-year nursing students. Online professional proficiency evaluation of nursing students can be a valid alternative to traditional methods. We designed a one group pre-posttest study. The 51 nursing students were recruited. We implemented a 3-stage of…

Non-cognitive skills are routinely measured using self-reports in the context of large-scale international assessments. However questions remain on the adequacy of self-reports to conduct comparisons. Measures that exploit test-taker's behaviour during the completion of questionnaires or of the cognitive tests have been proposed in the literature…

Mathematical calculations are an important part of chemistry. Those problems are difficult for students, especially if the task is set with a limiting reactant. The aim of this study was development of a Procedure for evaluation of cognitive complexity of the Stoichiometric Tasks with a Limiting Reactant. The procedure created included an…

Teacher candidates bring many beliefs and interpretations of mathematics teaching and learning at the start of their teacher preparation coursework (e.g. methods courses, field experiences, assessment). Well-prepared beginning teachers in many instances requires programs and designed experience to breakdown unproductive beliefs and/or improve…

Purposes: This study uses think-alouds and cognitive interviews to provide validity evidence for an online formative assessment--i-Ready Standards Mastery (iSM) mini-assessments--which involves a heavy use of innovative items. iSM mini-assessments are intended to help teachers determine student understanding of each of the on-grade-level Common…

With rising importance of collaborative problem-solving skills (CLPS) for the new information age, the PISA 2015 assessed students' CLPS skills on a large scale. This new attempt to measure CLPS raises an issue of validity. The purpose of this research is to examine evidence for convergent validity of CLPS through investigating the relationships…

High school graduation is "not yet a reliable indicator of college readiness", (Gaertner & McClarty, 2015, p2). As such, researchers are investigating the use of non-cognitive factors as predictors of college and career readiness (CCR). The College and Career Readiness English Language Arts (ELA) Scale was designed to measure…

We have developed assessment tasks aligned to NGSS that require students to use practices along with disciplinary core ideas to make sense of energy-related phenomena. In this paper, we present an analysis of field test data and feedback from expert reviewers on the validity and reliability of a set of elementary school tasks. These tasks focused…

The continuous measurement of learning behavior or learning outcome by appropriate sensors is fundamental for the implementation of technology-based adaptive learning courses. An adaptive system needs such learning data to adapt the instruction to the needs of students. Depending on the learning objective, the sensors use information generated…

Before an assessment is used to make decisions, the validity of the intended interpretation must be evaluated. The purpose of this paper is to describe how the argument-based approach and an interpretation/use argument (IUA) (Kane, 2013) were used to validate the interpretations made from the new Early Grade Mathematics Assessment (EGMA)…

Existing studies have defined and assessed disciplinary literacy, mathematical literacy, and general academic language. However, there is a need to define and assess mathematics discipline-specific language (MDL), particularly for elementary school teachers. Therefore, the purpose of this study was to develop a research instrument to assess the…

This paper reports findings from a national wide research project in Norway called "Research on individual assessment in schools" (FIVIS), with the main purpose to gain knowledge of how assessment stimulates learning and what characterizes school practices and classroom practices when assessment is used as a tool for learning.The project…

Building on prior work visualizing player behavior using interaction networks [1], we examined whether measures of implicit science learning collected during gameplay were significantly related to changes in external pre-post assessments of the same constructs. As part of a national implementation study, we collected data from 329 high school…