Post-secondary data literacy education is critical to students' academic and career success. However, the literature has not adequately addressed the conceptualization and assessment of data literacy for post-secondary students. In this study, we introduced a novel digital performance-based assessment for teaching and evaluating post-secondary…

Essay exams offer many benefits for instructors who seek to vary their assessment methods and engage students in critical discourse, yet they also pose many challenges and require thoughtful construction and evaluation. The author provides an extensive overview of the literature to illuminate best practices for designing and assessing effective…

This article addresses performance assessments that involve collaboration among students. We apply the Hawkes process to infer whether the actions of one student are associated with increased probability of further actions by his/her partner(s) in the near future. This leads to an intuitive notion of engagement among collaborators, and we consider…

An accumulating body of evidence suggests that young children who exhibit greater executive functioning (EF) skills in early childhood also achieve more academically. The goal of the present study was to examine the unique contributions of direct assessments and teacher ratings of children's EF skills at the beginning of prekindergarten (pre-k) to…

Looking beyond the right or wrong answer is imperative to the development of effective educational environments conducive to Pre-AP work in math. This presentation explores a system of evaluation in math that provides a personalized, student-reflective model correlated to consortia-based assessment. Using examples of students' work that includes…

Literacy skills are fundamental for all learners. For students who require augmentative and alternative communication (AAC), strong literacy skills provide a gateway to generative communication, genuine social networking, improved access to academic opportunities, access to information technology and future employment opportunities. However, many…

Although the theoretical benefits of feedback are generally well established, in practice those benefits can be less than clear. This is particularly the case on shorter courses, where students have limited scope to integrate feedback into future assessment performance. If we accept that one of the key purposes of feedback is to encourage students…

The use of latent class analysis for establishing student performance standards was studied. Latent class analysis (LCA) is an established procedure for investigating the latent structure of a set of data. LCA presumes that groups, classes, or respondents differ qualitatively from one another, and that these differences account for all of the…

Using responses of 123 elementary school teachers, a battery of performance-assessment tasks designed to generate responses to reading tests was evaluated from task development and scoring perspectives. More than one dozen types of errors were identified. Practical outcomes of the study and improvement of task development and scoring are…

Causes of local item dependence in a large-scale performance assessment were studied using data from the Maryland School Performance Assessment Program. Contextual characteristics (content and response requirements) were identified to differentiate locally independent and dependent item clusters. Hypothesized explanations are offered for high…

The purpose of "Considering Consistency" is to provide conceptual and procedural guidance regarding reliability within the context of a local assessment system. Some of this document's contents echo "Measured Measures." For instance, methods for estimating the reliability of individual assessments, particularly as appropriate for…

The purpose of this Item Response Theory study was to investigate how the expected reduction in item information, due to the collapsing of response categories in performance assessment data, was affected by varying testing conditions: item difficulty, item discrimination, inter-rater reliability, and direction of collapsing. The investigation used…

A framework for categorizing constructed-response items was developed in which items were ordered on a continuum from multiple-choice to presentation/performance according to the degree of constraint placed on the examinee's response. Two investigations were carried out to evaluate the validity of this framework. In the first investigation, 27…

This study investigated whether raters in two different training groups would demonstrate halo error when each rater scored all five responses to five different mathematics performance-based items from each student. One group of 20 raters was trained by an experienced scoring director with item-specific scoring rubrics and the opportunity to…

This study examined the effects of conversational language (e.g., asking questions, inviting replies, acknowledgments, referencing others by name, closing signatures, "I agree, but", greetings, etc.) on the frequency and types of responses posted in reply to given types of messages (e.g., argument, evidence, critique, explanation), and…