Current approaches used in educational research and practice to evaluate the quality of written arguments often rely on structural analysis. In such assessments, credit is awarded for the presence of structural elements of an argument, such as claims, evidence, and rebuttals. In this article, we discuss limitations of such approaches, including…

The purpose of this manuscript is, first and foremost, to present new research in the Information Systems realm that will support future research into perceptions of Visual Appeal in an online environment. In furtherance of these goals, the research draws on Composition Theory to articulate a two-essay research agenda. Composition Theory states…

After passage of the Every Student Succeeds Act (ESSA) in 2015, states assumed greater responsibility for designing their own accountability and assessment systems. ESSA requires states to measure "higher order thinking skills and understanding" and encourages the use of open-ended performance assessments, which are essential for…

The Every Student Succeeds Act (ESSA) opened up new possibilities for how student and school success are defined and supported in American public education. States have greater responsibility for designing and building their assessment and accountability systems. These new opportunities to develop performance assessments are critically important…

Two experiments were conducted to examine whether students use arguments with refutation in one text for evaluating the opposite arguments without refutation in another text. Undergraduate students read two conflicting texts in either of the two orders: pro arguments text first and con arguments text first. After reading each text, they evaluated…

This article discusses how to assess for wisdom, intelligence, and creativity. The author describes how he uses the model, Wisdom, Intelligence and Creativity Synthesized, or WICS, as a basis for admissions at Tufts University. Then, he presents actual essay topics that can be used for admissions to the Class of 2011.

Automated scoring models for the "e-rater"® scoring engine were built and evaluated for the "GRE"® argument and issue-writing tasks. Prompt-specific, generic, and generic with prompt-specific intercept scoring models were built and evaluation statistics such as weighted kappas, Pearson correlations, standardized difference in…

The 10th International Conference on Educational Data Mining (EDM 2017) is held under the auspices of the International Educational Data Mining Society at the Optics Velley Kingdom Plaza Hotel, Wuhan, Hubei Province, in China. This years conference features two invited talks by: Dr. Jie Tang, Associate Professor with the Department of Computer…

An objective model for evaluating expository compositions is proposed in this article. The model requires that English composition instructors be cognizant of their instructional objectives and that they convey the criteria for a good essay to their students. The evaluation of compositions then is based on the manifestation of the stipulated…

A model-based approach to rater reliability for essays read by multiple readers is presented. Variation of rater severity (between-rater variation) and rater inconsistency (within-rater variation) is considered in the presence of between-examinee variation. An additive variance component model is posited and the method of moments for its…

A phenomenological approach to library research utilizing qualitative research methods is contrasted to a positivist-behaviorist approach utilizing quantitative methods. Psychological understanding of a situation attained by means of accurate description, and subjectivity and associated intentionality are presented as part of the phenomenological…

In this study, we investigated a variety of Reader effects that may influence the validity of ratings assigned to AP® English Literature and Composition essays. Specifically, we investigated whether Readers exhibit changes in their levels of severity and accuracy, and their use of individual scale categories over time. We refer to changes in these…

The 7th International Conference on Education Data Mining held on July 4th-7th, 2014, at the Institute of Education, London, UK is the leading international forum for high-quality research that mines large data sets in order to answer educational research questions that shed light on the learning process. These data sets may come from the traces…