According to the model of constructive alignment, learners adjust their learning strategies to the announced assessment (backwash effect). Hence, when teaching for understanding, the assessment method should be aligned with this teaching goal to ensure that learners engage in corresponding learning strategies. A quasi-experimental field study with…

The research aimed to produce an Android-based learning media with local cultural content in the form of the othok-othok toy ship to improve the competence of diagrammatic and argumentative representation in Physics. 4D methods were used with a control and an experimental class in the first grade of a Senior High School. The learning media…

Automated scoring models were trained and evaluated for the essay task in the "Praxis I"® writing test. Prompt-specific and generic "e-rater"® scoring models were built, and evaluation statistics, such as quadratic weighted kappa, Pearson correlation, and standardized differences in mean scores, were examined to evaluate the…

Students' critical thinking skills are very important in the 21st century. Learning strategies can play a role in enhancing students' critical thinking skills in the Nutrition and Health lecture. The results of a survey in 2013 showed that the implementation of learning strategies had not given students the opportunity to practice their critical…

Automated essay scoring (AES) generally computes essay scores as a function of macrofeatures derived from a set of microfeatures extracted from the text using natural language processing (NLP). In the "e-rater"® automated scoring engine, developed at "Educational Testing Service" (ETS) for the automated scoring of essays, each…

For the last century, the quality of large-scale assessment in the United States has been undermined by narrow educational theory and hindered by limitations in technology. As a result, poor assessment practices have encouraged low-level instructional practices that disparately affect students from the most disadvantaged communities and schools.…

This article describes two separate, related studies that provide insight into the effectiveness of "e-rater" score calibration methods based on different distributional targets. In the first study, we developed and evaluated a new type of "e-rater" scoring model that was cost-effective and applicable under conditions of absent human rating and…

Essay writing is a common type of constructed-response task used frequently in standardized writing assessments. However, the impromptu timed nature of the essay writing tests has drawn increasing criticism for the lack of authenticity for real-world writing in classroom and workplace settings. The goal of this paper is to contribute evidence to a…

Proficiency with written communication (WC) is critical for success in college and careers. As a result, institutions face a growing challenge to accurately evaluate their students' writing skills to obtain data that can support demands of accreditation, accountability, or curricular improvement. Many current standardized measures, however, lack…

This paper reports the findings of a quasi-experiment that aims to investigate the role of metacognitive teaching-learning (MTL) and mathematical prior knowledge (MPK) on students' mathematical logical thinking ability (MLTA) and self-regulated learning (SRL). The subject of the study was 70 tenth-grade students inSumedang, Indonesia. One…

This study examines the effectiveness of an automated translation chatbot used in online interactions which consequently could enhance second/foreign language (L2) competence. Based on the sociocultural perspectives of learning, such as communication to recognize the difference from others and to be involved in sense-making processes, this study…

The Common Core assessments emphasize short essay constructed-response items over multiple-choice items because they are more precise measures of understanding. However, such items are too costly and time consuming to be used in national assessments unless a way to score them automatically can be found. Current automatic essay-scoring techniques…

This case study explores the intricate interaction between students' preferences for written corrective feedback and actual teacher feedback practices in a second year academic EFL writing class in a Japanese university. Specific institutional and instructional details establish the context in which written feedback is being provided. A…

Cultural consensus theory (CCT) is a data aggregation technique with many applications in the social and behavioral sciences. We describe the intuition and theory behind a set of CCT models for continuous type data using maximum likelihood inference methodology. We describe how bias parameters can be incorporated into these models. We introduce…

There is increasing expectation that schools should be able to use tablets for a range of instructional and assessment purposes. This article considers the comparability of student writing on tablets and laptops to ensure that writing assessment is conducted in a way that is fair to all students. Data were collected from a sample of 826 students…