Speech remediation by identifying those segments which compromise the quality of speech content can be performed by correctly identifying portions of a recording which can be deleted without diminishing from the overall quality of the speech, but rather improving it. Speech remediation is especially important when it is heavily disfluent as in the…

Since researchers investigated automatic scoring systems in writing assessments, they have dealt with relationships between human and machine scoring, and then have suggested evaluation criteria for inter-rater agreement. The main purpose of my study is to investigate the magnitudes of and relationships among indices for inter-rater agreement used…

Recent research has provided evidence that the information provided before a story--a spoiler--may increase the enjoyment of that story, perhaps by increasing the processing fluency experienced during reading. In one experiment, we tested the reliability of these findings by closely replicating existing methods and the generality of these findings…

This study aimed to develop, validate, and trial a rubric for evaluating the cloud-based learning designs (CBLD) that were developed by teachers using virtual learning environments. The rubric was developed using the technological pedagogical content knowledge (TPACK) framework, with rubric development including content and expert validation of…

The purpose of this article is to introduce and review the capability and performance of the Stata item response theory (IRT) package that is available from Stata v.14, 2015. Using a simulated data set and a publicly available item response data set extracted from Programme of International Student Assessment, we review the IRT package from…

Two professors co-taught critical and civic thinking in the same first-semester course for four years. For the first year, they used computerized argument mapping and critical-thinking-for-civic-thinking (CT)[superscript 2] exercises based on open-ended scenarios framed within a civic context. The instructors assessed student skill levels using…

Research in the study of students' writing concludes that vocabulary use is a key variable in determining the holistic quality of the writing. In the present study, 77 writing samples from a mixed group of Grade 3 children were analyzed for features of linguistic diversity using public domain vocabulary-profiling software. The writing was also…

In this research, we investigated the feasibility of implementing the "e-rater"® scoring engine as a check score in place of all-human scoring for the "Graduate Record Examinations"® ("GRE"®) revised General Test (rGRE) Analytical Writing measure. This report provides the scientific basis for the use of e-rater as a…

The opportunity to give oral presentations is important because it helps develop skills that are necessary for many aspects of professional careers. Competencies for oral presentations include appropriate content, design and organization of the presentation, and delivery skills. Self-assessment has been shown to help students develop…

The ultimate aim of our research project was to use the Google Web Speech API to automate scoring of elicited imitation (EI) tests. However, in order to achieve this goal, we had to take a number of preparatory steps. We needed to assess how accurate this speech recognition tool is in recognizing native speakers' production of the test items; we…

Students' writing can provide better insight into their thinking than can multiple-choice questions. However, resource constraints often prevent faculty from using writing assessments in large undergraduate science courses. We investigated the use of computer software to analyze student writing and to uncover student ideas about chemistry in an…

Scoring models for the "e-rater"® system were built and evaluated for the "TOEFL"® exam's independent and integrated writing prompts. Prompt-specific and generic scoring models were built, and evaluation statistics, such as weighted kappas, Pearson correlations, standardized differences in mean scores, and correlations with…

The researchers in this study undertook development of a webquest evaluation rubric and investigated its reliability. The rubric was created using the strengths of the currently available webquest rubrics with improvements based on the comments provided in the literature and feedback received from educators. After the rubric was created, 23…

Three decision consistency and accuracy (DC/DA) methods, the Livingston and Lewis (LL) method, LEE method, and the Hambleton and Han (HH) method, were evaluated. The purposes of the study were: (1) to evaluate the accuracy and robustness of these methods, especially when their assumptions were not well satisfied, (2) to investigate the "true"…

The error-correction program "Criterion" provides students with an immediate essay feedback using tools that can analyze and review writing automatically. This feedback covers grammar, usage, mechanics, style, organization, and development. With its diagnostic tools for scoring essays and offering relevant feedback, the error-correction…