Background: On an annual basis, students across Australia in Years 3, 5, 7 and 9 are assessed on their literacy and numeracy skills via the National Assessment Program -- Literacy and Numeracy (NAPLAN), with the student performance data used for purposes including national accountability. Purpose: Against this backdrop of large-scale national…

The purpose of this report is to present our process and results for establishing validity and reliability of an observation tool used to investigate teaching practices that high school mathematics teachers use to engage students. We developed our tool using established practices, such as reviewing literature to develop a framework for instruction…

Schools and policymakers are mandating new anti-bias training for teachers in an attempt to improve racial attitudes. Decades of research have shown that teachers often give racially biased evaluations of student work and that biased evaluations can affect students' future learning and course-taking decisions. However, less is known about what…

With the continuous development of education, personalized learning has attracted great attention. How to evaluate students' learning effects has become increasingly important. In information technology courses, the traditional academic evaluation focuses on the student's learning outcomes, such as "scores" or "right/wrong,"…

This paper compares the speaking scores generated by two online systems that are designed to automatically grade student speech and provide personalized speaking feedback in an EFL context. The first system, "Speech Assessment for Moodle" ("SAM"), is an open-source solution developed by the author that makes use of Google's…

Current writing support tools tend to focus on assessing final or intermediate products, rather than the writing process. However, sensing technologies, such as keystroke logging, can enable provision of automated feedback during, and on aspects of, the writing process. Despite this potential, little is known about the critical indicators that can…

Aim/Purpose: This paper focuses on designing and implementing the rubric for objective JAVA programming assessments. An unsupervised learning approach was used to group learners based on their performance in the results obtained from the rubric, reflecting their learning ability. Background: Students' learning outcomes have been evaluated…

Purpose: The aim of this study was to advance the use of structured, monologic discourse analysis by validating an automated scoring procedure for core lexicon (CoreLex) using transcripts. Method: Forty-nine transcripts from persons with aphasia and 48 transcripts from persons with no brain injury were retrieved from the AphasiaBank database. Five…

The purpose of this study was to analyze the perceptions of academic rigor by teachers and administrators of secondary mathematics classrooms in Maryland, during a crisis. The identified problem is, during COVID-19 pandemic, school district leadership may not have effectively communicated with employees about rigor application expectations. The…

Purpose: Our aim was to evaluate the psychometric properties of the online administered format of the Test of Narrative Language--Second Edition (TNL-2; Gillam & Pearson, 2017), given the importance of assessing children's narrative ability and considerable absence of psychometric studies of spoken language assessments administered online.…

Planning a lesson remains a challenging task for the teachers. The transition from a student into a pre-service teacher and turn out into an effective teacher is a challenging task in the teaching field. We all know the nexus between the significant roles of a lesson plan in an effective teaching-learning process. This study aims to analyze the…

Oral reading fluency (ORF) assessments measure how quickly and accurately students read within one minute. They are widely used at the elementary level; however, due to the typical structure and class sizes in middle schools, such individualized assessments are less feasible and, therefore, less frequently used. Two exploratory studies…

In item response theory (IRT) modeling, the Fisher information matrix is used for numerous inferential procedures such as estimating parameter standard errors, constructing test statistics, and facilitating test scoring. In principal, these procedures may be carried out using either the expected information or the observed information. However, in…

Context: The accuracy of summative assessment scoring and discriminating the level of knowledge in subject matter is critical in fairness to learners in health care professional programs and to ensure stakeholders of competent providers. An evidence-based approach to determine examination quality for the assessment of applied knowledge is…

The Framework for Teaching (FFT) is one of the most widely used observational systems for evaluating teacher effectiveness and driving professional development conversations in schools. This study contrasts reliability and validity evidence relevant to the FFT as traditionally scored with evidence relevant to a composite scoring approach that…