Quality measurement tools such as the Rubric for Online Instruction (ROI) and Quality Matters (QM) have developed guidelines by providing research based educational criteria for planning, creating, and implementing quality online education courses. This dissertation reviews QM program standards and identifies the primary characteristics of…

There has been significant growth in the number of regulations placed on colleges and universities in recent years. This type of growth contributes to the complex environment that exists for colleges and universities. The study focuses on the federal government's consumer information mandate and the release of "The College Scorecard."…

Multiple-choice items are used in large-scale assessments of mathematical achievement for secondary students in many countries. Research findings can be implemented to improve the quality of the items and hence increase the amount of information gathered about student learning from each item. One way to achieve this is to create items for which…

Since researchers investigated automatic scoring systems in writing assessments, they have dealt with relationships between human and machine scoring, and then have suggested evaluation criteria for inter-rater agreement. The main purpose of my study is to investigate the magnitudes of and relationships among indices for inter-rater agreement used…

The Partnership for Assessment of Readiness for College and Careers (PARCC) mathematics items measure critical thinking, mathematical reasoning, and the ability to apply skills and knowledge to real-world problems. Students are asked to solve problems involving the key knowledge and skills for their grade level as identified by the Common Core…

This report stems from the Data Innovation in US Education initiative funded by the Bill & Melinda Gates Foundation. The work was led by the Preva Group, in partnership with IMPAQ and Periscopic. The initiative had three overarching goals: to support the Foundation's efforts to better understand the impact of their education investments; to…

This paper describes the implementation of an inter-rater reliability measure for assessing portfolio scores in a teacher education program. The reliability coefficient for the portfolio scores from completers of a newly revised program were compared with the reliability coefficient of the scores from a second set of reviewers who discussed the…

There is a significant need for kindergarten entry assessments (KEA) that meet state education agency (SEA) requirements and are psychometrically sound measures of a broad range of school readiness domains such as language, literacy, math, science, executive function, and social-emotional skills. Research Findings: In this paper, we describe five…

Demand for second-language (L2) Chinese education for kindergarteners has grown rapidly, but little is known about these kindergarteners' L2 skills, with existing studies focusing on school-age populations and alphabetic languages. Accordingly, we developed a six-subtest Chinese character acquisition assessment to measure L2 kindergarteners'…

Proposing cumulative and integrative processes for an online course development, this paper addresses six core considerations when shifting from a face-to-face to a blended to an online class in three academic semesters. Considerations address real-time face-to-face interaction, lecture structure, instructor presence, learning objectives, course…

Virtual patient cases (VPs) are used for healthcare education and assessment. Most VP systems track user interactions to be used for assessment. Few studies have investigated how virtual exam cases should be scored and graded. We have applied eight different scoring models on a data set from 154 students. Issues studied included the impact of…

A recent review of existing rubrics designed to help researchers evaluate the internal and external validity of single-case design (SCD) studies found that the various options yield consistent results when examining causal arguments. The authors of the review, however, noted considerable differences across the rubrics when addressing the…

This paper responds to the commentary provided by Hitchcock et al. "(Journal of Behavioral Education," 2015) which provides updated information on the procedures for considering the generality of an intervention using the "What Works Clearinghouse" (WWC) single-case guidelines. The new information provided by Hitchcock et al.…

This paper introduces and illustrates Bi-relational Design (BD) as a general approach to (re)solving wicked problems. BD theorises oppositional, equipositional and para-positional approaches to problem-specific dyads (e.g., subjective/objective) based on a general consensus of research on epistemological development. These epistemic positions are…

A new probability-based standard setting technique, the Objective Borderline Method (OBM), was introduced recently. This was based on a mathematical model of how test scores relate to student ability. The present study refined the model and tested it using 2500 simulated data-sets. The OBM was feasible to use. On average, the OBM performed well…