Artificial intelligence-enabled adaptive learning systems (AI-ALS) are increasingly being deployed in education to enhance the learning needs of students. However, educational stakeholders are required by policy-makers to conduct an independent evaluation of the AI-ALS using a small sample size in a pilot study, before that AI-ALS can be approved…

Environmental science is a broad, interdisciplinary field integrating aspects of biology, chemistry, earth science, geology, and social sciences. Mastery of basic science concepts and reasoning are therefore necessary for students to understand the interactions of different components in an environmental system. How do teachers identify and assess…

This technical brief describes the easyCBM® Spanish language Vocabulary assessments added to the easyCBM® system in the fall of 2018 and provides the initial norms for the fall and winter assessments. These norms should be interpreted with caution, as the sample was smaller than ideal, particularly for the Winter norms.

Precision is a key facet of test development, with score reliability determined primarily according to the types of error one wants to approximate and demonstrate. This article identifies and discusses several primary forms of reliability estimation: internal consistency (i.e., split-half, KR-20, a), test-retest, alternate forms, interscorer, and…

This paper describes an instrument designed for assessing learning outcomes in data management. In addition to assessment of student learning and ABET outcomes, we have also found the instrument to be effective for determining database placement of incoming information systems (IS) graduate students. Each of these three uses is discussed in this…

"Sustainable" development refers to development that meets our needs, while making it possible for future generations to meet their needs. Societal and personal choices will dictate if sustainable development will be possible, or, rather, if the environmental, economic and social impact of our continual lifestyle demands will lead to…

The authors propose a method to compare the influence of a treatment on different properties within subjects. The properties are measured by several Likert-type-scaled items. The results show that many existing approaches, such as repeated measurement analysis of variance on sum and mean scores, a linear partial credit model, and a graded response…

Medical residents do not receive adequate training in screening, brief intervention, and referral to treatment (SBIRT) for alcohol and other drug use disorders. The federally funded Pennsylvania SBIRT Medical and Residency Training program (SMaRT) is an evidence-based curriculum with goals of training residents in SBIRT knowledge and skills and…

This report summarizes the complex research literature on quantitative methods for assessing how impacts of educational interventions on instructional practices and student learning differ across students, educators, and schools. It also provides technical guidance about the use and interpretation of these methods. The research topics addressed…

The normalized gain, "g", has been an important tool for the characterization of conceptual improvement in physics courses since its use in Hake's extensive study on conceptual learning in introductory physics. The normalized gain is calculated from the score on a pre-test administered before instruction and a post-test administered…

Perhaps the greatest value of response to intervention (RTI) as a decision framework is that it brings attention to variables (e.g., mastery of prerequisite skills, frequency of instructional corrective feedback, reinforcement schedules for correct responding) that if changed might make a meaningful difference for students (e.g., child rate of…

This paper introduces a variation on the post-test only cohort control design and addresses questions concerning both the methodological credibility and the practical utility of employing this design variation in evaluations of large-scale complex professional development programmes in mathematics education. The original design and design…

This article describes a project where students in a low-performing suburban school learned about profit and area by forming their own companies and creating bids to re-surface of their school's floors. They learned by measuring floor area, calculating costs, performing cost analysis, determining desired profit, making a payment schedule and…

The laboratory component of undergraduate engineering education poses challenges in resource constrained engineering faculties. The cost, time, space and physical presence requirements of the traditional (real) laboratory approach are the contributory factors. These resource constraints may mitigate the acquisition of meaningful laboratory…

Included here are two appendixes to "Adult Education Literacy Instruction: A Review of the Research." Appendix A, "Adult Studies," contains: (1) Assessment Profiles; (2) Alphabetics; (3) Fluency; (4) Vocabulary; and (5) Comprehension. Appendix B, "Adolescent Studies," contains: (1) Alphabetics; (2) Fluency; (3) Vocabulary; and (4) Comprehension.…