Feedback on how students progress through completing subgoals can improve students' learning and motivation in programming. Detecting subgoal completion is a challenging task, and most learning environments do so either with "expert-authored" models or with "data-driven" models. Both models have advantages that are…

Low- and middle-income countries have made significant progress getting children into school, but student learning and achievement are often dreadfully low (Berry, Barnett, & Hinton, 2015; Pritchett, 2013). Approximately 250 million children across the world are not acquiring basic reading and math skills, even though about half have spent at…

As scientific models of student thinking, learning progressions (LPs) have been evaluated in terms of one important, but limited, criterion: fit to empirical data. We argue that LPs are not empirically adequate, largely because they rely on problematic assumptions of theory-like coherence in students' thinking. Through an empirical investigation…

The Every Student Succeeds Act grants states new flexibility to create more balanced assessment systems with a greater role for formative assessment. Drawing on lessons learned over three decades of research and reform, we argue that state and local leaders should take the lead in designing new assessments guided by two core principles: First,…

Many changes in teaching practices (such as introduction of e-assessment) are initiated by school management, or by a lead teacher, but have direct impact on the learning designs of others. However, models of teachers as innovators, conducting evidence-based inquiry into their students' learning, view the teacher as initiator of change in their…

In an effort to bring rigorous research into the education and social sciences field, the past decade had seen an increase in the advocacy of randomized controlled trials. The argument in favor of using randomized controlled trial is that one can evaluate the impact of an intervention in comparison to a control group with confidence during a…

Minnesota Statutes 122A.40, Subdivision 8 and 122A.41, Subdivision 5, require that all districts evaluate teachers beginning in the 2014-2015 school year. In response to the statutes, the Minnesota Department of Education (MDE) convened a work group in early winter 2011 to consult with the MDE Commissioner to develop a state model for teacher…

The National Science Foundation's (NSF) National Science Digital Library/Distributed Learning (NSDL) program turned 10 years old in 2010. This report presents results of a preliminary program evaluation carried out by RAND and is organized around three principal goals: (1) Provide an initial evaluation of NSDL based on existing information…

Students should have exposure to social justice education (SJE) through the content-based curriculum or through cocurricular learning opportunities. This program evaluation study used qualitative data collection and analysis procedures to determine how to best improve the cocurricular SJE program, Lead for Diversity (LFD), which is used in high…

The Hint Factory is an implementation of our novel method to automatically generate hints using past student data for a logic tutor. One disadvantage of the Hint Factory is the time needed to gather enough data on new problems in order to provide hints. In this paper we describe the use of expert sample solutions to "seed" the hint generation…

This report presents the results of the formative evaluation of the Adult Learning, Literacy and Essential Skills Program (ALLESP). Data collection related to this evaluation took place between November 2008 and May 2009. The evaluation resulted in the following four recommendations: (1) It is recommended that Program objectives and activities…

Various Web 2.0 technologies can be used to support pedagogy. Examples include wikis, blogs, and social media including forum discussions. Online class forum discussions involving electronic text can result in robust strings of data containing meta-knowledge, inherent meaning, themes and patterns. Based on instructional design, learning outcomes…

Presents a model for instructional design that highlights formative evaluation as the central process. Other models of instructional design are discussed; data collection methods are examined; the evaluator's role is considered; and the recursive nature of the design process is emphasized. (seven references) (LRW)

Once programs or projects have been planned (in terms of personnel, activities, and expected outcomes), it becomes most important to develop a method of collecting information relative to the implementation of the programs or projects. This process of determining if what is planned as a program or project is actually implemented is known as…

This chapter discusses current methods of formative evaluation and suggests that these methods themselves need to be subjected to more critical research and evaluation in order to provide them with a more scientific base. Topics addressed include problems and methods associated with data gathering, evaluation designs, number of subjects available,…