Evidence from a handful of large-scale studies suggests that although observers can be trained to score reliably using observation protocols, there are concerns related to initial training and calibration activities designed to keep observers scoring accurately over time (e.g., Bell, et al, 2012; BMGF, 2012). Studies offer little insight into how…

Designers-by-assignment, or subject matter experts (SMEs) who are pressed into training service, have become common in the workplace. A review of more than 24 studies on expert and novice instructional designers, however, revealed that little is known about how designers-by-assignment think about design and make design decisions in the field. A…