In this paper, I extend the concept of observer effect into the realm of country-level secondary data analysis. When analyzing what appear to be the same secondary data using the same methods, macro-comparative researchers arrive at different results. I argue that this is a product of idiosyncratic variation directly or indirectly produced by the…

A small-scale action research project was used to consider the policy and rhetoric surrounding development of the "expert learner" and how this might be further explored to provide opportunities for learners to have greater direct involvement in reflection and discussion with teachers. The research was based within a further education…

The authors outline the application of latent class analysis (LCA) to classroom observational instruments. LCA offers diagnostic information about teachers' instructional strengths and weaknesses, along with estimates of measurement error for individual teachers, while remaining relatively straightforward to implement and interpret. It is…

The purpose of this study was to investigate the learning that takes place when people with disabilities interact in a rehabilitation context. Data were generated through in-depth interviews and close observations in a 2 one-half week-long rehabilitation program, where the participants learned both wheelchair skills and adapted physical…

Describes a naturalistic paradigm and discusses the value of using a naturalistic, or qualitative, approach to study the effectiveness of computer-based instruction (CBI) and to design effective courseware. Topics discussed include data collection; data analysis; and findings of naturalistic studies of CBI effectiveness. (53 references) (LRW)

Explores problems involved in the quantitative verification of independent variables in investigations of the effects on student outcomes of planned variations in instructional behavior. Specifically addresses (1) gathering of data through direct systematic observation, and (2) analysis of those data through the use of inferential statistics. (GC)

The theoretical perspective and naturalistic methods of ecological psychology developed by Roger Barker are described. Ecological assessment implies examining (1) naturally occurring behavior; (2) environment immediately surrounding behavior; and (3) the individual-environment link. The specimen record, chronolog, and behavior-setting survey are…

This introduction to second language program evaluation begins with a rationale outlining the major issues involved in program evaluation. Procedures for evaluation are described, and examples are offered of goal statements, sub-goal statements, curriculum objectives, and learning objectives. Guidelines for judging a statement of aims are listed.…

Validity is a central issue in use of self-report data for the investigation of teacher thinking. "Triangulation," or use of several data sets to test, corroborate and elaborate each other, is one method for increasing validity of findings. This paper illustrates a process of triangulation of data obtained by three different data…