The number of real-world laboratories (RwLs) as research settings to address sustainability problems by using collaborative and experimental approaches has been growing steadily over the past years. RwLs are widely considered promising settings for the production of action-orientated knowledge in order to contribute solving wicked real-world…

The laboratory is an integral component of engineering education, resulting in a multitude of studies. Generally, the research focus is on the laboratory innovation, rather than learning itself. It is observed that empirical evidence is strongly built around student perceptions of their learning or experience via survey instruments; and in some…

This article discusses the nonuse, misuse, and proper use of pilot studies in experimental evaluation research. The authors first show that there is little theoretical, practical, or empirical guidance available to researchers who seek to incorporate pilot studies into experimental evaluation research designs. The authors then discuss how pilot…

Reporting standards and critical appraisal tools serve as beacons for researchers, reviewers, and research consumers. Parallel to existing guidelines for researchers to report and evaluate group-comparison studies, single-case experimental (SCE) researchers are in need of guidelines for reporting and evaluating SCE studies. A systematic search was…

The worked example effect within cognitive load theory is a very well-established finding. The concrete effectiveness of worked examples in a learning situation, however, heavily depends on further moderating factors. For example, if learners improve their processing of worked examples by actively explaining the worked examples to themselves, they…

Six articles about evaluating information retrieval (IR) systems and methods are briefly described in this introduction to a special issue and some of the major problems that are encountered in evaluating interactive information retrieval are considered. (two references) (LAE)

Various methods for calculating and presenting results of information retrieval (IR) evaluation research are discussed, with illustrations from recent laboratory results. Highlights include measures for calculating recall and precision, user needs for high or low level of recall, and comparisons of Boolean and ranked output retrieval. (22…

These guidelines are intended to help those who design and conduct investigations of psychopharmacologic agents in children. A progression of studies in four phases is advocated. First, early short term studies should establish single and multiple dose safety baselines. Second, early pilot efficacy studies may be initiated jointly with longer…

The increasing complexity of evaluating information retrieval (IR) systems is discussed in terms of contributing factors and research methods. Examples are provided from experiments with weighted searching on a front-end system, information-seeking behavior and online catalogs, and the OKAPI experimental retrieval system. (21 references) (LAE)

This review focuses on distance education research in Norway, although studies in Finland, Denmark, and Sweden are briefly mentioned. Examples are given of distance education projects from the 1970s to the present. Research in distance education has a more continuous tradition in Norway than in the other Scandinavian countries, and evaluation…