This special issue's editors invited discussion of three broad questions. Slightly rephrased, they are: How well do self-report data represent theoretical constructs? How should analyses of data be conditioned by properties of self report data? In what ways do interpretations of self-report data shape interpretations of a study's findings? To…

For decades, self-report instruments -- which rely heavily on students' perceptions and beliefs -- have been the dominant way of measuring motivation and strategy use. Event-based measures based on online trace data arguably has the potential to remove analytical restrictions of self-report measures. The purpose of this study is therefore to…

Central to the mission of most educational institutions is the task of preparing the next generation of citizens to contribute to society. Schools, colleges, and universities value a range of outcomes--e.g., problem solving, creativity, collaboration, citizenship, service to community--as well as academic outcomes in traditional subjects. Often…

The field of education technology is embracing a use of learning analytics to improve student experiences of learning. Along with exponential growth in this area is an increasing concern of the interpretability of the analytics from the student experience and what they can tell us about learning. This study offers a way to address some of the…

Comprehension assessment is an essential tool in classroom learning. However, the judgment often relies on experience of an instructor who makes observation of students' behavior during the lessons. We argue that students should report their own comprehension explicitly in a classroom. With students' comprehension made available at the slide…

Although skill shortages are often portrayed as a significant problem for the Australian economy, there is surprisingly little evidence about their prevalence, causes and consequences. It is difficult to find robust evidence about where skill shortages occur, why they occur, what businesses try to do about them and whether their responses are…

This study aims to construct ranking indicators from the perspective inside of the university and shift the ranking target from overall university quality to undergraduate education quality. In dealing with the complexity of the concept of undergraduate education quality, two-stage questionnaire survey was conducted to gain comprehensive opinions…

Purpose: This paper proposes a benefit of the doubt (BoD) approach to construct and analyse teacher effectiveness scores (i.e. SET scores). Design/methodology/approach: The BoD approach is related to data envelopment analysis (DEA), a linear programming tool for evaluating the relative efficiency performance of a set of similar units (e.g. firms,…

Most institutional research (IR) practitioners lack access to direct measures of longitudinal student learning, let alone assessment instruments systematically embedded into the curriculum that yield representative cognitive gain data controlling for student motivation. Typically, measures of student learning growth rest on findings from survey…

Ecological momentary assessment (EMA) is particularly suitable for studying substance use, because use is episodic and thought to be related to mood and context. This article reviews EMA methods in substance use research, focusing on tobacco and alcohol use and relapse, where EMA has been most applied. Common EMA designs combine event-based…

By using the Rasch model, much detailed diagnostic information is available to developers of survey and assessment instruments and to the researchers who use them. We outline an approach to the analysis of data obtained from the administration of survey instruments that can enable researchers to recognise and diagnose difficulties with those…

Techniques for estimating the labor supply in any locality from a town and its surrounding rural area to a county or multi-county area are presented. The labor supply in a community can be estimated by many means, including registrations of the unemployed, newspaper advertisements, and a census-type sampling survey of the population.…

Error profiles for the Fall Enrollment Survey of the Higher Education General Information Survey (HEGIS) were developed as part of an assessment of the quality of survey data. Three statistics were of particular interest: the count of full-time equivalent students, the breakdown by race/ethnicity, and the count of unclassified students. Attention…

Reports on results of a Swiss project designed to provide descriptions of language competence at various cross-over points at which Swiss learners change from one educational sector to another in order to create a coherent information system for course planning, coordination of certification, self-assessment, and reporting achievement. (72…