The Student Evaluation of Teaching (SET) instrument provides insight for instructors and administrators alike, often touting high response-rates to endorse their validity and reliability. However, response-rate alone omits consideration for "adequate quantity of 'observational sampling opportunity' (OSO) data points" (e.g., high student…

What is validity? A simple question but apparently one with many answers, as Paul Newton highlights in his review of the history of validity. The current definition of validity, as entertained in the 1999 "Standards for Educational and Psychological Testing" is indeed a consensus, one between the classical notion of attributes, and measures…

This article describes the development and validation of a six-scale survey to assess school climate in terms of students' perceptions of the degree to which they feel welcome and connected, together with a scale to assess students' perceptions of bullying. The development of each survey involved a multi-stage approach, including: 1) an extensive…

A number of cognitive-behavior therapies now strongly emphasize particular behavioral processes as mediators of clinical change specific to that therapy. This shift in emphasis calls for the development of measures sensitive to changes in the therapies' processes. Among these is acceptance and commitment therapy (ACT), which posits valued living…

Hopelessness has become an increasingly important construct in palliative care research, yet concerns exist regarding the utility of existing measures when applied to patients with a terminal illness. This article describes a series of studies focused on the exploration, development, and analysis of a measure of hopelessness specifically intended…

A screening tool (in Chinese) for maladaptive internet use was developed in two stages. Thirty-five factors were first extracted from data obtained from 378 adolescents with a 179-item questionnaire. Nine higher-order factors were then obtained from 35 factors. A 26-item screen that measures both endogenous and exogenous factors was constructed on…

The aim of this paper is to describe a digital game with an educational purpose in the subject of computer programming, which enables students to reinforce and improve their abilities on the concepts of sequencing, defined iteration and nesting. For its design, a problem solving approach was followed and a score comparing mechanism was implemented…

The National Assessment Governing Board adopted a Program of Preparedness Research in March 2009. Several categories of research studies were recommended to produce results for reporting 12th grade preparedness for the 2009 grade 12 National Assessment of Educational Progress (NAEP) in reading and mathematics. The categories included content…

Structured questionnaires and semi-structured interviews are often used in mixed method studies to generate confirmatory results despite differences in methods of data collection, analysis, and interpretation. A review of 19 questionnaire-interview comparison studies found that consensus and consistency statistics were generally weak between…

This article proposes procedures for simultaneously assessing and controlling acquiescence and social desirability in questionnaire items. The procedures are based on a semi-restricted factor-analytic tridimensional model, and can be used with binary, graded-response, or more continuous items. We discuss procedures for fitting the model (item…

This article describes the development, content, and use of four questionnaires that comprise the Assessment of Campus Climate to Enhance Student Success with the focus on the Faculty Questionnaire. Faculty development activities are described as an example of how the questionnaires can be used to enhance knowledge and change attitudes and…

This article discusses the challenging process of developing a common data set for independent living programs serving older adults who are visually impaired. The three-year project, which included collaborative efforts among many stakeholders that encompass diverse program models, resulted in the development of the Internet-based Nationally…

Training professionals to design and produce interactive systems requires the use of well thought-out training scenarios. Indeed, it is essential to consider pedagogical forms whose objective is providing learners with field experience. It is also necessary to motivate learners to learn about subjects that sometimes seem distant from their…

This article describes a 2-session laboratory project in which students develop, conduct, and attempt to validate an interview-based personality assessment. In Session 1, students learn about effective interview procedures and then design and pilot-test an interview to assess 4 personality traits (emotionality, activity level, sociability, and…

Developers of museum service systems want to know what users think about their systems and they often design questionnaires to capture users' opinions. However, there are usually serious gaps between what developers want to know and what the users really think about the system. The present research aims to develop a questionnaire that takes into…