The benefits of peer evaluation of teaching effectiveness and quality in higher education are well documented. While instruments exist for the review and evaluation of entire online courses, there is no standardized single-lesson, peer evaluation instrument available for online instruction. This pilot study focused on the validation of a peer…

Learner satisfaction is an important element in online learning because it impacts achievement motivation, success, and retention. It was the purpose of this study to develop an instrument that measures the satisfaction of learners in online learning environments. Data were collected from 335 students at higher education institutions. The Online…

Researchers tout digital learning as a tool that can increase the authenticity of student learning and assessment tasks but lack a psychometrically valid instrument to test this hypothesis. Further, there are several complementary definitions of authentic work, versus a single agreed upon definition, presented in academic literature. I synthesized…

Computational thinking (CT) has permeated primary and early childhood education in recent years. Despite the extensive effort in CT learning initiatives, few age-appropriate assessment tools targeting young children have been developed. In this study, we proposed Computational Thinking Test for Lower Primary (CTtLP), which was designed for lower…

The current study aimed to measure preservice teachers' skills in implementing pedagogical model of collaborative problem solving (CPS) using a more advanced and novel human-to-agent computerized assessment instrument. By doing so, a framework with three major skills in the implementation of CPS and four major individual problem-solving processes…

In this paper, we present the development and validation of a new measure of attitudinal learning--the Attitudinal Learning Inventory (ALI). While specific scales are available for measuring attitudes, they largely focus on established attitudes, not the impact of instruction on those attitudes. We developed the inventory with two explicit…

The purpose of this study is to develop a standardized measurement tool that can be used to determine the participation styles of individuals participating in online instructional discussions. The scale consists of two dimensions called 'Why' and 'How.' The Why dimension comprises the main motivators of the participants' participation in online…

This paper describes an effort to develop a survey instrument capable of measuring important aspects of adolescents' experiences of interest-related pursuits that are supported by technology. The measure focuses on youths' experiences of "connected learning" (Ito et al. in Connected learning: an agenda for research and design. Digital…

Even as digital devices (e.g., tablets, smart phones, laptops) have become increasingly ubiquitous in schools, concerns have also been raised that such devices might hinder students' social, emotional, and personal development. Educators' perspectives on such matters could shape the success or failure of 1:1 technology initiatives. Thus, there is…

The purpose of this study was to develop and validate a content analysis model for assessing students' cognitive learning in asynchronous online discussions. It adopted a fully mixed methods design, in which qualitative and quantitative methods were employed sequentially for data analysis and interpretation. Specifically, the design was a…

The purpose of this study was to identify and validate items applicable to evaluating online courses at the postsecondary level. Items were derived from a review of the literature. Four judges rated the similarity of the items by making pair-wise comparisons utilizing multidimensional scaling (MDS). The study consisted of five stages. Stage I…