Background: The STEM education system has garnered significant interest due to its innovative approach in creating a multidisciplinary and integrated knowledge structure that connects science, technology, engineering, and mathematics, and allows students to apply scientific knowledge in a comprehensive and holistic manner. Consequently, evaluating…

Nationally recognized social justice standards guide educators in developing social justice education. Absent from the guidance are tools to conduct initial formative assessment or to measure the impact of related instruction. To fill that gap, an academic researcher and 10th-grade teacher used a 3-phased, 9-step process to develop, pilot test,…

Computerized assessments and digital games have become more prevalent in childhood, necessitating a systematic investigation of the effects of gamified executive function assessments on performance and engagement. This study examined the feasibility of incorporating gamification and a machine learning algorithm that adapts task difficulty to…

Motivation is crucial in the pace and success of language learning, and the effect of motivation on language learning has been extensively studied. Many scales have been developed to measure the motivation levels of the students. However, there are a limited number of studies conducted to specifically measure the motivation towards English…

Reliable and valid assessment of parenting and child behaviors is critical for clinicians and researchers alike, and observational measures of parenting behaviors are often considered the gold standard for assessing parenting and parent-child interaction quality. The current study sought to evaluate the reliability and validity of the Coder…

This dissertation comprises three cross-disciplinary essays on information systems, marketing, and financial outcomes research for nonprofit service organizations. In our first essay, we explore service quality impacts on the constructs of positive and negative word of mouth, developing and validating a new measurement scale, testing it…

Background: Health literacy research in school gardening is lacking. Development of a psychometrically sound survey can fill this gap. Purpose: The purpose of this study was twofold: (1) to develop and validate a Functional Health Literacy Survey for School Gardening (FHLS-SG), and (2) to determine the effect of health literacy on reciprocal…

High-stakes examinations enjoy widespread use as summative assessments in higher education. We review the arguments for and against their use, across seven common themes: memory recall and knowledge retention; student motivation and learning; authenticity and real-world relevance; validity and reliability; academic misconduct and contract…

This technical manual provides an overview of the Mosaic™ by ACT®: Social Emotional Learning Screener. The Mosaic by ACT: Social Emotional Learning Screener (hereafter referred to as the Screener) assesses the social emotional skills of students in elementary school (Grades 3-5), middle school (Grades 6-8), and high school (Grades 9-12). Each…

The reaction time-based concealed information test (RT-CIT) has been used to judge the veracity of an examinees claim to be naïve by using RTs to test for recognition of relevant details. Here, we explore the validity of the RT-CIT to generate new knowledge about the incident--the searching CIT. In a mock terrorism study (n = 60) the RT-CIT not…

The authors conducted a preliminary validation of the Feelings Experienced in Supervision Scale (FESS), with findings supporting a single-factor instrument. Relationships between the FESS and attachment patterns, cognitive distortions, and difficulty with corrective feedback are reported. Implications include emotion-focused supervision to…

Validity, reliability, and fairness are three prominent indicators for evaluating the quality of assessment processes. Each of the indicators is most often written about and applied in the context of large-scale assessment. As a result, the technical properties of these indicators make them limited in both their practicality and relevance for…

Grades serve as one of the primary indicators of student learning, directing subsequent actions for students, instructors, and administrators, alike. Therefore, grade validity--that is, the extent to which grades communicate a meaningful and credible representation of what they purport to measure--is of utmost importance. However, a grade cannot…

For many years, scholars have investigated instructional design expertise and described the difficulty defining it. A lack of a clear definition, inclusive of primary components, poses a measurement problem for those seeking to evaluate the development of expertise. An overarching aim of this study is to gather evidence to support a definition of…

A tension raised in recent scholarship is that between numeracy as a social practice and numeracy as a functional skill set. Such frameworks for conceptualizing numeracy pose a challenge to assessment because what individuals do with numeracy is not the same as what individuals can do (or express) in an assessment setting. This study builds on…