This study presents a novel approach contributing to our understanding of the design, development, and implementation AI-based systems for conducting double-blind online randomized controlled trials (RCTs) for higher education research. The process of the entire interaction with the participants (n = 1193) and their allocation to test and control…

This dissertation consists of three manuscripts. The manuscripts contribute to a budding "methodological reform" currently taking place in quantitative second-language (L2) research. In the first manuscript, the researcher describes an empirical investigation on the application of two well-known effect size estimators, eta-squared (eta…

Research has shown that plagiarism is on the increase in higher education. Some state that this is due to poor knowledge rather than intentional cheating. Other researchers explain that plagiarism is on the rise due to increased competitiveness in college and easy access to work that has already been completed. In this study, we show how a 2-hr…

We present three strategies to replace the null hypothesis statistical significance testing approach in psychological research: (1) visual representation of cognitive processes and predictions, (2) visual representation of data distributions and choice of the appropriate distribution for analysis, and (3) model comparison. The three strategies…

Previous research suggests that undergraduate research methods students doubt the utility of course content and experience math and research anxiety. Research also suggests involving students in hands-on, applied research activities, although empirical data on the scope and nature of these activities are lacking. This study compared academic…

We tested the effectiveness of a course-long intervention in an undergraduate Research Methods course aimed toward reducing students' endorsement of hostile sexism (HS) and benevolent sexism (BS). Reading assignments illustrating diverse research methodologies, lecture examples, and a hands-on research project designed by student teams focused on…

This study investigated demographic characteristics such as type of university attended, course of study and gender as determinants of duration of unemployment among university graduates in Nigeria. Data were collected from 1 451 employed university graduates in 300 firms in Nigeria. Results showed a significant difference between duration of…

The Programme for International Student Assessment (PISA) is an important cross-national study of 15-year-olds' academic knowledge and skills. Educationalists and public policymakers eagerly await the tri-annual results, with particular interest in whether their country has moved up or slid down the international rankings, as compared to earlier…

Although International Association for the Evaluation of Educational Achievement-pioneered international large-scale assessment (ILSA) of education is now a well-established science, non-practitioners and many users often substantially misunderstand how large-scale assessments are conducted, what questions and challenges they are designed to…

The current investigation tested the effectiveness of an online student research project designed to supplement traditional methods (e.g., lectures, discussions, and assigned readings) of teaching research methods in a large-enrollment Introduction to Psychology course. Over the course of the semester, students completed seven assignments, each…

The present paper aims to discuss how data from international large-scale assessments (ILSAs) can be utilized and combined, even with other existing data sources, in order to monitor educational outcomes and study the effectiveness of educational systems. We consider different purposes of linking data, namely, extending outcomes measures,…

Previous research demonstrates that psychology courses have the potential to reduce students' biases (e.g., biases against women). In the current research, we hypothesized that taking a seminar-style course on the self (as compared to a research methods course) could reduce students' typically biased views of the self (i.e., unrealistically…

We used a false-biofeedback methodology to manipulate physiological arousal in order to induce affective states that would influence learners' metacognitive judgments and learning performance. False-biofeedback is a method used to induce physiological arousal (and resultant affective states) by presenting learners with audio stimuli of false heart…

The purpose of this study was to evaluate the effectiveness of group testing as a pedagogical technique to enhance learning in a difficult subject such as statistics. Individual test scores were compared to their group test scores for the same, identical test. A t test was used to compare the scores for 157 randomly selected MBA students enrolled…

The purpose of this document is to describe the methods RAND used to analyze achievement for 23 personalized learning (PL) schools for the 2012-13 through 2013-14 academic years. This work was performed at the request of the Bill & Melinda Gates Foundation (BMGF), as part of a multi-year evaluation contract. The 23 schools were selected from a…