Assessment instruments composed of two-tier multiple choice (TTMC) items are widely used in science education as an effective method to evaluate students' sophisticated understanding. In practice, however, there are often concerns regarding the common scoring methods of TTMC items, which include pair scoring and individual scoring schemes. The…

The present study hypothesized that requiring use of an integrated learning system (ILS) would yield a learning benefit in a classroom situation. Two sections of an introductory psychology course taught by the same instructor and using the same text and exams differed with respect to whether online quizzing and concept mastery exercises in an ILS…

This paper addresses the understanding of technological tools' influences on formative assessment in classrooms. From an extensive literature review we outline what is known about the role technology is playing in assisting teachers' assessment practice and how this is being done in primary and secondary school settings. A literature search…

The continuous measurement of learning behavior or learning outcome by appropriate sensors is fundamental for the implementation of technology-based adaptive learning courses. An adaptive system needs such learning data to adapt the instruction to the needs of students. Depending on the learning objective, the sensors use information generated…

In 2018, state boards of education discussed and adopted policies to increase accountability for student data protection and to increase transparency of schoolwide data through data dashboards. This analysis highlights policy changes in state data protection requirements, test administration and security, records retention, and confidentiality…

This dissertation consists of three manuscripts. The manuscripts contribute to a budding "methodological reform" currently taking place in quantitative second-language (L2) research. In the first manuscript, the researcher describes an empirical investigation on the application of two well-known effect size estimators, eta-squared (eta…

In the e-learning context, social network analysis (SNA) can be used to build understanding around the ways students participate and interact in online forums. This study contributes to the growing body of research that uses statistical methods to test hypotheses about structures in social networks. Specifically, we show how statistical analysis…

Empirically supported multimedia learning (MML) principles [1] suggest effective ways to design instruction, generally for elements on the order of a graphic or an activity. We examined whether the positive impact of MML could be detected in larger instructional units from a MOOC. We coded instructional design (ID) features corresponding to MML…

Purpose: The purpose of this paper is to explore teachers' noncompliance with secondary-level standardised literacy testing in Tasmania, Australia, particularly their motivations, behaviours and justifications. This paper challenges pervasive views regarding test noncompliance, suggesting a reframing as "advocacy cheating": noncompliance…

The current studies test the hypothesis that the financial burden of college can initiate a psychological process that has a negative influence on academic performance for students at selective colleges and universities. Prior studies linking high college costs and student loans to academic outcomes have not been grounded within relevant social…

The current studies test the hypothesis that the financial burden of college can initiate a psychological process that has a negative influence on academic performance for students at selective colleges and universities. Prior studies linking high college costs and student loans to academic outcomes have not been grounded within relevant social…

Continuously administered examination programs, particularly credentialing programs that require graduation from educational programs, often experience seasonality where distributions of examine ability may differ over time. Such seasonality may affect the quality of important statistical processes, such as item response theory (IRT) item…

The equating of tests is an essential process in high-stakes, large-scale testing conducted over multiple forms or administrations. By adjusting for differences in difficulty and placing scores from different administrations of a test on a common scale, equating allows scores from these different forms and administrations to be directly compared…

Examinees' thinking processes have become an increasingly important concern in testing. The responses processes aspect is a major component of validity, and contemporary tests increasingly involve specifications about the cognitive complexity of examinees' response processes. Yet, empirical research findings on examinees' cognitive processes are…

Extracting information efficiently from game/simulation-based assessment (G/SBA) logs requires two things: a well-structured log file and a set of analysis methods. In this report, we propose a generic data model specified as an extensible markup language (XML) schema for the log files of G/SBAs. We also propose a set of analysis methods for…