In recent ACT mode comparability studies, students testing on laptop or desktop computers earned slightly higher scores on average than students who tested on paper, especially on the ACT® reading and English tests (Li et al., 2017). Equating procedures adjust for such "mode effects" to make ACT scores comparable regardless of testing…

We compared students' performance on a paper-based test (PBT) and three computer-based tests (CBTs). The three computer-based tests used different test navigation and answer selection features, allowing us to examine how these features affect student performance. The study sample consisted of 9,698 fourth through twelfth grade students from across…

In the present study, two types of curriculum-based measurement (CBM) tools in science, Vocabulary Matching (VM) and Statement Verification for Science (SV-S), a modified Sentence Verification Technique, were compared. Specifically, this study aimed to determine whether the format of information presented (i.e., SV-S vs. VM) produces differences…

Measuring student learning is a complicated but necessary task for understanding the effectiveness of instruction and issues of equity in college science, technology, engineering, and mathematics (STEM) courses. Our investigation focused on the implications on claims about student learning that result from choosing between one of two commonly used…

The Kruger-Dunning effect was studied as it related to performance in chemistry courses based on student differences in academic background. Student major was chosen as the classification to look at the effect of students with different interests/specializations. Chemistry majors tended to predict lower performance than biology majors, while…

This study was aimed to examine the relation between the STEM (Science, Technology, Engineering and Mathematics) career interests and science process skills of middle school seventh grade students. Method of this study was the relational survey method. The study was conducted on the basis of voluntariness and participants were 133 seventh grade…

We provide a tutorial on differential item functioning (DIF) analysis, an analytic method useful for identifying potentially biased items in assessments. After explaining a number of methodological approaches, we test for gender bias in two scenarios that demonstrate why DIF analysis is crucial for developing assessments, particularly because…

In a recent study, the 30-question Force Concept Inventory (FCI) was theoretically split into two 14-question "half-length" tests (HFCIs) covering the same set of concepts and producing mean scores that can be equated to those of the original FCI. The HFCIs require less administration time and reduce test-retest issues when different…

In England, there is a growing need to improve the attainment in, and attitudes towards, science among disadvantaged secondary school pupils. This project was designed to support disadvantaged year 11 pupils (age 15-16) by pairing them with an undergraduate STEM student mentor throughout the final year of their compulsory science General…

A flipped-classroom environment generally strives to create more in-class time for activities that enhance student learning, while shifting some content delivery to outside the classroom through the use of short didactic videos. We compared a flipped-classroom setting with the traditional ("control") setting for an accelerated…

The increased emphasis on STEM related careers and the use of science in everyday life makes learning science content and concepts critical for all students especially for those with disabilities. As suggested by the National Resource Council (2012), more emphasis is being placed on being able to critically think about science concepts in and…

Agricultural education can take scientific topics to higher levels, emphasize scientific concepts, involve hands-on learning, and develop interrelationships with the other sciences, thus making the living and non-living world around them relevant for students, potentially supporting a STEM curriculum. As such, in 1996, Utah deemed agricultural…

We present the Electricity and Magnetism Conceptual Assessment (EMCA), a new assessment aligned with second-semester introductory physics courses. Topics covered include electrostatics, electric fields, circuits, magnetism, and induction. We have two motives for writing a new assessment. First, we find other assessments such as the Brief…

This study examined the high schools' state tests performances in mathematics, reading, and science of an open-enrollment STEM-focused charter school system,Harmony Public Schools(HPS), between 2010 and 2013, and compared them with the performance of matched traditional public schools (TPS) in Texas. After propensity score matching, 12 HPS schools…

The overarching purpose of our study was to compare performances of treatment and control condition students who completed a literacy-infused, inquiry-based science intervention through sixth grade as measured by a big idea assessment tool which we refer to as the Big Ideas in Science Assessment (BISA). First, we determine the concurrent validity…