This meta-analysis examined the validity of an alternative to traditional assessments called the Wonderlic which is a brief measure of general mental ability. Our results showed significant, positive correlations between Wonderlic scores and academic performance in general ([r-bar] = 0.26), between Wonderlic scores and undergraduate GPA in…

We compared the influence of open-book extended duration versus closed book time-limited format on reliability and validity of written assessments of pharmacology learning outcomes within our medical and dental courses. Our dental cohort undertake a mid-year test (30xfree-response short answer to a question, SAQ) and end-of-year paper (4xSAQ,…

Metacognition is defined as a higher-order thinking skill that enables individuals to monitor, control, and regulate their thinking and behavior. In education, this skill is important, as learners need to self-regulate their learning behaviors for successful lifelong learning. Thus, it is essential for educators and learners alike to know their…

The present study examined the convergent validity between two frequently used achievement goal instruments: Patterns of Adaptive Learning Scales (PALS) and the Achievement Goal Questionnaire 3 x 2 (AGQ 3 x 2). Confirmatory factor analysis and structural equation models tested for relationships both within and across the scales in a sample of…

The current study aims to explore the impact of the two-column format in writing simple mathematical arguments. That is to say, a structured method of presenting a mathematical proof or argument by using a tabular layout with two columns. The underlying goal of the research reported in this paper is to inform understanding of how to effectively…

Testing English writing skills could be multi-dimensional; thus, the study aimed to compare students' writing scores calculated according to Classical Test Theory (CTT) and Multi-Facet Rasch Model (MFRM). The research was carried out in 2019 with 100 university students studying at a foreign language preparatory class and four experienced…

Using an established global academic interest scale, academic interest dimensions of undergraduate (n = 326) and graduate (n = 401) students were compared. The four-factor structure, consisting of passion for learning, confidence in the future, career aspiration, and self-expression, held for both student groups. However, the item scores and mean…

Biology instructors use concept assessments in their courses to gauge student understanding of important disciplinary ideas. Instructors can choose to administer concept assessments based on participation (i.e., lower stakes) or the correctness of responses (i.e., higher stakes), and students can complete the assessment in an in-class or…

Purpose: This paper explores how sustainability consciousness varies among undergraduate students at a higher education institution in the Republic of Korea. Based on the analyses of survey data, this paper aims to understand the present state and future prospect of education for sustainable development, specifically within higher education in the…

With the advent of new technologies, assessment research has adopted technology-based methods to investigate test validity. This study investigated the neurocognitive processes involved in an academic listening comprehension test, using a biometric technique called functional near-infrared spectroscopy (fNIRS). Sixteen right-handed university…

Software security is inevitably dependent on developers' ability to to design and implement software without security bugs. Perhaps unsurprisingly, developers often fail to do this. Our goal is to understand this from a usability perspective, identifying how we might best train developers and equip them with the right software tools. To this end,…

This study outlines the development of the Design Log Instrument (DLI), which is intended for use in identifying moments of abstraction as evidence of STEM content knowledge transfer. The DLI prompts participants to be reflective during technological/engineering design challenges. During the development of this instrument, a three-phase,…

Since research integrity is not external to research but an integral part of it, it should be integrated into research training. However, several hindrances regarding contemporary research integrity education exist. To address them, we have developed a competency profile for teaching and learning research integrity based on four assumptions: 1) to…

Aptitude tests are widely used in selection. However, despite certain advantages their use remains controversial. This paper aims to critically appraise five sources of evidence for the construct validity of the Health Professions Admission Test (HPAT)-Ireland, an aptitude test used for selecting undergraduate medical students. The objectives are…

This study reports quantitative evaluation of changes in students' study approaches during the first semester of organic chemistry. Students were surveyed by a modified M-ASSIST (OCH-adjusted M-ASSIST) instrument adjusted to the specific student population. The validity of the data-model fit was assessed by confirmatory factor analysis. Students…