The credibility of conclusions arrived at in quantitative research depends, to a large extent, on the quality of data collection instruments used to quantify language and non-language constructs. Despite this, research into data collection instruments used in Applied Linguistics and particularly in the thesis genre remains limited. This study…

The population relationship between coefficient alpha and scale reliability is studied in the widely used setting of unidimensional multicomponent measuring instruments. It is demonstrated that for any set of component loadings on the common factor, regardless of the extent of their inequality, the discrepancy between alpha and reliability can be…

To examine the reproducibility of three measurement techniques used to determine creatine kinase, interleukin-6 and high-sensitivity C-reactive protein, 50 participants had blood samples taken on two occasions. Fingertip plasma samples were analysed using the Reflotron for CK determination. Venous blood samples collected into serum separator tubes…

The study compared the agreement, internal consistency, and measurement stability of the GE iDXA, BOD POD, and InBody 720. Body composition of 43 men and 37 women (31.4 ± 10.7 years; 90% Caucasian and 10% other) was assessed in triplicate using each method over two different days. Mean percent body fat (% BF) of the participants was different for…

Background and context: The variables that researchers measure and how they measure them are central in any area of research, including computing education. Which research questions can be asked and how they are answered depends on measurement. Objective: To summarize the commonly used variables and measurements in computing education and to…

Insincere respondents can have an adverse impact on the validity of substantive inferences arising from self-administered questionnaires (SAQs). The current study introduces a new method for identifying potentially invalid respondents from their atypical response patterns. The two-step procedure involves generating a response inconsistency (RI)…

Purpose of the Study: Missing data are a common problem encountered while implementing measurement instruments. Yet the extent to which reliability, validity, average discrimination and difficulty of the test results are affected by the missing data has not been studied much. Since it is inevitable that missing data have an impact on the…

This study examined the validity and reliability of a 30-second running sprint test using two non-motorized treadmills compared to the established Wingate Anaerobic Test. Twenty-four participants completed three sessions in a randomized order on a: (1) manual mode treadmill (Woodway); (2) specialized interval training treadmill (HiTrainer); and…

Purpose: An advanced system for the assessment of climbing-specific performance was developed and used to: (a) investigate the effect of arm fixation (AF) on construct validity evidence and reliability of climbing-specific finger-strength measurement; (b) assess reliability of finger-strength and endurance measurements; and (c) evaluate the…

The purpose of this study was to compare the validity and reliability of three short physical activity self-report instruments to determine their potential for use with university student populations. The participants (N = 155; 44.5% male; 22.9 ± 5.13 years) wore an accelerometer for 9 consecutive days and completed a single-item measure, the a…

The literature on Automated Essay Scoring (AES) systems has provided useful validation frameworks for any assessment that includes AES scoring. Furthermore, evidence for the scoring fidelity of AES systems is accumulating. Yet questions remain when appraising the scoring performance of AES systems. These questions include: (a) which essays are…

Purpose: In South Africa, the field of scale development and utilization in social work is referred to as "ecometrics," that is, the measurement of ecological constructs. There is, however, a lack of ecometric tools for social workers, particularly regarding strengths or resilience. Given the high vulnerability of South African youth,…

In the present study, two types of curriculum-based measurement (CBM) tools in science, Vocabulary Matching (VM) and Statement Verification for Science (SV-S), a modified Sentence Verification Technique, were compared. Specifically, this study aimed to determine whether the format of information presented (i.e., SV-S vs. VM) produces differences…

This study aimed to adapt to Turkish the measurement of work-leisure conflict developed by Tsaur et al. (2012) to measure work-leisure conflict and to present the causes and dimensions of the conflict and to develop a new study-leisure conflict scale for university students based on the items of this scale and to undertake reliability and validity…

Existing tests of interrater agreements have high statistical power; however, they lack specificity. If the ratings of the two raters do not show agreement but are not random, the current tests, some of which are based on Cohen's kappa, will often reject the null hypothesis, leading to the wrong conclusion that agreement is present. A new test of…