Experimental psychology is witnessing an increase in research on individual differences, which requires the development of new tasks that can reliably assess variations among participants. To do this, cognitive researchers need statistical methods that many researchers have not learned during their training. The lack of expertise can pose…

In evaluating the learning achievement of programming-thinking skills, the method of using a rubric that describes evaluation items and evaluation stages is widely employed. However, few studies have evaluated the reliability, validity, and consistency of the rubrics themselves. In this study, we introduced a statistical method for evaluating the…

Introduction: The purpose of this paper is to propose a methodology to conceptualize, operationalize, and empirically validate the concept of information need. Method: The proposed methodology makes use of both qualitative and quantitative perspectives, and includes a broad array of approaches such as literature reviews, expert opinions, focus…

Objectives: The purpose of this study was to examine the construct and predictive validity of the Adult-Adolescent Parenting Inventory (AAPI-2). Methods: The validity of the AAPI-2 was evaluated using multiple statistical methods, including exploratory factor analysis, confirmatory factor analysis, and latent class analysis. These analyses were…

Objectives: Many Asian Americans tend to report receiving lower quality services from direct service providers. Improving the cultural competence of social workers and other professionals who work with Asian Americans may address this dissatisfaction. To date, there are few tools to help educators and supervisors evaluate the level of cultural…

This article reports on the updating and validation of a questionnaire for vocabulary learning strategies. An English as a second language (ESL) version of the "Vocabulary Learning Questionnaire" (VLQ), first published in Gu and Johnson (1996), was created based on its latest version. Two response formats were piloted, that is, a paper…

This study reported the development and initial validation of the Survey of Parent/Provider Expectations and Knowledge (SPEAK), a self-administered questionnaire assessing expectations and knowledge about early childhood cognitive and language development. Development of the SPEAK was guided by the theory emphasizing the role of language input…

Background and context: The variables that researchers measure and how they measure them are central in any area of research, including computing education. Which research questions can be asked and how they are answered depends on measurement. Objective: To summarize the commonly used variables and measurements in computing education and to…

This study reports the development and validation process for an instrument to measure university students' anxiety in physics courses. The development of the Physics Anxiety Rating Scale (PARS) included the following steps: Generation of scale items, content validation, construct validation, and reliability calculation. The results of construct…

One of the keystones of scientific disciplines is the production and dissemination of quality, valid research. Within the Journal of Agricultural Education, traditions passed down from mentor to mentee have led to the establishment of magic words and symbols that, while used to meet criteria for acceptance for publication, actually obscure and…

Insincere respondents can have an adverse impact on the validity of substantive inferences arising from self-administered questionnaires (SAQs). The current study introduces a new method for identifying potentially invalid respondents from their atypical response patterns. The two-step procedure involves generating a response inconsistency (RI)…

This report presents a review of the statistical practices of 30 journals representative of the second language field. A review of 150 articles showed a number of prevalent statistical violations including incomplete reporting of reliability, validity, non-significant results, effect sizes, and assumption checks as well as making inferences from…

The purpose of this study is developing a valid and reliable scale intended to determine the irrational beliefs of students in mathematics. The study was conducted with a study group consisting of 700 students in 2015-2016 academic year. Expert opinions were received for the content and face validity of the scale, and the Exploratory Factor…

This research study aims to evaluate the graduate theses and articles conducted on the concept of instructional leadership over the period between 2002 and 2017 in Turkey by means of methodological and statistical analysis techniques. In the study, which is configured by using the case study design as one of the qualitative research methods, the…

Purpose: Our purpose was to explore the validity and reliability of the German Focus on the Outcomes of Communication Under Six (FOCUS-G; Thomas-Stonell, Oddson, Robertson, & Rosenbaum, 2010, 2012), which is an authorized adaptation of the Focus on the Outcomes of Communication Under Six (Thomas-Stonell et al., 2010) tool, which measures…