Trend scoring constructed response items (i.e. rescoring Time A responses at Time B) gives rise to two-way data that follow a product multinomial distribution rather than the multinomial distribution that is usually assumed. Recent work has shown that the difference in sampling model can have profound negative effects on statistics usually used to…

Increasingly, the broader public, media and policymakers are looking to qualitative research to provide answers to our most pressing social questions. While an exciting and perhaps overdue moment for qualitative researchers, it is also a time when the method is coming under increasing scrutiny for a lack of reliability and transparency. The…

Phenomenography is an empirical approach to ascertain the qualitatively different ways in which individuals experience and understand aspects of the world around them. Originating in educational research (Marton, F., & Säljö, R. (1976). On qualitative differences in learning. 1- outcome and process. "British Journal of Educational…

The authors evaluated the extent to which interobserver agreement (IOA) scores, using the block-by-block method for events scored with continuous duration recording (CDR), were higher when the data from the same sessions were converted to discontinuous methods. Sessions with IOA scores of 89% or less with CDR were rescored using 10-s partial…

To validate an interpretation or use of test scores is to evaluate the plausibility of the claims based on the scores. An argument-based approach to validation suggests that the claims based on the test scores be outlined as an argument that specifies the inferences and supporting assumptions needed to get from test responses to score-based…

Nonformal education is learner-centered and provides knowledge in a practical manner to participants. Master Gardener is a nonformal extension horticultural program that includes extensive requirements to earn certification. The purpose of this study was to examine the Mergener Education Participation Scale (M-EPS) to evaluate adult motivations to…

In this work we present a large area of aspects related to the problem of sampling inspection in the case of reliability. First we discuss the actual status of this domain, mentioning the newest approaches (from a technical view point) such as HALT and HASS and the statistical perspective. After a brief description of the general procedure in…

This article deals with the ways in which historical discourse analysis is at once different from and similar to research described as qualitative or quantitative. It discusses the consequences of applying the standards of such methods to historical discourse analysis. It is pointed out that although the merit of research using historical…

A concern for generalization dominates quantitative research. For generalizability and repeatability, identification of sample size is essential. The present study investigates 90 qualitative master's theses submitted for the Primary and Secondary School Science and Mathematics Education Departments, Mathematic Education Discipline in 10…

This study analyzed the reliability and validity of an indirect measure of clarity of feelings that is based on response latencies (RTs) of mood ratings. Fifty-two participants completed a laboratory session and an experience-sampling week with 6 measurement occasions per day. Shorter RT of mood ratings measured in the laboratory (but not…

Needs assessments in substance abuse prevention often rely on secondary data measures of consumption and consequences to determine what population subgroup and geographic areas should receive a portion of limited resources. Although these secondary data measures have some benefits (e.g. large sample sizes, lack of survey response biases and cost),…

This report examines the results of the field test for the base year of the High School Longitudinal Study of 2009 (HSLS:09). The general purposes of the field test were, in anticipation of the base-year full-scale effort, to test instruments, forms, and procedures; to experiment with different approaches to questionnaire content and survey…

Reliability is a property of test scores from individuals who have been sampled from a well-defined population. Reliability indices, such as coefficient and related formulas for internal consistency reliability (KR-20, Hoyt's reliability), yield lower bound reliability estimates when (a) subjects have been sampled from a single population and when…

This paper intends to construct a survey data quality strategy for institutional researchers in higher education in light of total survey error theory. It starts with describing the characteristics of institutional research and identifying the gaps in literature regarding survey data quality issues in institutional research. Then it is followed by…

Introduction: Tutorial-based assessment, despite providing a good match with the philosophy adopted by educational programmes that emphasize small group learning, remains one of the greatest challenges for educators working in this context. The current study was performed in an attempt to assess the psychometric characteristics of tutorial-based…