Survey data are usually of mixed type (quantitative, multistate categorical, and/or binary variables). Multidimensional scaling (MDS) is one of the most extended methodologies to visualize the profile structure of the data. Since the past 60s, MDS methods have been introduced in the literature, initially in publications in the psychometrics area.…

This study examines factorial structure and the gender invariance of the Turkish version of the Survey of Attitudes toward Statistics (SATS-36). The SATS-36 has 36 items measuring six components: affect, cognitive competence, value, difficulty, effort, and interest. Data were collected from 347 university students. Results showed that the Turkish…

Successful testing programs rely on high-quality test items to produce reliable scores and defensible exams. However, determining what statistical screening criteria are most appropriate to support these goals can be daunting. This study describes and demonstrates cost-benefit analysis as an empirical approach to determining appropriate screening…

These are the appendixes for the report, "The Association between Teachers' Use of Formative Assessment Practices and Students' Use of Self-Regulated Learning Strategies." Two appendixes are included in this document. Appendix A are the methods of the study. This includes the reliability of the teacher and student surveys and the…

Drawing parallels to classical test theory, this article clarifies the difference between rater accuracy and reliability and demonstrates how category marginal frequencies affect rater agreement and Cohen's kappa. Category assignment paradigms are developed: comparing raters to a standard (index) versus comparing two raters to one another…

Assessing global interrater agreement is difficult as most published indices are affected by the presence of mixtures of agreements and disagreements. A previously proposed method was shown to be specifically sensitive to global agreement, excluding mixtures, but also negatively biased. Here, we propose two alternatives in an attempt to find what…

Throughout the dissertation process, the chair and committee members provide feedback regarding quality to help the doctoral candidate to produce the highest-quality document and become an independent scholar. Nevertheless, results of previous research suggest that overall dissertation quality generally is poor. Because much of the feedback about…

In this study, we describe what factors influence the observed score correlation between an (external) anchor test and a total test. We show that the anchor to full-test observed score correlation is based on two components: the true score correlation between the anchor and total test, and the reliability of the anchor test. Findings using an…

The purpose of this study was to explore the reliability of measures of both individual and group creative work using the consensual assessment technique (CAT). CAT was used to measure individual and group creativity among a population of pre-service music teachers enrolled in a secondary general music class (n = 23) and was evaluated from…

In applications of item response theory (IRT), an estimate of the reliability of the ability estimates or sum scores is often reported. However, analytical expressions for the standard errors of the estimators of the reliability coefficients are not available in the literature and therefore the variability associated with the estimated reliability…

We investigated the classification accuracy of learning disability (LD) identification methods premised on the identification of an intraindividual pattern of processing strengths and weaknesses (PSW) method using multiple indicators for all latent constructs. Known LD status was derived from latent scores; values at the observed level identified…

This study investigated the validity and reliability of scores on the instrument employing Rasch analysis in a sample of 299 Malaysian adolescents aged between 16 and 19 and provided further evidence for the validity among the sub-constructs: social self-efficacy, academic self-efficacy, and emotional self-efficacy.

Within the major therapeutic paradigms, observational instruments have been developed to assess orientation-specific interventions or processes. However, to date, no such instrument exists to assess existential practices. Recent research indicates the key practices of existential therapists, and forms an empirical basis on which to develop an…

There is a major trend in engineering education to provide students with realistic hands-on learning experiences. This paper reports on the results of work done to develop standardized test instruments to use for student learning outcomes assessment in an experiential hands-on manufacturing engineering and technology environment. The specific…

The study was designed to identify the effect of high-order thinking on the quality of life among Ajloun University students. The study used the associative method. The randomly selected sample consisted of 147 students from Ajloun University College. The study used two tools: The two measures were applied to the sample of the current study after…