With the increasing refinement of language processing models and the new discoveries about which variables can modulate these processes, stimuli selection for experiments with a factorial design is becoming a tough task. Selecting sets of words that differ in one variable, while matching these same words into dozens of other confounding variables…

Linear factor analysis models used to examine constructs underlying the responses are not very suitable for dichotomous or polytomous response formats. The associated problems cannot be eliminated by polychoric or tetrachoric correlations in place of the Pearson correlation. Therefore, we considered parameters obtained from the NOHARM and FACTOR…

Purpose: The purpose of this paper is to examine the differences between the four main kinds of business schools in Egypt (private; internationally affiliated; public with local programs; and public with international programs) in terms of perceptions of entrepreneurial orientation (EO). Design/Methodology/Approach: Data were gathered 212 with a…

This study investigated the responses of 531 preservice teachers to a "Beliefs About Assessment" questionnaire in China. The questionnaire focused on understanding the purposes, practices and principles of assessment for and of learning. Using factor analysis, an inter-correlated two-order model fitted well to the responses. This model…

Midterm student evaluations have been shown to be beneficial for providing formative feedback for course improvement. With the purpose of improving instruction in marketing courses, this research introduces and evaluates a novel form of midterm student evaluation of teaching: the online collaborative evaluation. Working in small teams, students…

These authors have previously described how to use the "t" test to compare two groups. In this article, they describe the use of a different test, analysis of variance (ANOVA) to compare more than two groups. ANOVA is a test of group differences: do at least two of the means differ from each other? ANOVA assumes (1) normal distribution…

How to compute and report subscores for a test that was originally designed for reporting scores on a unidimensional scale has been a topic of interest in recent years. In the research reported here, we describe an application of multidimensional item response theory to identify a subscore structure in a test designed for reporting results using a…

This study assesses the psychometric properties of a newly tested self-report assessment tool for media literacy, based on the twelve new media literacy skills (NMLs) developed by Jenkins et al. (2006). The sample (N = 327) consisted of normal volunteers who completed a comprehensive online survey that measured their NML skills, media exposure,…

The objective of this research was to explore the possibilities of identifying knowledge style factors that could be used as central elements of a professional business analyst's (PBA) performance attributes at work for those decision makers that use advanced analytical technologies on decision making tasks. Indicators of knowledge style were…

Various policy papers assert that teamwork is an essential skill for the 21st-century workforce. However, outside of organizational psychology research with adult populations, there are few reliable assessments of this construct with suitable validity evidence for test scores. To redress this issue, self-report, situational judgment, and…

This paper introduces five commonly used approaches to analyzing multiple-choice test data. They are classical test theory, factor analysis, cluster analysis, item response theory, and model analysis. Brief descriptions of the goals and algorithms of these approaches are provided, together with examples illustrating their applications in physics…

Various policy papers and research studies assert that teamwork is one of the most important skills for students to learn if they are to become meaningful contributors to the 21st century workforce. However, outside of organizational psychology and adult populations, few reliable assessments of this construct exist, with suitable validity evidence…

A method is presented that allows multivariate comparability while making only minimal restrictions on randomization. This procedure is demonstrated in the context of assigning 63 aggregated units (schools) to 28 experimental and control conditions. Good comparability of groups for all primary main effects and interactions was verified for 15…

Because ignoring the missing data in an evaluation may lead to results that are questionable, this study investigated the effects of use of four missing data handling techniques on a survey instrument. A questionnaire containing 35 5-point Likert-style questions was completed by 384 respondents. Of these, 166 (43%) questionnaires contained 1 or…

It is shown that goodness-of-fit criteria developed for the evaluation of multivariate structural models can be applied to assist in evaluating the dimensionality of a test consisting of binary items, and correlative methods regularly used in factor analysis can be employed to diagnose causes of misfit. (Author)