This research attempted to interrelate several methods of producing option weights (i.e., Guttman internal and external weights and judges' weights) and examined their effects on reliability and on concurrent, predictive, and face validity. It was concluded that option weighting offered limited, if any, improvement over unit weighting. (Author/CTM)

Extending past research, the present study provides an initial examination of the relationship between trait-like personality variables, communicator style, and individual listening preferences. A series of canonical correlations were run to ascertain to what degree certain communication preferences and trait-like personality variables are related…

The study investigated the comparison of the difficulty and discrimination incides of three multiple choice tests using the confidence scoring procedure (CSP). The study was also set to determine whether or not the difficulty and discrimination indices would be improved, if the tests were scored by the confidence scoring procedure. Two null…

Tactical approaches to teaching are, arguably, still under-utilized in physical education settings, and this may be due to the lack of pertinent assessment materials. The purpose of this article is to present a generic invasion-game unit and to link it to a variety of assessment materials using three tactical components from the Game Performance…

The purpose of this study was to find critical features of engineering design that can be incorporated within technology education learning activities, and develop a rubric for assessing these features. Data were collected through semi-structured interviews with three professors actively involved in engineering education. Supporting documents such…

Research on input processing in the acquisition of a non-primary language has rested largely on the assumption that learners use a meaning-based approach as the "default" when processing input (VanPatten, 1996). The study reported here poses a challenge to this assumption: findings show that participants who were absolute beginners used a…

It is often questioned as to why fewer women enter science. This study assesses whether a cognitive style characterized by systemizing being at a higher level than empathizing (S greater than E) is better than sex in predicating entry into the physical sciences compared to humanities. 415 students in both types of discipline (203 males, 212…

Writing Workshop is an interactive approach to teaching writing as students learn and practice the importance of rehearsal, drafting/revising, and editing their pieces of writing (Calkins, 1986; Graves, 1983). This study implemented a mixed methodology design incorporating qualitative and quantitative analysis (Mills, 2007) by administering a pre…

If examinees are permitted to choose to answer a subset of the questions on a test, just knowing which questions were chosen can provide a measure of proficiency that may be as reliable as would have been obtained from the test graded traditionally. This new method of scoring is much less time consuming and expensive for both the examinee and the…

The increased use of constructed-response items, like essays, creates a need for tools to score these responses automatically in part or as a whole. This study explores one approach to analyzing essay-length natural language constructed-responses. A decision model for scoring essays was developed and evaluated. The decision model uses…

The International Test Commission formed a 13-person committee of psychologists representing a number of international organizations to prepare a set of guidelines for adapting educational and psychological tests. The committee has worked for 3 years to produce near final drafts of 22 guidelines organized into 4 categories: (1) context; (2)…

This paper presents some Bayesian theories of simultaneous optimization of decision rules for test-based decisions. Simultaneous decision making arises when an institution has to make a series of selection, placement, or mastery decisions with respect to subjects from a population. An obvious example is the use of individualized instruction in…

This paper reviews and critically evaluates the psychometric properties of Kolb's Learning Style Inventory (LSI). The LSI was developed originally in the 1970s (Kolb, 1976a) and was revised in the 1980s (Kolb, 1985). Although the LSI has been very popular, extensive evidence available in the published literature indicates that both the original…

In the traditional Angoff Standard Setting Method, experts are instructed to predict the possibility that a randomly selected, hypothetical minimally competent candidate will be able to answer each multiple choice question in the test correctly. These item performance estimates are averaged across panelists and aggregated to determine the minimum…

Given judges' ratings on a set of variables, the program will produce for each variable, a printed analysis of variance summary table for between subjects/events, within subjects/events, and between judges sources of variability, a reliability coefficient, an adjusted reliability coefficient and means and standard deviations for each rater. (RC)