As the education reform movement increasingly focuses on teachers and teaching, educators, policy-makers, and researchers need valid and reliable measures that can be used to evaluate individual teachers, provide guidance for improving teaching performance, and support research in ways that advance instruction and classroom dialog and practice. A…

Researchers using structural equation modeling (SEM) aspire to learn about the world by seeking models with causal specifications that match the causal forces extant in the world. This quest for a model matching existing worldly causal forces constitutes an ontology that orients, or perhaps reorients, thinking about measurement validity. This…

This article discusses how methodological practices can shape and limit how mixed methods is practiced and makes visible the current methodological assumptions embedded in mixed methods practice that can shut down a range of social inquiry. The article argues that there is a "methodological orthodoxy" in how mixed methods is practiced…

A method for point and interval estimation of change in criterion validity of multiple-component measuring instruments as a result of revision is outlined. The procedure is developed within the framework of covariance structure modeling, which complements earlier methods for testing change in composite reliability due to addition or deletion of…

Numerous studies have shown increasing item reliabilities as an effect of the item position in personality scales. Traditionally, these context effects are analyzed based on item-total correlations. This approach neglects that trends in item reliabilities can be caused either by an increase in true score variance or by a decrease in error…

Discusses the definition of creativity and the broad methodological issues associated with organizational creativity. Reviews the most relevant theoretical models for studying creativity in organizations. Specific methodological requirements for studying creativity in organizations are then discussed, with emphasis on issues of validity and…

This paper describes how a naturalistic inquirer can demonstrate rigor, or trustworthiness, and how an auditor might assess it. Looking at both inquiry products and processes, Part 1 of this paper describes how an audit may assess whether an inquiry's findings and conclusions are grounded in the raw data, and whether appropriate conventions were…

A conceptual model of quality of life, developed at the Centre for Health Promotion at the University of Toronto (Canada), and associated instrumentation for collecting data from persons with developmental disabilities are presented. Results from a preliminary study with 41 participants support the reliability and validity of the model's…

Estimates confluence model of intellectual development for a within-family sample of 321 children from 101 transracial adoptive families. Mental ages of children and their parents and birth or adoption intervals were used in a nonlinear least-squares estimation procedure to obtain children's predicted mental ages. Results suggest efficiency of the…

Explains that from a prediction standpoint the confluence model is not very efficient. Very modest increments in accuracy are associated with family configuration variables once chronological age is covaried. Suggests that the major postulates of the theory be tested directly, within individuals and with longitudinal data. (Author/AS)

The overall poor quality of educational software on the market suggests that educators must continue efforts to evaluate available packages and to disseminate their findings. In this paper, weaknesses in published evaluation procedures are identified, and an alternative model, the York Educational Software Evaluation Scale (YESES), is described.…

The accuracy of trait estimates obtained from three vertical equating methods was examined. The procedures studied included two anchor test designs and a single-group design. Data from two content areas and two grade combinations were studied. A three-parameter logistic model was used to perform the equatings. The results obtained were used to…

This paper suggests that in addressing the issue of parent-professional congruence in child assessment, researchers should avoid focusing on the conventional aspects of interrater reliability and rater interchangeability, but rather should focus on the reliability of the pooled assessment information from parents and professionals. A…

This paper describes the planning of a qualitative research methodology to develop strategies to improve and expand social interaction skills of deaf-blind students in supported employment settings. Characteristics of qualitative research are delineated and include: definition of the domain of the research; an evolving study design; behavior…

Psychometric theory has been one of psychology's stronger foundations and a major contributor to the recognition of psychology as a scientific discipline. Basic principles of psychometric theory led to the development of respected intelligence tests and large and comprehensive testing and assessment programs. This paper synthesizes major…