Addresses concerns about the trustworthiness of research results derived from image-based data, particularly questions of validity assessment. Compares examples of such research to provide an illustration of these issues. Presents a tentative strategy for ensuring trustworthiness based on five criteria: completeness, interpretive adequacy,…

The Tower of London test (T. Shallice, 1982), a measure of executive function, was reconstructed to increase its reliability through revisions tested with successive samples of 50, 50, and 34 college students. Adjusting the item pool resulted in acceptable test-retest reliability. (SLD)

Evaluated external assessor ratings of the quality of the research team and the proposed research for proposals submitted to the Australian Research Council large grants program. Data from 313 evaluations show that the reliability of the assessments varied systematically with the number of assessors and the score considered. Discusses implication…

Used structural equations modeling to test the competing values framework (CVF) formulated by R. E. Quinn and colleagues and to refine a scale identifying the extent to which managers use the framework to evaluate organizational effectiveness. Results with 300 hospital managers and supervisors support the CVF, and the refined scale yields…

Stresses two essential characteristics that principals must keep in mind when constructing measures that yield accurate and relevant evaluation data. When constructing quantitative measures, validity and reliability are most important considerations. When designing qualitative measures, credibility and dependability are most important. (14…

Devises a nine-point scale for scoring drawings of a cube. Provides detailed criteria and examples for each category. Shows that interrater reliability of the scale is high, and scores trace a linear trend through a sample age-range. Suggests that the scale is suitable for use as a diagnostic or assessment tool. (DSK)

Examines the internal consistency and temporal stability of informant ratings from the revised NEO Personality Inventory (NEO PI-R) (P. Costa and R. McRae, 1992) and the Interpersonal Adjective Scale (IAS) (J. Wiggins, 1995) through ratings by 109 undergraduates of well-known adult targets. The estimates of internal consistency and temporal…

This study examines selected psychometric characteristics of Bandura's Multidimensional Scales of Perceived Self-Efficacy, including reliability and factor structure. First- and second-order factor structures are presented. Interrelationships among the factors and relationship of factor solutions and subscales are discussed. Implications of the…

The discriminant validity of the Upper Preschool Level of the Differential Ability Scales (DAS) was studied using 32 at-risk preschoolers and 30 normal preschoolers. Results indicate that the DAS was an excellent measure to use when trying to differentiate between at-risk and normal preschoolers, and could reliably identify whether a child was at…

Examines the relationship between Cronbach's coefficient alpha and the reliability of a composite of a prespecified set of interrelated nonhomogeneous components through simulation. Shows that alpha can over- or underestimate scale reliability at the population level. Illustrates the bias in terms of structural parameters. (SLD)

Reports on the interrater reliability of the Educational Needs Questionnaire (Victoria Department of Education, Australia), which was applied to 70 school-age children by their parents and 2 therapists. Results indicate that six of the subscales are reliable when evaluated by therapists and parents, but three subscales did not achieve the…

Examined continuity in attachment classification from infancy through adolescence and related it to autobiographical memories of childhood, divorce, and maladjustment in white middle-class children. Found no continuity in attachment classification from 1 to 18 years and no relation between infant attachment status and adolescent adjustment.…

Undertook two studies (n=113 and n=55) a year apart, to create an instrument that measures nutritional competence and self-efficacy among prospective physicians. Results using Rasch modeling demonstrate the reliability and validity of the scale for assessing mastery of applied nutrition among prospective physicians. (SLD)

Studied the reliability of implicit and explicit memory tests in experiments involving these tests. Results with 168, 84, 120, and 128 undergraduates show that methodological artifacts may cause implicit memory tests to have lower reliability than explicit memory tests, but that implicit tests need not necessarily be less reliable. (SLD)

Used meta-analysis to cumulate reliabilities of personality scale scores, using 848 coefficients of stability and 1,359 internal consistency reliabilities across the Big Five factors of personality. The dimension of personality being measured does not appear to moderate strongly either internal consistency or the test-retest reliabilities.…