The purpose of this study was to develop an instrument to measure perceived teacher efficacy to teach in inclusive classrooms. An 18-item scale was developed on a sample of 607 pre-service teachers selected from four countries (Canada, Australia, Hong Kong and India). Factor analysis of responses from the sample revealed three factors: efficacy in…

Questionnaire instruments are frequently administered in digital formats, largely web-based, without much systematic investigation of possible effects from these administration methods. Furthermore, little attention has been given to the contextual lack of control for extraneous factors that may influence user responses. In this study, 263…

This study assessed scores from the Counselor Burnout Inventory for factorial validity, convergent and discriminant validity, internal consistency reliability, and measurement invariance across U.S. and Korean counselors. Although evidence existed for factorial validity across both groups, mixed results emerged for the other forms of validity and…

The present study investigated the impact of an antecedent intervention in the form of a daily posted schedule on the interobserver agreement (IOA) assessment of educational goals implemented within a classroom at a private school serving individuals with disabilities. During baseline, the percentage of academic goals with interobserver agreement…

The principal aim of the study is to develop a new scale Science Anxiety Scale and to examine its the psychometric properties and construct validity of the Science Anxiety Scale in a sample of 797 primary school students. Exploratory factor analysis was applied and found to have a two-dimensional structure. Confirmatory factor analyses provide…

Objective: There is increasing emphasis on dimensional conceptualizations of psychopathology, but empirical evidence of their utility is just emerging. In particular, although a range of multidimensional models have been proposed, the relative fit of competing models has rarely been tested. Furthermore, developmental considerations have received…

Students with positive attitudes toward statistics are likely to show strong academic performance in statistics courses. Multiple surveys measuring students' attitudes toward statistics exist; however, a comparison of the validity and reliability of interpretations based on their scores is needed. A systematic review of relevant electronic…

We evaluated interrater agreement across multiple respondents on anecdotal assessments and compared cases in which agreement was obtained with outcomes of functional analyses. Experiment 1 evaluated agreement among multiple respondents on the function of problem behavior for 27 individuals across 42 target behaviors using the Motivation Assessment…

For testing programs that administer multiple forms within a year and across years, score equating is used to ensure that scores can be used interchangeably. In an ideal world, samples sizes are large and representative of populations that hardly change over time, and very reliable alternate test forms are built with nearly identical psychometric…

Within a response to intervention (RTI) framework, students are administered multiple tests of equivalent difficulty. Changes in students' scores over time are then attributed to changes in learning. In the current study, we evaluated the reliability of score changes (i.e., slope) for the easyCBM[R] letter names, word reading fluency, and passage…

This study examines the proposed Reliability Generalization (RG) method for studying reliability. RG employs the application of meta-analytic techniques similar to those used in validity generalization studies to examine reliability coefficients. This study explains why RG does not provide a proper research method for the study of reliability,…

Likert response scales are widely used in the social sciences, typically to measure attitudes and personality. This study seeks to understand the optimal number of categories to include in a Likert scale measuring attitudes. Therefore, the author examined four versions of an attitude measure, the Religious Motivation Scale, ranging from a 4- to…

A comparison between six rater agreement measures obtained using three different approaches was achieved by means of a simulation study. Rater coefficients suggested by Bennet's [sigma] (1954), Scott's [pi] (1955), Cohen's [kappa] (1960) and Gwet's [gamma] (2008) were selected to represent the classical, descriptive approach, [alpha] agreement…

There is limited research about the validity and reliability of civic engagement indicators. This study examines the measurement invariance of a Civic Values construct based on students' responses on the 2000 Freshman Survey and 2004 College Senior Survey, which are both part of the Cooperative Institutional Research Program (CIRP). Results show…

Background: The purpose of this study was to determine the feasibility and reliability of the modified Berg Balance Scale (mBBS) in persons with severe intellectual and visual disabilities (severe multiple disabilities, SMD) assigned Gross Motor Function Classification System (GMFCS) grades I and II. Method: Thirty-nine participants with SMD and…