This paper reports on literature related to the assessment of barriers to educational technology assessment. It surveys the development of technology acceptance models from social cognitive theory and innovation diffusion theory through to a unified theory that considers performance expectancy, effort expectancy, and social influence. Because risk…

In the last twenty-five years, the discussion surrounding validity evidence has shifted both in language and scope, from the work of Messick and Kane to the updated Standards for Educational and Psychological Testing. However, these discussions haven't necessarily focused on best practices for different types of instruments or assessments, taking…

Short forms of psychometric scales have been commonly used in educational and psychological research to reduce the burden of test administration. However, it is challenging to select items for a short form that preserve the validity and reliability of the scores of the original scale. This paper presents and evaluates multiple automated methods…

Assessing speaking is one of the most difficult tasks in computer based language testing. Many countries all over the world face the need to implement standardized language tests where speaking tasks are commonly included. However, a number of problems make them rather impractical such as the costs, the personnel involved, the length of time for…

This paper is intended to examine the validity of Big 5 Personality test inventory of 44 questions with 5-Likert Scale measurement. Confirmatory factory analysis (CFA) was conducted to determine the good fit indices of the 5 personality types. Those types are 1) extraversion, 2) agreeableness, 3) conscientiousness, 4) openness and 5) neuroticism.…

The general education teacher has the greatest influence on a student's success in school, and a teacher's attitude towards inclusion is a major factor in determining whether inclusion will be successful. The ATTAS-mm is a 9-item scale with strong reliability and validity. The three subscales: believing all students can succeed in general…

Few arguments about education are as effective at galvanizing public attention and motivating political action as those that compare the performance of students with their counterparts in other countries and that connect academic achievement to economic performance. Because data from international large-scale assessments (ILSA) have a powerful…

Within the field of higher education, the majority of quantitative research focuses on college students. Given the limitations of institutional databases, surveys of college students have become one of the largest and most frequently used data sources. In addition, surveys of college students play an increasingly important role in evaluating…

Standardised testing has received a lot of political and public attention recently in Australia. This paper describes the sense-making of Year 3 students as they interpret items from the 2008 NAPLAN. Results show that student performance changed dramatically when the terminology of an item was modified and subsequently were not a true indication…

With the increasing attention on managerial coaching as an effective leadership initiative in organizations, there have been increasing needs for reliable and valid tools to assess managers' coaching skills. This study reviewed and revised an existing instrument measuring coaching skills in organizations created by McLean, Yang, Kuo, Tolbert, and…

This paper discusses issues related to the design and psychometric work for mixed-format tests --tests containing both multiple-choice (MC) and constructed-response (CR) items. The issues of validity, fairness, reliability and score consistency can be addressed but for mixed-format tests there are many decisions to be made and no examination or…

Cut scores are used in a variety of circumstances to aid in decision making through the establishment of a clear cut line between adjacent categories. Community colleges regularly use cut scores on placement tests to decide the appropriate course for each beginning student: the first college-level course or a developmental course, depending on…

This paper reviews the basic processes of exploratory factor analysis (EFA) with regard to evaluating test score validity. Construct validity is the focus of the paper. The similarity between the processes of construct validation and EFA is described and the use of EFA as a tool to explore score validity is explored. Factor analysis is a method…

Conventional scoring of the Coloured Progressive Matrices (CPM) was compared with three methods of multiple weight scoring. The methods include: (1) theoretical weighting in which the weights were based on a theory of cognitive processing; (2) judged weighting in which the weights were given by a group of nine adult expert judges; and (3)…

Increasing attention is being given to the psychometric adequacy of recently published structured child interviews. Three published child interviews, The Child Assessment Schedule (CAS), The Diagnostic Interview for Children and Adolescents (DICA), and The Interview Schedule for Children (ISC) were evaluated in terms of the available evidence of…