This research applies multimedia technology to design a dynamic item generation method that can adaptively adjust the difficulty level of items according to the level of the testee. The method is based on interactive testing software developed by Flash Actionscript, and provides a testing solution for users by automatically distributing items of…

Many innovative item formats have been proposed over the past decade, but little empirical research has been conducted on their measurement properties. This study examines the reliability, efficiency, and construct validity of two innovative item formats--the figural response (FR) and constructed response (CR) formats used in a K-12 computerized…

Assessment practices and requirements are very broad and vary widely among academic programs and from one institution to the other. Consequently, we noticed, in the recent years, increased volumes of research and interest geared into the assessment process and procedures in various disciplines in higher education. In this paper, we present and…

This article reports on a study conducted with 42 participants from a Chilean university, which aimed to determine the effect of mode of response on test performance and test-taker perception of test features by comparing a semidirect online version and a direct face-to-face version of a speaking test. Candidate performances on both test versions…

The standard evaluation forms used in most college and university courses are ill suited to assess courses and instructors whose goals and pedagogy differ significantly from the "chalk and talk" approach to undergraduate instruction. This article discusses an evaluation form that the author, a professor emeritus of economics at the…

Web-based standard setting holds promise for reducing the travel and logistical inconveniences of traditional, face-to-face standard setting meetings. However, because there are few published reports of setting standards via remote meeting technology, little is known about the practical potential of the approach, including technical feasibility of…

The action research study described in this report outlines the design and implementation of a unit of blended instruction in a traditional high school English classroom. Twenty technical high school students in an 11th grade Honors English class engaged in a variety of internet-based activities in conjunction with traditional learning activities…

In teacher education programmes, text-based portfolios are generally used to assess student-teachers' competence as new teachers. However, striking discrepancies are known to exist between the competencies reflected in a written portfolio and the competencies observed in actual classroom practice. Multiple assessments should be used to provide a…

With the advancement of information and communication technology, collaboration and knowledge sharing through technology is facilitated which enhances the learning process and improves the learning efficiency. The purpose of this paper is to review the methods of assessment and strategy of collaboration and knowledge sharing in a computer course,…

The current era of common curriculum standards, increased accountability, and rapid expansion of technology within a complex and highly charged political context has influenced changes in assessment practices in mathematics classrooms. This research commentary situates high-stakes assessments in a historical context, discusses recent advances in…

In a cross-sectional study, we examined the relationship between the quality of lexical representations and text comprehension skill in German primary school children (Grades 1-4). We measured the efficiency and accuracy of orthographical, phonological, and meaning representations by means of computerized tests. Text comprehension skill was…

The purpose of this research is to develop a multidimensional computerized adaptive test for diagnosing the cognitive process of grade 7 students in learning algebra by applying multidimensional item response theory. The research is divided into 4 steps: 1) the development of item bank of algebra, 2) the development of the multidimensional…

This paper reviews the literature on comparing online and paper course evaluations in higher education and provides a case study of a very large randomised trial on the topic. It presents a mixed but generally optimistic picture of online course evaluations with respect to response rates, what they indicate, and how to increase them. The paper…

This article investigates if online evaluation leads to different results than paper-and-pencil evaluation. Given that most previous studies confound the evaluation mode (online versus paper) with the evaluation situation (in class versus after class), we expected that evaluation results would be influenced only by the evaluation situation,…

The important but little understood problem that motivated this study was the lack of research on valid assessment methods to determine progress in higher-order learning in situations involving complex and ill-structured problems. Without a valid assessment method, little progress can occur in instructional design research with regard to designing…