Within the framework of the Testing Algorithmic and Application Skills project we tested first year students of Informatics at the beginning of their tertiary education. We were focusing on the students' level of understanding in different programming environments. In the present paper we provide the results from the University of Debrecen, the…

Using data from the Trends in International Mathematics and Science Study (TIMSS) 2007, this study examined the big-fish-little-pond-effects (BFLPEs) in 49 countries. In this study, the effect of math ability on math self-concept was decomposed into a within- and a between-level components using implicit mean centring and the complex data…

The main purpose of this study is to improve estimation efficiency in obtaining maximum marginal likelihood estimates of contextual effects in the framework of nonlinear multilevel latent variable model by adopting the Metropolis-Hastings Robbins-Monro algorithm (MH-RM). Results indicate that the MH-RM algorithm can produce estimates and standard…

The main purpose of this study is to improve estimation efficiency in obtaining maximum marginal likelihood estimates of contextual effects in the framework of nonlinear multilevel latent variable model by adopting the Metropolis-Hastings Robbins-Monro algorithm (MH-RM; Cai, 2008, 2010a, 2010b). Results indicate that the MH-RM algorithm can…

Many scales contain both positively and negatively worded items. Reverse recoding of negatively worded items might not be enough for them to function as positively worded items do. In this study, we commented on the drawbacks of existing approaches to wording effect in mixed-format scales and used bi-factor item response theory (IRT) models to…

The main purpose of this study is to improve estimation efficiency in obtaining full-information maximum likelihood (FIML) estimates of contextual effects in the framework of a nonlinear multilevel latent variable model by adopting the Metropolis-Hastings Robbins-Monro algorithm (MH-RM; Cai, 2008, 2010a, 2010b). Results indicate that the MH-RM…

The purpose of this study was to investigate teachers' perceptions of the impact of alternate assessments based on alternate achievement standards (AA-AAS). We used a survey of 401 teachers from three states to probe teacher perspectives across a wide range of topics. Our study found teacher perceptions were more universal than state specific. The…

This paper provides a history of ETS's role in developing assessment instruments and psychometric procedures for measuring change in large-scale national assessments funded by the Longitudinal Studies branch of the National Center for Education Statistics. It documents the innovations developed during more than 30 years of working with…

The city-wide standardized testing program of Madison Public Schools was reviewed by a committee of a cross-section of school system educators as part of a total effort to design a testing program more sensitive to the needs of the system. As a result, standardized testing was reduced to reading (grades 1, 2, 3, 4, 5, and 8) and mathematics (grade…

Several techniques exist to automatically put together a test meeting a number of specifications. In an item bank, the items are stored with their characteristics. A test is constructed by selecting a set of items that fulfills the specifications set by the test assembler. Test assembly problems are often formulated in terms of a model consisting…

The basic steps and procedures in the development of criterion referenced tests (CRT), as well as the issues and problems associated with these activities are discussed. In the first section of the paper, the discussions focus upon the purpose and defining characteristics of CRTs, item construction and selection, improving item quality, content…

This study was patterned after a previous study by Skaggs and Lissitz (1992) in which inconsistency of differential item functioning (DIF) was reported across test administrations. They suggested multidimensionality of test data as one possible reason for inconsistency. Therefore, in this study, DIF indices which were developed recently with a…

Outlines the structure of the CRIMEL project in mathematics at the Ohio State University. Describes the testing program which gives students the opportunity to retake examinations if they believe that they can improve on their initial performance. (JR)

Teacher dissatisfaction with the existing math testing program in the Minneapolis Public Schools (MPS) led to the establishment of the Committee on Citywide Mathematics Testing. The committee was formed to identify tests to be used, grade levels to be tested, and testing schedules. The committee recommended that tests be given in the spring…

This paper presents a summary of the results for the Washington, D.C., public schools of the Metropolitan Readiness Test for grade 1; of the Reading and Mathematics Tests of the Comprehensive Tests of Basic Skills for grades 3 through 9; of the Reading and Mathematics test of the California Achievement Tests for grade 2; plus a summary of the…