The paper compares the nature of the textual construction of the Programme for International Student Assessment (PISA) science test items and the Greek school science textbooks. This nature is determined by the interplay of the notions of classification (content specialization) and formality (code specialization) modulated by both the linguistic…

Much of the learning in technology education is hands-on and best assessed via techniques other than traditional tests. Rubrics have become increasingly recognized as the best means of evaluating student efforts and accomplishments in projects, group work, presentations, various types of research papers, videotapes, web pages, and many other…

As item response models gain increased popularity in large-scale educational and measurement testing situations, many studies have been conducted on the development and applications of unidimensional and multidimensional models. Recently, attention has been paid to IRT-based models with an overall ability dimension underlying several ability…

The purpose of this study was to use the picture format to examine in depth the metacognitive performances and reaction time in general education, low-achieving, and institutionally raised students. Results revealed that institutionally raised students, unlike low-achieving students, took significantly the longest reaction time to finish the test…

The main requisite for a functional computerized adaptive testing system is the need of a calibrated item bank. This text presents the tasks carried out during the calibration of an item bank for assessing knowledge of Basque language. It has been done in terms of the 3-parameter logistic model provided by the item response theory. Besides, this…

To improve student science achievement in the United States we need inquiry-based instruction that promotes coherent understanding and assessments that are aligned with the instruction. Instead, current textbooks often offer fragmented ideas and most assessments only tap recall of details. In this study we implemented 10 inquiry-based science…

The central idea of differential item functioning (DIF) is to examine differences between two groups at the item level while controlling for overall proficiency. This approach is useful for examining hypotheses at a finer-grain level than are permitted by a total test score. The methodology proposed in this paper is also aimed at estimating…

The relationship between stratified alpha (alpha-sub(s)) and the reliability of a test composed of interrelated nonhomogeneous items is examined. It is mathematically demonstrated that when there is congeneric equivalence within the strata or subtests, the difference between the coefficients is a function of the variances of the loadings within…

Many statistics used in the assessment of differential item functioning (DIF) in polytomous items yield a single item-level index of measurement invariance that collapses information across all response options of the polytomous item. Utilizing a single item-level index of DIF can, however, be misleading if the magnitude or direction of the DIF…

Student underachievement on standardized math achievement tests is a major concern in American public schools. One of the speculated reasons for student underachievement is the inability to solve math word problems. Word problems are the most challenging problems in math because word problem solving requires the use of skills in language,…

We study the scale and nature of ability peer effects in secondary schools in England. In order to shed light on the nature of these effects, we investigate which segments of the peer ability distribution drive the impact of peer quality on students' achievements. Additionally, we study which quantiles of the pupil ability distribution are…

Mandatory numeracy tests have become commonplace in many countries, heralding a new era in school assessment. New forms of accountability and an increased emphasis on national and international standards (and benchmarks) have the potential to reshape mathematics curricula. It is noteworthy that the mathematics items used in these tests are rich in…

The present study investigated the functioning of three psychometric models for cognitive diagnosis--the general diagnostic model, the fusion model, and latent class analysis--when applied to large-scale English as a second language listening and reading comprehension assessments. Data used in this study were scored item responses and incidence…

Federal regulations allow up to 2% of the student population of a state to achieve proficiency for adequate yearly progress by taking an alternate assessment based on modified academic achievement standards (AA-MAS). Such tests are likely to be easier, but as long as a test is considered a valid measure of grade level content, it is allowable as…

In this commentary on the "Peabody Journal of Education" special edition, the author addresses implications of the contributing articles to three central domains of interest to states engaged in or considering the development of an alternate assessment on modified academic achievement standards: (a) identifying an eligible student population, (b)…