Speech act theory-based, second language pragmatics testing (SLPT) poses problems for validation due to a lack of correspondence with empirical conversational data. Since conversation analysis (CA) provides a richer and more accurate account of language behavior, it may be preferred as a basis for SLPT development. However, applying CA methodology…

This chapter provides an overview of sampling methods that are appropriate for conducting online surveys. The authors review some of the basic concepts relevant to online survey sampling, present some probability and nonprobability techniques for selecting a sample, and briefly discuss sample size determination and nonresponse bias. Although some…

Students in an introductory psychology course took a quiz a week over each textbook chapter, followed by a cumulative final exam. Students missing a quiz in class could make up a quiz at any time during the semester, and answers to quiz items were available to students prior to the cumulative final exam. The cumulative final exam consisted of half…

The 7th International Conference on Education Data Mining held on July 4th-7th, 2014, at the Institute of Education, London, UK is the leading international forum for high-quality research that mines large data sets in order to answer educational research questions that shed light on the learning process. These data sets may come from the traces…

As the idea of including limited English proficient (LEP) students in large-scale assessments is becoming popular among researchers, the practical question of how to do so meaningfully so that the needs and performances of LEP students are recognized while their scores are interpreted and used correctly becomes more important. This paper presents…

This booklet has been written to help persons interested in assessment of education and training programs in general and competency-based vocational education programs in particular. The following topics are covered in the individual sections: the meaning of the term "assessment"; the importance of assessment; curriculum models; percentages and…

The measurement dilemmas involved in assessing the national educational goals established by the President and governors at the 1989 education summit are discussed. The first and most important choice is what to assess and whether to align assessment to the vision of curriculum reform or to the curriculum that students are actually experiencing.…

This research examined the results from direct and indirect writing assessments to determine the most effective method of discrimination. The New Jersey State Department of Education developed a test for ninth-grade students which was designed to measure the ability to apply writing mechanics to written text and to communicate effectively in…

This introduction and overview is part of a seven-section report that investigates how individual competence is defined and assessed in the settings of education and work. Following background rationale, the first portion develops a definition of competence as "a characteristic of an individual that underlies effective work performance."…

Use of the Woodcock Reading Mastery Tests (WRMT), individually administered wide ranging reading tests, was explored, using Title I evaluation Models A1 and A2. Attention was focused on: (1) relationship of the Title I curriculum to the WRMT and the SRA Reading Test; (2) comparative reading achievement gains on both tests, using Model A1; and (3)…

The author takes the position that standardized tests, as presently developed and marketed, do have potentially positive uses. However, these advantages are outweighed by the tests' deleterious effects on children and programs. Standardized tests refer to published, norm referenced, achievement and intelligence tests which contain specific…

The New York State Education Department's state-wide testing program using the Pupil Evaluation Program (PEP) is shown to be generally inadequate for judging program or school effectiveness, or for making decisions which would allow improvements in program effectiveness. The Comprehensive Achievement Monitoring (CAM) system can, however, be…

The increasing use of educational performance or outcome measurements for a range of policy purposes points to new procedures for adjusting data for population composition. The purposes include: program formulation, budget resource allocation, grant-in-aid designs, performance incentive payments, consumer information for school selection, and…

This article presents initial findings related to the psychometric issues and current state policies and practices for out-of-level testing of students with disabilities. Findings indicate 12 states have out-of- level testing policies and states are evenly distributed among those that use criterion-referenced tests, norm-referenced tests, or a…

Adaptation techniques can be applied not only to the multimedia contents or navigational possibilities of a course, but also to the assessment. In order to facilitate the authoring of adaptive free-text assessment and its integration within adaptive web-based courses, Adaptive Hypermedia techniques and Free-text Computer Assisted Assessment are…