This essay presents the reflections of four Education Doctorate (EdD) students on the pilot testing strategies used during an online research methods course. Rigorous questionnaire and interview development skills are challenging to acquire. Pilot testing is an under-researched stage of instrument design, yet it is crucial to ensure validity and…

What follows is a practical guide for establishing the validity of a survey for research purposes. The motivation for providing this guide is our observation that researchers, not necessarily being survey researchers per se, but wanting to use a survey method, lack a concise resource on validity. There is far more to know about surveys and survey…

"The Common European Framework of Reference for Languages: Learning, Teaching, Assessment" (CEFR) (Council of Europe. 2001. "Common European Framework of Reference for Languages: Learning, Teaching, Assessment." Cambridge: Cambridge University Press) has been widely accepted as a reference for aligning curricula, learning…

Just as with print resources, as the number of Web-based resources continues to soar, the need to evaluate them has become a critical information skill for both children and adults. This is particularly true for schools where librarians often are called on to recommend Web resources to classroom teachers, parents, and students, and to support…

It has long been noted in research literature that there does not exist a shared definition of integration of science and mathematics. Classifying a particular set of integration practices by one of many labels has limited value. Moving past the definition debate, this study describes the development and testing of the Mathematics Integrated into…

Student success is at the heart of both institutional effectiveness and the community college mission, yet measuring such success at community colleges is problematic. This article highlights three efforts to grapple with this problem--a multistate work group of system- and state-level policymakers to create an improved set of student success…

In this technical report, we describe the development of cognitive diagnostic test items that form the basis of the diagnostic system for Project DIVIDE (Dynamic Instruction Via Individually Designed Environments). The construct underlying the diagnostic test is division of fractions. We include a description of the process we used to identify the…

The idea that formative assessments embedded in a curriculum could help guide teachers toward better instructional practices that lead to greater student learning has taken center stage in science assessment research. In order to embed formative assessments in a curriculum, curriculum developers and assessment specialists should collaborate to…

An instrument was developed to measure the perceptions of principals toward problems related to educational vouchers (EVs). Thirty-four items concerning freedom of choice, equalization, segregation, church and state issues, and enrollment and recruitment were originally chosen through a literature review. Seventeen graduate students in…

Describes a study to pilot-test a new reading assessment instrument designed to function in a computerized adaptive testing (CAT) environment. Indicates that the measure showed fair internal consistency and correlated well with other tests. Discusses advantages and disadvantages of CAT systems and describes the HyperCAT testing program. (23…

Job training has become an important aspect of an employee's overall job experience. However, it is not often called out specifically on instruments measuring job satisfaction. This technical manual details the processes used in the development and validation of a survey instrument to measure job training satisfaction and overall job…

This article describes the development of an English spelling measure designed to assess the progress made by Spanish-English bilingual children from Grade 2 to Grade 5. Different stages of developing the measure are described, such as selecting the focus features, the prepilot and pilot phases, and the operational version. Two underlying…

In this technical report, the authors describe the development alternate forms of Word and Passage Reading Fluency measures as part of a comprehensive progress monitoring literacy assessment system developed in 2006 for use with students in Kindergarten through fourth grade. They begin with a brief overview of the two conceptual frameworks…

The requirement that schools in England and Wales assess their students, at age seven, in English and mathematics has created a demand for an assessment of students at their entry to statutory schooling. This paper reports on the development and standardization of a test of mathematical concepts for students aged four and over (four plus) as they…

This paper presents the advantages of computer generated tests over traditional tests, outlines the procedures followed in developing a test of music fundamentals, and concludes with the results of a trial of the test. The test, which was developed and programmed in BASIC at Oregon State University, covers elements of notation, intervals and…