By design, randomized experiments (XPs) rule out bias from confounded selection of participants into conditions. Quasi-experiments (QEs) are often considered second-best because they do not share this benefit. However, when results from XPs are used to generalize causal impacts, the benefit from unconfounded selection into conditions may be offset…

The EdSurvey package helps users download, explore variables in, extract data from, and run analyses on large-scale assessment data. The analysis functions in EdSurvey account for the use of plausible values for test scores, survey sampling weights, and their associated variance estimator. We describe the capabilities of the package in the context…

Assessment has an important role in education and it has a critical role in the teaching process. Through appropriate assessment, teachers can classify and grade their students, give feedback and structure their teaching accordingly. Recently, educators and scientists have been becoming more interested in the requirements of assessment procedures…

In this article, I provide answers to the questions posed by Will Shadish about the history and development of the Schmidt-Hunter methods of meta-analysis. In the 1970s, I headed a research program on personnel selection at the US Office of Personnel Management (OPM). After our research showed that validity studies have low statistical power, OPM…

Computers can be an effective teaching method for students with learning disabilities (LD). The use of mobile devices as education tools for students with disabilities has received considerable attention in special education recently. Parents, teachers, and professionals look for effective applications (i.e., apps) that meet the needs of their…

Assessments come in many forms in part because they serve many purposes, and those purposes often vary by the stakeholders they support. Students, parents, teachers, and school, district and state leaders may all be end users of the information provided by various assessments. This brief supports state leaders' understanding of assessments by…

Universal screening measures can be used to identify students at risk academically due to learning disabilities or other difficulties. Research and legislation support the use of screening measures early in students' education to ensure they receive any supports necessary to bolster their academic achievement. When selecting a screening measure,…

Assessments used for both clinical practice and research should show evidence of validity and reliability for the target group of people. It is easy to agree with this statement, but it is not always easy to choose the right assessment for the right purpose. Recently there have been increasing numbers of studies which investigate further the…

An unprecedented assessment project involving half the states is planning a significant shift: Instead of designing one test for all of them, it will offer a choice of a longer and a shorter version. The pivot came in response to some states' resistance to spending more time and money on testing for the common standards. The plan under discussion…

The 2007 reauthorization of Head Start requires Head Start programs to use child assessments and developmental screeners that are developmentally, linguistically, and culturally appropriate, as well as valid and reliable in the language in which they are used. This can be a challenge, since very few child assessment tools are developed or tested…

Presents 40 questions, commentaries, and rebuttals on the generalizability of validities of employment tests of cognitive abilities and meta analysis. (BL)

A neglected element in designing tests is that of publicness, that is, the extent to which test specifications are understandable and usable by all interested parties. Issues related to content validity, such as test bias and instructional sensitivity, become accessible to these parties once content validity and design have been adequately…

The article outlines the physiological and measurement bases for the development of physical fitness tests, raising questions concerning physiological, psychological, and evaluation issues. (Author/CB)

The project reviewed, tested, and analyzed the National Occupational Competency Testing Institute's (NOCTI) test series (written and performance for skilled occupations), using a sample of 16 examinations, to determine their appropriateness for use by the State of Georgia in their selection and certification of vocational and technical educators.…

In the next few years employers will frequently be confronted with the fact that they cannot rely on undocumented, subjective selection procedures. As long as disparate impact exists in employee selection, employers will be required to validate whatever selection procedures they use. (Author/IRT)