It is almost self-evident that test results will be unreliable and misleading if those undergoing assessments do not make a full effort on testing. Nevertheless, objective tests of effort have not typically been used with young adults to determine whether test results are valid or not. Because of the potential economic and/or recreational benefits…

Although the memorial benefits of testing are well established empirically, the mechanisms underlying this benefit are not well understood. The authors evaluated the mediator shift hypothesis, which states that test-restudy practice is beneficial for memory because retrieval failures during practice allow individuals to evaluate the effectiveness…

In this study, potential benefits of early memory testing were examined in terms of "inoculating" eyewitness memory against forgetting. As predicted by fuzzy trace theory (e.g., Reyna & Titcomb, 1997), a larger testing advantage in the delayed recall of event details was expected after immediate testing than after delayed testing…

Paul E. Newton's article on the consensus definition of validity tackles a number of big issues and makes a number of strong claims. I agreed with much of what he said, and I disagreed with a number of his claims, but I found his article to be consistently interesting and thought provoking (whether I agreed or not). I will focus on three general…

The representation of item and associative information in episodic memory was investigated using cued recall and single item recognition. In the first four experiments, participants studied two lists constructed such that some items presented in a pair during List 1 were rearranged to create new pairs in List 2 and were accompanied by pairs…

Extreme linkings are performed in settings in which neither equivalent groups nor anchor material is available to link scores on two assessments. Examples of extreme linkages include links between scores on tests administered in different languages or between scores on tests administered across disability groups. The strength of interpretation…

This paper describes the process for creating and validating an assessment test that measures the effectiveness of instruction by probing how well that instruction causes students in a class to think like experts about specific areas of science. The design principles and process are laid out and it is shown how these align with professional…

Standardizing aspects of assessments has long been recognized as a tactic to help make evaluations of examinees fair. It reduces variation in irrelevant aspects of testing procedures that could advantage some examinees and disadvantage others. However, recent attention to making assessment accessible to a more diverse population of students…

The desirability of test equating to maintain the same criterion standard from test administration to test administration has long been accepted for multiple choice tests. The same consistency of expectations is desirable for performance tests, especially if they are part of a licensure or certification process or used for other high stakes…

Recently, there has been an increasing level of interest in subscores for their potential diagnostic value. Haberman (2008b) suggested reporting an augmented subscore that is a linear combination of a subscore and the total score. Sinharay and Haberman (2008) and Sinharay (2010) showed that augmented subscores often lead to more accurate…

It is shown how the time limit on a test can be set to control the probability of a test taker running out of time before completing it. The probability is derived from the item parameters in the lognormal model for response times. Examples of curves representing the probability of running out of time on a test with given parameters as a function…

These are the appendixes for the report "Children's Knowledge and Skills at Kindergarten Entry in Illinois: Results from the First Statewide Administration of the Kindergarten Individual Development Survey." At least half of states administer or are developing kindergarten entry assessments. In fall 2017 the Illinois State Board of…

Since 2012, the Jack Kent Cooke Foundation has supported educational enrichment in rural areas by awarding over $3.3 million in grants to six outstanding organizations operating in Iowa, Indiana, Mississippi, North Carolina, Tennessee, and Virginia. In this report, the authors combine the experiences of these organizations with findings from the…

The Jack Kent Cooke Foundation has provided over $3.3 million in grants to outstanding providers of educational enrichment in rural areas since 2012. In extensive interviews, rural education experts in our grantee organizations shared their practical knowledge of the best ways to identify academically talented students in rural areas, provide…

Prompted by a previous study investigating the effects of pacing on the academic testing performance of college students with AD/HD, we further explored our preliminary findings, which suggested that a computerized testing environment enhanced the testing performance of college students with AD/HD. We compared the effects of a computerized vs.…