In the present study Monte Carlo methods were employed to evaluate the degree to which canonical function and structure coefficients may be differentially sensitive to sampling error. Sampling error influences were investigated across variations in variable and sample (n) sizes, and across variations in average within-set correlation sizes and in…

A version of sequential mastery testing is studied in which response behavior is modeled by an item response theory (IRT) model. First, a general theoretical framework is sketched that is based on a combination of Bayesian sequential decision theory and item response theory. A discussion follows on how IRT based sequential mastery testing can be…

Focus: HOPE provides valuable, practical occupational training in machinist or information technology (IT) occupations to young people who face barriers to the development of viable careers through postsecondary education and training because of low-income, basic skills deficiencies, incarceration, or parenting responsibilities. This report…

Digital information can be lost for a variety of reasons, including magnetic decay, format and device obsolescence, human or system error, among many others. A solution is to build an archival repository, a system capable of storing and preserving digital objects as technologies and organizations evolve. Designing an archival repository is a…

This report examines issues in the scale-up of assessment software from the Center for Research on Evaluation, Standards, and Student Testing (CRESST). "Scale-up" is used in a metaphorical sense, meaning adding new assessment tools to CRESST's assessment software. During the past several years, CRESST has been developing and evaluating a…

This article discusses the effectiveness of a theoretical-based integrated learning environment (ILE) for training non-traditional learners to perform the skills required to be successful in entry-level jobs. The ILE places instruction in a real-world, workplace context with realistic settings, characters, and storylines. The multimedia interface…

Background: Terms such as 'clinical intuition' have often been applied to the practice of speech and language therapy. Various authors have aimed to make the process of therapy practice more explicit, and it is argued that recently developed descriptive/analytic frameworks have the potential to engender the critical mindset necessary for student…

With the advent of No Child Left Behind (NCLB), the context for NAEP participation is changing. Whereas in the past participation in NAEP has always been voluntary, participation is now mandatory for some grade and subjects among schools receiving Title I funds. While this will certainly raise school-level participation rates in the mandated…

The purpose of this simulation was to assess the improvements in estimates of standard errors that could be expected if students participating in NAEP were pre-assigned to test booklets that were adapted to their level of performance based on their state assessment scores. Students in extreme quartiles would receive one regular NAEP block and…

A simulation study was conducted to explore the potential of state assessment scores to improve adjustments for nonparticipation (McLaughlin, Gallagher, and Stancavage, 2004). That study found that state assessment scores could potentially be more effective than demographic information in removing the bias related to absences. The present study…

The performance of distant students in a simulation exercise for a Small Business Management (SBM) course was compared with that of internal students and the demographic and psychological variables associated with the performance of each student group were examined. Distant students matched or exceeded the performance of internal students in…

This report documents the technology initiatives of the Center for Research on Evaluation, Standards, and Student Testing (CRESST) in two broad areas: (1) using technology to improve the quality, utility, and feasibility of existing measures; and (2) using technology to design and develop new assessments and measurement approaches available…

A basic technical framework is provided for the design and use of mastery tests. The Mastery Testing Project (MTP) prepared this framework using advanced mathematics supplemented with computer simulation based on real test data collected by the South Carolina Statewide Testing Program. The MTP focused on basic technical issues encountered in using…