We conducted a collective case study investigating two college algebra students' graph reasoning and selection on an online assessment. Students completed the assessment during individual, semi-structured interviews, as part of a broader validation study. The assessment contained six items; students selected Cartesian graphs to represent…

To developed an educational tool for an online OSCE to evaluate the practice readiness of the fourth-year nursing students. Online professional proficiency evaluation of nursing students can be a valid alternative to traditional methods. We designed a one group pre-posttest study. The 51 nursing students were recruited. We implemented a 3-stage of…

Instructors have to make important decisions regarding the type of assessment that will finally be implemented when producing online learning materials, since this has a noticeable effect in terms of the methodology, the approach, and the attitude of all the actors involved (Goertler, 2011). This study investigates students' perception of tutor…

This mixed-method study examined the impact of an online formative assessment tool on the language and early literacy skills development of 204 3-4-year-old children enrolled in Head Start. Twenty-four classroom and children participated in a two-group randomized control trial, in which classrooms in the treatment condition implemented weekly…

This paper examines the impact of the informational value of feedback choices on students' performance, their choice to revise, and the time they spend designing posters and reading feedback in an assessment game. Choices to seek confirmatory or critical feedback and to revise posters in a poster design task were collected from a hundred and six…

The use of electronic portfolios for authentic student assessment is growing rapidly (Batson, 2002). Creating portfolios electronically offers a number of benefits not available using traditional paper-based portfolios. Advantages include the portability from one application or institution to another, wider accessibility of the portfolio, and the…

The Board of Registry (BOR) certifies medical technologists and other laboratory personnel. The BOR has studied adaptive testing for over 6 years and now administers all 17 BOR certification examinations using computerized adaptive testing (CAT). This paper presents an overview of the major research efforts from 1989 to the present related to test…

The Office of Personnel Management (OPM) decided to explore alternative examining procedures for positions covered by the Administrative Careers with America (ACWA) examination. One requirement for new procedures was that they be automated for use with OPM's recently developed Microcomputer Assisted Rating System (MARS), a highly efficient system…

This paper describes two procedures for making binary classification decisions using tailored testing: the sequential probability ratio test (SPRT) and a Bayesian decision procedure. The first procedure described, the SPRT, was developed by Wald for quality control work. It has not been widely applied for testing applications because the…

Project Impact, a support system for the administrative and instructional staff in the Onondaga-Madison BOCES schools, was designed to support a diagnostic-prescriptive approach in the classroom by providing the information the teacher needs in order to make instructional decisions. It consists of a series of computer programs with a large storage…

The issue of test-item selection in support of decision making in adaptive testing is considered. The number of items needed to make a decision is compared for two approaches: selecting items from an item pool that are most informative at the decision point or selecting items that are most informative at the examinee's ability level. The first…

The level of confidence in pass/fail decisions obtained with computer adaptive tests (CATs) was compared to decisions based on paper-and-pencil tests. Subjects included 645 medical technology students from 238 educational programs across the country. The tests used in this study constituted part of the subjects' review for the certification…

The sequential probability ratio test (SPRT), developed by Abraham Wald, is one statistical model available for making mastery decisions during computer-based criterion referenced tests. The predictive validity of the SPRT was empirically investigated with two different and relatively large item pools with heterogeneous item parameters. Graduate…