In the human sciences, a common assumption is that latent traits have a hierarchical structure. Higher order item response theory models have been developed to account for this hierarchy. In this study, computerized adaptive testing (CAT) algorithms based on these kinds of models were implemented, and their performance under a variety of…

Higher expectations are on all parties to ensure students successfully perform on standardized tests. Specifically in North Carolina agriculture classes, students are given a CTE Post Assessment to measure knowledge gained and proficiency. Prior to students taking the CTE Post Assessment, teachers have access to a test item bank system that…

Educating children is a costly endeavor; however, when children with special needs enter kindergarten unprepared emotionally, socially, or academically, the increased costs and support systems have to be absorbed by the schools and communities. The purpose of this study was to determine if there was a significant difference between the academic…

A substantial amount of research has been conducted over the past 40 years on technical aspects of computerized adaptive testing (CAT), such as item selection algorithms, item exposure controls, and termination criteria. However, there is little literature providing practical guidance on the development of a CAT. This paper seeks to collate some…

The authors used a nominal response item response theory model to estimate category boundary discrimination (CBD) parameters for items drawn from the Emotional Distress item pools (Depression, Anxiety, and Anger) developed in the Patient-Reported Outcomes Measurement Information Systems (PROMIS) project. For polytomous items with ordered response…

Andersen (1995, 2002) proves a theorem relating variances of parameter estimates from samples and subsamples and shows its use as an adjunct to standard statistical analyses. The authors show an application where the theorem is central to the hypothesis tested, namely, whether random guessing to multiple choice items affects their estimates in the…

This study investigated item exposure control procedures under various combinations of item pool characteristics and ability distributions in computerized adaptive testing based on the partial credit model. Three variables were manipulated: item pool characteristics (120 items for each of easy, medium, and hard item pools), two ability…

The use of emerging technologies shape learners' knowledge creation and transformation processes. In this regard, this study aimed to develop a scale to investigate 8 th graders' competencies regarding the educational technology standards based on ISTE-NETS. After a review of relevant literature, an item pool was prepared. The pool was improved…

In the EU Kids Online II project, data were collected from children and parents via in-home face-to-face interviews in 25 European countries to examine children's Internet use, activities and skills, the risk of harm they encountered, parental awareness, and safety strategies regarding children's Internet use and risks. The project provides…

Distance Learning supported by the WEB is a reality which is growing fast and, like any technological or empirical innovation, it reveals positive and negative aspects. An important aspect is in relation to the monitoring of the activities done by the students since an accurate online assessment of the knowledge acquired is an open and, therefore,…

Tony Alpert, chief operating officer for the Smarter Balanced Assessment Consortium (SBAC), ponders whether to allow tablet computers--and particularly iPads--to be used for summative testing online. As Alpert points out, not only would student cheating compromise the validity of the individual student's test event, "worse yet, it could expose…

Item replenishing is essential for item bank maintenance in cognitive diagnostic computerized adaptive testing (CD-CAT). In regular CAT, online calibration is commonly used to calibrate the new items continuously. However, until now no reference has publicly become available about online calibration for CD-CAT. Thus, this study investigates the…

PeerWise is a novel, freely available, online pedagogical tool that allows students to create and deposit questions for peer evaluation. A participatory learning approach through this web-based system was used to motivate and promote a deep approach in learning nervous system by 124 second year MBBS students at Cyberjaya University College of…

For computerized adaptive tests (CATs) to work well, they must have an item pool with sufficient numbers of good quality items. Many researchers have pointed out that, in developing item pools for CATs, not only is the item pool size important but also the distribution of item parameters and practical considerations such as content distribution…

The Smarter Balanced Assessment Consortium has built a comprehensive learning and assessment system in English Language Arts/Literacy (ELA/L) and mathematics, the components of which work together toward the goal that all students leave high school prepared for postsecondary success in college or career through increased student learning and…