Developing models and using mathematics are two key practices in internationally recognized science education standards such as the Next Generation Science Standards (NGSS, 2013). In this paper, we used a virtual performance-based formative assessment to capture students' competencies at both "developing" and "evaluating"…

Simulated testing has become more prevalent in higher education, especially as competency-based institutions begin to incorporate micro-credentials and skills certificates into their curriculum. Competency-based assessment falls outside traditional norm-based testing practices used in K-12 education, and is largely focused on criterion referenced…

How can we test whether state-of-the-art generative models, such as Blender and GPT-3, are good AI teachers, capable of replying to a student in an educational dialogue? Designing an AI teacher test is challenging: although evaluation methods are much-needed, there is no off-the-shelf solution to measuring pedagogical ability. This paper reports…

Online learning has attracted a large number of participants and is increasingly becoming very popular. However, the completion rates for online learning are notoriously low. Further, unlike traditional education systems, teachers, if any, are unable to comprehensively evaluate the learning gain of each student through the online learning…

Mathematical Argumentation skills have historically been overlooked in assessment, but the inclusion of Mathematical Argumentation in the Common Core State Standards (CCSS) as one of the Standards of Mathematical Practice challenges assessment developers to assess this mathematical practice. Explanation and justification of one's own thinking to a…

The virtual reality is being more and more used in the education, enabling the student to find out, to explore and to build his own knowledge. This paper presents an Educational Software for presence or distance education, for subjects of Formal Language, where the student can manipulate virtually the target that must be explored, analyzed and…

Significant momentum exists for next-generation assessments to increasingly utilize technology to develop and deliver performance-based assessments. Many traditional challenges with this assessment approach still apply, including psychometric concerns related to performance-based tasks (PBTs), which include low reliability, efficiency of…

Complex decision-making environments often demand that a range of alternative strategies be identified and compared for their shared value in achieving desired ends. Simple parametric statistical procedures such as analysis of variance and discriminant function analysis can be used in such situations to compare (using selected criteria) the value…

This investigation examined the value of using a multimethod-multisource approach to assess high-technology training systems. The research strategy was utilized to provide empirical information on the instructional effectiveness of the Reserve Component Virtual Training Program (RCVTP), which was developed to improve the training of Army National…

This simulation study involved the design of two two-stage tests in which the routing tests and the second-stage measurement testlets took the form of a multidimensional knapsack problem with prespecified target informations and constraints to be enumerated using the algorithm of E. Balas. Two conventional tests of similar length to the two-stage…

This paper explores the role of computerized simulations as a decision-modeling intervention strategy, and views the strategy's different attribute biases based upon the varying primary missions of instruction versus application. The common goals associated with computer simulations as a training technique are discussed and compared with goals of…

Whether item response theory (IRT) is useful to the small-scale testing practitioner is examined. The stability of IRT item parameters is evaluated with respect to the classical item parameters (i.e., p-values, biserials) obtained from the same data set. Previous research investigating the effect of sample size on IRT parameter estimation has…

Although item bias statistics are widely recommended for use in test development and test analysis work, problems arise in their interpretation. The purpose of the present research was to evaluate the validity of logistic test models and computer simulation methods for providing a frame of reference for item bias statistic interpretations.…

MICROPIK is a multiple-alternatives, criterion-referenced model for evaluating CAI (computer-assisted instruction) software and microcomputer hardware against selected curricular objectives. The model provides decision-modeling control over diverse interactive patterns that occur when computer hardware, courseware, and instructional objectives are…

Continued advances in computerized training technology allow for a better link between instruction and evaluation. The use of computer-controlled audio and video feedback takes the automation of a mastery learning approach with its frequent shifts between instruction and testing a step further and begins to blur the distinction between training…