In the context of digital technologies, computational thinking (CT) is considered a key competence of primary school teachers. However, assessment tools to measure in-service teachers' CT competence are rare. The current study explains the design, development, and validation of a scale to determine the in-service teachers' mastery level of their…

To address the computational constraints of parameter estimation in the polytomous Cognitive Diagnosis Model (pCDM) in large-scale high data volume situations, this study proposes two two-stage polytomous attribute estimation methods: P_max and P_linear. The effects of the two-stage methods were studied via a Monte Carlo simulation study, and the…

These proceedings contain the papers of the 18th International Conference on Cognition and Exploratory Learning in the Digital Age (CELDA 2021), held virtually, due to an exceptional situation caused by the COVID-19 pandemic, from October 13-15, 2021, and organized by the International Association for Development of the Information Society…

A computer simulation study was conducted to investigate Subkoviak's index of reliability for criterion-referenced tests, called the coefficient of agreement. Results indicate that the index can be adequately estimated. (JKS)

Four different methods for estimating the proportions of testees properly classified as having mastered or not mastered test content are examined, using data from the Scholastic Aptitude Test. All four methods prove reasonably accurate and all show some bias under certain conditions. (JKS)

Classical test construction and analysis procedures are applicable and appropriate for use with criterion referenced tests when samples of both mastery and nonmastery examinees are employed. (Author/BB)

Forty adolescent subjects were administered the Woodcock Reading Mastery Tests. The Passage Comprehension Test for each subject was rescored using three different ceiling criteria. The three scoring methods were found to be equivalent to the scoring method recommended in the Woodcock Manual in terms of internal consistency reliability. (Author/LMO)

The purpose of this study was to develop a valid and reliable racquetball skills test for evaluating college racquetball students. (MM)

Two types of classification error are possible in competency tests: erroneous classification of an individual as a "master" of the subject (Type II error), and erroneous classification of a master as a "nonmaster" of the subject (Type I). If steps are taken to minimize Type II errors, an artificially high number of true masters…

The fundamental purposes of this study were to develop mastery tests in the cognitive and psychomotor domains for skin and scuba diving and to establish validity and reliability for the tests. A table of specifications was developed for each domain, and a pilot study refined the initial test batteries into their final form. In the main study,…

False-positive and false-negative decisions are the two possible errors committed with a mastery test; yet the estimation of the likelihood of committing these errors has not been investigated. Two methods of this type of estimation are presented and discussed. (Author/JKS)

Techniques derived from item response theory are useful for estimating the reliability of test classification above and below the cutting score. Test developers can construct a test whose information is peaked in the region of the cutting score; users can select a test which provides the most information in this region. The Cut-Score…

This study examined the test-retest reliability and criterion validity of basal mastery tests of three commercial reading series. Results indicated that reliability and validity of the test varied among and within instruments. Implications for developing and using basal mastery tests are discussed. (Author/MT)

The presently viewed role and utility of measures of instructional sensitivity are summarized. A case is made that the rationale for the assessment of instructional sensitivity can be applied to all achievement tests and should not be restricted to criterion-referenced mastery tests. (Author/BW)

Consistent with its mission of synthesizing available information on performance assessment in a variety of skill areas, the Clearinghouse for Applied Performance Assessment has prepared this summary of the role of performance assessment in selected published tests of problem-solving skill. Performance assessment is defined in terms of assessment…