The product Bayes factor (PBF) synthesizes evidence for an informative hypothesis across heterogeneous replication studies. It can be used when fixed- or random effects meta-analysis fall short. For example, when effect sizes are incomparable and cannot be pooled, or when studies diverge significantly in the populations, study designs, and…

There can be many reasons why students fail to answer correctly to summative tests in advanced computer science courses: often the cause is a lack of prerequisites or misconceptions about topics presented in previous courses. One of the ITiCSE 2020 working groups investigated the possibility of designing assessments suitable for differentiating…

Monitoring applications (MAs) use digital and online tools to collect and track data on student behavior, and they have become increasingly popular among schools. Empirical research on these complex surveillance platforms is scant, and little is known about the efficacy or impact that they have on students. This study used a multi-method…

Trust in science and scientists can greatly influence consideration of scientific developments and activities. Yet, trust is a nebulous construct based on emotions, knowledge, beliefs, and relationships. As we explored the literature regarding trust in science and scientists we discovered that no instruments were available to assess the construct,…

This policy report provides a guide and framework to early childhood policymakers considering formative assessment. The report defines formative assessment and outlines its process and application in the context of early childhood. The substance of this document is the issues for consideration in the implementation of the formative assessment…

We have developed simple data-mining algorithms to assess the consistency and the randomness of student responses to problems consisting of multiple true or false statements. In this paper we describe the algorithms and use them to analyze data from introductory physics courses. We investigate statements that emerge as outliers because the class…

This article discusses the role of assessment in a response-to-intervention model. Although assessment represents only 1 component in a response-to-intervention model, a well-articulated assessment system is critical in providing teachers with reliable data that are easily interpreted and used to make instructional decisions. Three components of…

The assessment of vocational workplace-based qualifications in England relies on human assessors (raters). These assessors observe naturally occurring, non-standardised evidence, unique to each learner and evaluate the learner as competent/not yet competent against content standards. Whilst these are considered difficult to measure, this study…

For identifying children with four major kinds of verbal learning disabilities viz. reading disability, speech and language comprehension disability, writing disability and mathematics disability, the present task was undertaken to construct and standardize verbal learning disabilities checklist. This checklist was developed by keeping in view the…

Background: Coaches and physical educators must obtain valid data relating to the contribution of each of their players in order to assess their level of performance in team sport competition. This information must also be collected and used in real game situations to be more valid. Developed initially for a physical education class context, the…

A study investigating the degree of agreement between teacher evaluators using a standard set of evaluation criteria and evaluation methods examines the test reliability of the Classroom Procedures Assessment Instrument, the Interpersonal Skills Assessment Instrument, and the Teaching Plans and Materials Assessment Instrument. Two statistical…

This study demonstrates that multiple matrix sampling procedures can be used to collect assessment data efficiently, unabstrusively, and reliably. (MB)

Data from the experimental functional analysis of challenging behaviors of 27 individuals with mental retardation were analyzed to assess agreement among three forms of interpretation. Results found that the methods of interpreting function from experimental assessment can give different results and that test-retest reliability of the experimental…

Assesses techniques used by researchers to collect and analyze data on how people with visual impairments or blindness learn, understand, and think about geographic space. Recommendations are made for increasing the validity of studies, including the use of multiple, mutually supportive tests; larger samples; and real-world environments.…

Fundamental problems in the collection and use of data, in particular the need to develop and use criteria for data, are discussed. Specific examples of the use and misuse of data related to teachers and children in the public schools are presented. Two methods of data collection--manifest techniques and formal response instruments--are evaluated…