The challenges experienced in measurement and evaluation during the distance education process among student and instructor groups are discussed in the study. A qualitative meta-synthesis method is used in this research. Twenty studies were included in the meta-synthesis. The challenges experienced by the instructors are program utilization,…

Scientific inquiry ability is closely related to the process of hands-on inquiry practice. However, its assessment is often separated from this practice due to the limitation of technical basis and labor cost. The development of multimodal data analysis provides a new opportunity to realize automated assessment based on hands-on practice.…

Creativity is highly valued in both education and the workforce, but assessing and developing creativity can be difficult without psychometrically robust and affordable tools. The open-ended nature of creativity assessments has made them difficult to score, expensive, often imprecise, and therefore impractical for school- or district-wide use. To…

A multistage adaptive testing (MST) design was implemented for the Programme for the International Assessment of Adult Competencies (PIAAC) starting in 2012 for about 40 countries and has been implemented for the 2018 cycle of the Programme for International Student Assessment (PISA) for more than 80 countries. Using examples from PISA and PIAAC,…

Various instruments for assessing metacognitive skills and strategy use exist. Off-line self-reports are questionnaires and interviews administered either before or after task performance, while on-line measures are gathered during task performance through thinking aloud or observation. Multi-method studies in reading have shown that off-line…

This article represents one outcome from the "Invitational Research Symposium on Technology-Enabled and Universally Designed Assessments," which examined technology-enabled assessments (TEA) and universal design (UD) as they relate to students with disabilities (SWD). It was developed to stimulate research into TEAs designed to better understand…

This comparative study examined the degree of similarity between the results of the Self-Directed Search and an online career assessment. Implications for career counselors, based on the results, are briefly discussed.

There are eight commercially available computer-based test interpretations (CBTIs) for the Minnesota Multiphasic Personality Inventory-2 (MMPI-2), of which few have been empirically evaluated. Prospective users of these programs have little scientific data to guide choice of a program. This study compared ratings of these eight CBTIs. Test users…

Background: This study describes the development of the Brief Child and Family Phone Interview (BCFPI)--a computer-assisted telephone interview which adapts the revised Ontario Child Health Study's (OCHS-R) parent, teacher, and youth self-report scales for administration as intake screening and treatment outcome measures in children's mental…

Background: This study examines the use of the Brief Child and Family Phone Interview (BCFPI) to screen for childhood psychiatric disorder based on Diagnostic Interview Schedule for Children Version IV (DISC-IV) classifications of attention-deficit hyperactivity disorder (ADHD), oppositional defiant disorder (ODD), conduct disorder (CD),…

The Flesch readability index yields meaningful information about the responses of readers to texts. Because the formula is so simple, a group of English teachers wrote a program in BASIC that would count some obvious surface features of a text and calculate Flesch scores. Among the programing problems encountered were counting words (taking into…

A way to assess knowledge acquired through simulation-based learning (intuitive knowledge) is presented. A "WHAT-IF" test item format is developed, and two pilot studies involving 74 college students responding to WHAT-IF items are described. The tests did tap improvement in learning, although test validity was only partially supportive.…

This study compared retrospective reports of childhood sexual and physical abuse as assessed by two measures: the Childhood Trauma Questionnaire (CTQ), which uses a Likert-type scaling approach, and the Computer Assisted Maltreatment Inventory (CAMI), which employs a behaviorally specific means of assessment. Participants included 1,195…

Increased demands for colleges and universities to engage in outcomes assessment for accountability purposes have accelerated the need to bridge the gap between higher education practice and the fields of measurement, assessment, and evaluation. The "Handbook on Measurement, Assessment, and Evaluation in Higher Education" provides higher…

A computer-delivered problem-solving task based on cognitive research literature was developed and its validity for graduate admissions assessment was studied with 107 undergraduates. Use of the test, which asked examinees to sort word-problem stems by prototypes, was supported by the findings. (SLD)