Conducting high-quality overviews of reviews (OoR) is time-consuming. Because the quality of systematic reviews (SRs) varies, it is necessary to critically appraise SRs when conducting an OoR. A well-established appraisal tool is A Measurement Tool to Assess Systematic Reviews (AMSTAR) 2, which takes about 15-32 min per application. To save time,…

Learning performance data, such as correct or incorrect answers and problem-solving attempts in intelligent tutoring systems (ITSs), facilitate the assessment of knowledge mastery and the delivery of effective instructions. However, these data tend to be highly sparse (80%90% missing observations) in most real-world applications. This data…

The "Building Your Research Data Management Toolkit" was developed to provide introductory research data management skills training to liaisons in academic libraries. This paper assesses the participants' perceived change in knowledge, behaviors and attitudes as a result of participation in the RoadShow program. Long term changes in…

In 2012, this author published a paper describing a method for using the raw data from Web of Science to examine the journals cited by any given group of researchers and then compare that list to lists of 'top journals' of similar disciplines. It was not a straightforward method to use and required a great deal of effort and spreadsheet work by a…

Building on a study conducted by the authors, this article provides strategies for teaching data literacy and outlines the case-based teaching method as an effective way of developing data-literate teachers.

A multiple case study was designed to examine the components of data literacy used by formal and informal leaders to support the work of Data Teams. Nine formal leaders and ten informal leaders constituted the participants. One overarching central question and seven subquestions guided the research. The answer to the central question, How do…

This paper aims to illustrate how data visualization could be utilized to identify errors prior to modeling, using an example with multi-dimensional item response theory (MIRT). MIRT combines item response theory and factor analysis to identify a psychometric model that investigates two or more latent traits. While it may seem convenient to…

Interest in the regression discontinuity (RD) design as an alternative to randomized control trials (RCTs) has grown in recent years. There is little practical guidance, however, on conditions that would lead to a successful RD evaluation or the utility of studies with underpowered RD designs. This article describes the use of RD design to…

Data science is a broad, interdisciplinary field concerned with the extraction of knowledge or insights from data, with the classification of data as a core, fundamental task. One of the most persistent challenges faced when performing classification is the class imbalance problem. Class imbalance refers to when the frequency with which each class…

Parceling is referred to as a procedure for computing sums or average scores across multiple items. Parcels instead of individual items are then used as indicators of latent factors in the structural equation modeling analysis (Bandalos 2002, 2008; Little et al., 2002; Yang, Nay, & Hoyle, 2010). Item parceling may be applied to alleviate some…

Using effective assessment techniques can improve an instructor's understanding of student needs and support learner-centered classrooms. Evaluating student learning takes on a new meaning in online classroom environment where students and instructors do not share physical proximity. According to Garrison (2011), the assessment strategies used to…

This dissertation investigated citizen science, a tool that connects the public to the scientific community through research-based projects and education campaigns. Benefits include volunteers adding data to long-term data sets and improved scientific literacy among the public. Oftentimes, there is trepidation among scientists, managers, and…

For better or worse, many educational decisions that were once handled on a personal level by teachers or administrators now increasingly rely upon data and information. To be successful in this era, educators need to understand this broad sociotechnical revolution and how it is realigning traditional roles and responsibilities. In this book, the…

Although there is a strong legislative base and perceived efficacy for multidisciplinary team decision making, limited evidence supports its effectiveness or consistency of implementation in practice. In recent research, we used the Decision Observation, Recording, and Analysis (DORA) tool to document activities and adult behaviors during positive…

This "What Works Clearinghouse Procedures and Standards Handbook (Version 3.0)" provides a detailed description of the standards and procedures of the What Works Clearinghouse (WWC). The remaining chapters of this Handbook are organized to take the reader through the basic steps that the WWC uses to develop a review protocol, identify…