We present two types of validity evidence to support inferences and decisions about use of easyCBMs in relation to state testing programs. The first type involves the use of Benchmarks in reading to use in making predictions of performance on the Smarter Balanced (SB) test. These predictions can be made both well in advance (several months) or…

The aim of this paper is to propose an analytical framework of disciplinary learning outcomes that will facilitate our understanding of the nature of disciplines and their relationships. Application of the draft analytical framework, Anderson and Krathwohl's "Taxonomy of Educational Objectives" to engineering learning outcome reference…

We examined which of two instruments (Text Reading and Comprehension inventory [TRC] or a traditional informal reading inventory [IRI]) provides the more valid assessment of a primary-grade student's reading instructional level. The TRC is currently the required, benchmark reading assessment for students in grades K-3 in the state of North…

The factorial survey is an experimental design consisting of varying situations (vignettes) that have to be judged by respondents. For more complex research questions, it quickly becomes impossible for an individual respondent to judge all vignettes. To overcome this problem, random designs are recommended most of the time, whereas quota designs…

Randomized experiments have long been established as the gold standard for addressing causal questions. However, experiments are not always feasible or desired, so observational methods are also needed. When multiple observations on the same variable are available, a repeated measures design may be used to assess whether a treatment administered…

Regression discontinuity design (RD) has been widely used to produce reliable causal estimates. Researchers have validated the accuracy of RD design using within study comparisons (Cook, Shadish & Wong, 2008; Cook & Steiner, 2010; Shadish et al, 2011). Within study comparisons examines the validity of a quasi-experiment by comparing its…

This paper describes a statistical linking between the 2011 National Assessment of Educational Progress (NAEP) in Grade 4 reading and the 2011 Progress in International Reading Literacy Study (PIRLS) in Grade 4 reading. The primary purpose of the linking study is to obtain a statistical comparison between NAEP (a national assessment) and PIRLS (an…

Organizations continue to rely on password-based authentication methods to control access to many Web-based systems. This research study developed a benchmarking instrument intended to assess authentication methods used in Web-based information systems (IS). It developed an Authentication Method System Index (AMSI) to analyze collected data from…

The current study proposed to determine the level of spiritual transformation in students at conservative Wesleyan-Arminian Bible colleges and the association of spiritual transformation with selected Bible college activities. A quantitative survey was designed, validated, and implemented to measure students' self-reported levels of spiritual…

In the past decade, American professional psychology has taken significant steps toward a unified statement of the competencies that define the practice of psychology, regardless of specialty. The purpose of this article is to explain the current competency initiative in professional psychology and examine its implications and potential impact on…

Dialectical behavior therapy (DBT) has been shown to be effective in randomized controlled trials with women with borderline personality disorder and histories of chronic self-inflicted injury including suicide attempts. The present study is a pre-post replication of a comprehensive DBT program in a community mental health center for individuals…

The purpose of this study was to compare different statistical and methodological approaches to standard setting and determining cut scores using R-CBM and performance on high-stakes tests. One thousand seven hundred and sixty-six students were followed longitudinally from first through third grades using R-CBM benchmark assessment. In addition,…

This study is an examination of the test results of 90 academically oriented adult participants on the Test of English as a Foreign Language (TOEFL) and the Canadian Language Benchmarks Assessment (CBLA), to determine the comparability of performance on the two tests and the possibility of using two tests in the academic admissions process for…

Training indicators are functional suites of quantitative and qualitative indicators of current or future vocational education and training (VET) supply and demand. The training indicators approach to educational planning considers indicators of present and likely future conditions for skilled labor and forms judgments about the most appropriate…