One of the substantive changes in the 2014 Standards for Educational and Psychological Testing was the elevation of fairness in testing as a foundational element of practice in addition to validity and reliability. Previous research indicates that testing practices often do not align with professional standards and guidelines. Therefore, to raise…

We describe an innovative automated test construction algorithm for building aligned achievement tests. By incorporating the algorithm into the test construction process, along with other test construction procedures for building reliable and unbiased assessments, the result is much more valid tests than result from current test construction…

How can fictitious websites fool so many people for so long? Most students at some time in their career are taught different flags to look for to try to ascertain the accuracy of a site. If one takes a look at most any list that teachers use to help students check on the credibility of a website, they seem to cover the same attributes. Is the…

In the past decade, American professional psychology has taken significant steps toward a unified statement of the competencies that define the practice of psychology, regardless of specialty. The purpose of this article is to explain the current competency initiative in professional psychology and examine its implications and potential impact on…

This article provides a personal perspective about the development of the seminal papers associated with the Community of Inquiry Framework. The framework and its construction are described. The main part of the paper explores the evolution of the framework and its associated methodology. Finally, research associated with the validation of the…

In this article, the authors describe an alignment and content analysis of the Wisconsin Alternate Assessment (WAA) for students with disabilities. The WAA is an assessment of the academic performance of students with significant disabilities and is an alternative to the traditional on-demand achievement test. Alternate assessments like the WAA…

CSCL research has given rise to a plethora of analysis methods, all with specific analysis goals, units of analysis, and for specific types of data (chat, threaded discussions, etc.). This article describes some challenges of CSCL-analysis. The development of an analysis method for negotiation processes in multidisciplinary teams serves as an…

The study of the consequences of evaluation, or more specifically of evaluation use or utilization, represents a significant portion of the body of research on evaluation. Much has been written on the evolution of the multidimensional concept of evaluation use, most recently the examination of consequences of evaluation that are not a function of…

Over the past 15 years, educational technologists have been dabbling with a research technique known as quantitative content analysis (QCA). Although it is characterized as a systematic and objective procedure for describing communication, readers find insufficient evidence of either quality in published reports. In this paper, it is argued that…

The authors describe the development of the Suicide Attempt Self-Injury Interview (SASII), an instrument designed to assess the factors involved in nonfatal suicide attempts and intentional self-injury. Using 4 cohorts of participants, authors generated SASII items and evaluated them with factor and content analyses and internal consistency…

Describes an approach to automatically classify and evaluate publicly accessible World Wide Web sites. Outlines a research methodology for model building and validation, develops a set of criteria for classifying Web sites, and compares manual versus automated evaluation. (Author/LRW)

Describes tools for measuring content of instruction, content of instructional materials, and alignment between them, reporting findings about use of these tools and possible additional uses for research and practice. Asserts that the validity of data produced using these tools is good. Sketches an agenda for future work to improve the quality and…

Examines the basic tenets of qualitative, or naturalistic, research methods in terms of their grounding in social science and their value to library and information science research. Topics discussed include the research problems; data collection, including interviews; data analysis, including content analysis; theory development; and ensuring…

Describes a list of attributes of instructional materials based on a review of instructional design literature that was validated and found reliable through a series of studies. Four categories of attributes are presented: (1) instructional design; (2) language, including semantic and syntactic structures; (3) presentation, including layout; and…

This paper describes content analysis as a data analysis technique useful for examining written or verbal communication within early intervention. The article outlines the use of referential or thematic recording units derived from interview data, identifies procedural guidelines, and addresses issues of rigor and validity. (Author/JDD)