Since 2018, colleagues from two research centers at Dublin City University have been collaborating to develop a measurement scale to assess individuals' ability to identify workplace bullying. Having agreed on an operational definition of the construct, an item pool of 26 workplace bullying scenarios, that is, short descriptions of…

This case study discusses an investigation to develop and validate a survey designed to obtain information on practitioner self-reported knowledge, use, and perceived effectiveness of recommended classroom-based practices for the inclusive instruction of students receiving special education services for Emotional Disturbance. First, students will…

My study focused on developing an instrument to resolve a problem of practice in my organization: How to accurately match individuals' preferences with projects. Other project leaders and I had already identified four 'types' of project preferences. My study used those constructs and their defining characteristics to develop a new instrument: The…

In 2007, while pursuing my doctoral degree, I (Baoshan Zhang) embarked on a study to develop a scale for measuring state self-monitoring. Although a Self-Monitoring Scale had been developed in 1974 to measure stable individual characteristics, the measure could be inadequate for examining the short-term self-monitoring elicited by certain social…

In this study, we provide a detailed account of processes involved in applying structural equation modelling to validate a survey instrument -- the students' view of mathematics instrument -- in a new cultural setting. First, we tested the factorial validity of the instruments in Ghana for 12th-grade students (N = 2034, M = 18.49, standard…

While working for the Youth Offending Service, I used a range of interventions with young people to help reduce their likelihood of reoffending. I became concerned that some of these interventions required the young people to have a higher appreciation of their own (and others') emotions than they appeared able to demonstrate. I felt that this…

This presentation summarizes a pilot study conducted after the May 2011 administration of the AP Environmental Science Exam. The study used analytical methods based on scaled anchoring as input to a Performance Level Descriptor validation process that solicited systematic input from subject matter experts.

This is a keynote presentation given at AERA on developing a validity agenda for growth models in a large scale (e.g., state) setting. The emphasis of this presentation was to indicate that growth models and the validity agenda designed to provide evidence in supporting the claims to be made need to be personalized to meet the local or…

[Slides] presented at the annual conference of the Southern Association for College Admission Counseling, April 2010. This presentation summarizes recent research from the national SAT Validity Study and includes information on the Admitted Class Evaluation Service (ACES) system and how ACES can help institutions conduct their own validity…

Developing a cognitive model of task performance is an important and often overlooked phase in assessment design; failing to establish such a model can threaten the validity of the inferences made from the scores produced by an assessment (e.g., Leighton, 2004). Conducting think aloud interviews (TAIs), where students think aloud while completing…

Presented at the 23rd Annual Historically Black Colleges & Universities (HBCU) Conference in Atlanta, GA, in September 2011. Admitted Class Evaluation Service (ACES) is the College Board's free online service that predicts how admitted students will perform at a college or university generally, and how successful students will be in specific…

Presented at the College Board National Forum in Washington, D.C., October 2010. This presentation examines the recent national validity evidence that supports the use of SAT Writing in college admissions and English placement. Additionally it includes information on the College Board's free online Admitted Class Evaluation Service (ACES) system,…

The current study will explore the validity and potential of using the SAT, in conjunction with HSGPA, to arrive at a predicted FYGPA to improve student retention at four-year postsecondary institutions. Specifically, this study examined whether college students who did not perform as expected (observed FYGPA minus predicted FYGPA) were more…

Presented at the national conference for the American Educational Research Association (AERA) in April 2009. This study examined the utility of scores on the SAT writing test, specifically examining the reliability of scores using generalizability and item response theories. The study also provides an overview of current predictive validity…

This presentation was presented at the 2011 National Conference on Student Assessment (CCSSO). The focus of this presentation is how to validate the common core state standards (CCSS) in math and ELA and the subsequent assessments that will be developed by state consortia. The CCSS specify the skills students need to be ready for post-secondary…