NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1472352
Record Type: Journal
Publication Date: 2025-May
Pages: 14
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1368-2822
EISSN: EISSN-1460-6984
Available Date: 2025-05-23
Treatment Fidelity in a Feasibility Trial of the Aphasia Intervention, Virtual Elaborated Semantic Feature Analysis
Niamh Devane1; Sofia Mazzoleni2; Nicholas Behn1; Jane Marshall1; Stephanie Wilson3; Katerina Hilari1
International Journal of Language & Communication Disorders, v60 n3 e70054 2025
Background and Aims: The reliability and validity of an intervention can be improved by checking treatment fidelity (TF). TF methods identify core components of an intervention, check their presence (or absence) and identify threats to fidelity. The Virtual Elaborated Semantic Feature Analysis (VESFA) intervention comprised individual sessions of word-finding treatment and group sessions of conversation practice. All sessions were delivered in the virtual world of EVA Park. This paper describes the TF in the VESFA trial that explored (1) if the treatment was delivered as planned, (2) which components influenced treatment adherence scores and (3) the reliability of the fidelity checklists. Methods and Procedures: Strategies to improve fidelity were employed in the study design, the delivery of treatment, treatment receipt and treatment enactment. Two fidelity checklists were developed with input from advisors with aphasia to establish the core components of the intervention (individual and group). During the trial, treatment sessions were video-recorded. A sample of 20% of sessions was randomly selected for adherence rating. Seven research students were trained to rate the videos using the fidelity checklists. Inter- and intra-rater reliability was established. Outcomes and Results: Study design strategies ensured 94% of sessions ran as planned and 75% of participants (12/16) received over 90% (>36/40h) of the intended dose. The average TF across all sessions rated was 81%, demonstrating a high degree of fidelity in the delivery of the VESFA intervention. The fidelity of the individual sessions was lower (78%) than the group elements (84%). The components that most threatened treatment adherence were (1) providing a rationale for the activities and (2) specific feedback for performance. Nevertheless, participants consistently practised target words both in individual sessions and in conversations in the group sessions, demonstrating treatment receipt. Ninety-four percent of participants (14/15) reported the words and phrases practiced in EVA Park were used in real-world conversations, indicating treatment enactment. The fidelity checklists were reliable: Inter-rater reliability was moderate (average Kappa of 0.76) and intra-rater reliability was strong (average Kappa of 0.89). Conclusions and Implications: A range of TF strategies were embedded within the trial protocol leading to high adherence to the core components of the VESFA intervention. Findings add to the evidence that aphasia therapies can be administered faithfully within the virtual environment of EVA Park.
Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: 1Department of Language and Communication Science, City St George's, University of London, London, UK; 2East London NHS Foundation Trust, London, UK; 3Centre for Human-Computer Interaction Design, City St George's, University of London, London, UK