ERIC Number: EJ1281916
Record Type: Journal
Publication Date: 2021-Feb
Pages: 36
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0049-1241
EISSN: N/A
Available Date: N/A
The Future of Coding: A Comparison of Hand-Coding and Three Types of Computer-Assisted Text Analysis Methods
Nelson, Laura K.; Burk, Derek; Knudsen, Marcel; McCall, Leslie
Sociological Methods & Research, v50 n1 p202-237 Feb 2021
Advances in computer science and computational linguistics have yielded new, and faster, computational approaches to structuring and analyzing textual data. These approaches perform well on tasks like information extraction, but their ability to identify complex, socially constructed, and unsettled theoretical concepts--a central goal of sociological content analysis--has not been tested. To fill this gap, we compare the results produced by three common computer-assisted approaches--dictionary, supervised machine learning (SML), and unsupervised machine learning--to those produced through a rigorous hand-coding analysis of inequality in the news (N = 1,253 articles). Although we find that SML methods perform best in replicating hand-coded results, we document and clarify the strengths and weaknesses of each approach, including how they can complement one another. We argue that content analysts in the social sciences would do well to keep all these approaches in their toolkit, deploying them purposefully according to the task at hand.
Descriptors: Coding, Content Analysis, Computer Use, Artificial Intelligence, Dictionaries, News Media, Social Science Research, Accuracy, Automation
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A