Content Analysis of Textbooks via Natural Language Processing: Findings on Gender, Race, and Ethnicity in Texas U.S. History Textbooks. (July 2020)

• Record Type: Journal Article
• Authors: Lucy, Li; Demszky, Dorottya; Bromley, Patricia; Jurafsky, Dan
• Is Part Of: AERA open. Volume 6:Number 3(2020)
• Publication Date: 2020-07
• Subjects: artificial intelligence -- case studies -- content analysis -- curriculum -- data science -- gender studies -- history -- natural language processing -- race -- textbooks -- textual analysis; Education -- Research -- Periodicals; 370.7205
• DOI: 10.1177/2332858420940312
• Languages: English
• ISSNs: 2332-8584

Abstract

Cutting-edge data science techniques can shed new light on fundamental questions in educational research. We apply techniques from natural language processing (lexicons, word embeddings, topic models) to 15 U.S. history textbooks widely used in Texas between 2015 and 2017, studying their depiction of historically marginalized groups. We find that Latinx people are rarely discussed, and the most common famous figures are nearly all White men. Lexicon-based approaches show that Black people are described as performing actions associated with low agency and power. Word embeddings reveal that women tend to be discussed in the contexts of work and the home. Topic modeling highlights the higher prominence of political topics compared with social ones. We also find that more conservative counties tend to purchase textbooks with less representation of women and Black people. Building on a rich tradition of textbook analysis, we release our computational toolkit to support new research directions.