Studying Terrorism Empirically: What We Know About What We Don't Know. (August 2017)

• Record Type: Journal Article
• Authors: Safer-Lichtenstein, Aaron; LaFree, Gary; Loughran, Thomas
• Other Names: LaFree Gary guest-editor.; Freilich Joshua D. guest-editor.
• Is Part Of: Journal of contemporary criminal justice. Volume 33:Number 3(2017:Aug.)
• Page Start: 273
• Page End: 291
• Publication Date: 2017-08
• Subjects: point identification -- no assumption bounds -- data validity -- missing data -- domestic extremism -- terrorism data; Criminal justice, Administration of -- Periodicals; Criminal justice, Administration of -- United States -- Periodicals; 364.973
• DOI: 10.1177/1043986217697873
• Languages: English
• ISSNs: 1043-9862

Abstract

Although the empirical and analytical study of terrorism has grown dramatically in the past decade and a half to incorporate more sophisticated statistical and econometric methods, data validity is still an open, first-order question. Specifically, methods for treating missing data often rely on strong, untestable, and often implicit assumptions about the nature of the missing values. We draw on Manski's idea of no-assumption bounds to demonstrate the vulnerability of empirical results to different tactics for treating missing cases. Using a recently available open-source database on political extremists who radicalized in the United States, we show how point estimates of basic conditional probabilities can vary dramatically depending on the amount of missing data in certain variables and the methods used to address this issue. We conclude by advocating for researchers to be transparent when building analytical models about the assumptions they are making about the nature of the data and their implications for the analysis and its interpretation.