A Reproducible IT-Blog Corpus. (22nd July 2021)

• Record Type: Journal Article
• Authors: Barbaresi, Adrien; Pohlmann, Jens
• Is Part Of: Journal of open humanities data. Volume 7(2021)
• Publication Date: 2021-07-22
• Subjects: web blogs -- corpus linguistics -- internet policy -- discourse analysis -- public discussion -- freedom of expression; Humanities -- Periodicals; 001.3
• DOI: 10.5334/johd.35
• Languages: English
• ISSNs: 2059-481X

Abstract

The dataset comprises text and metadata extracted from several hundred IT-blogs and websites, along with a method to duplicate the data by updating its contents and downloading it to the user's local machine. The targets have been hand-picked with the intention to represent the discourse on blogs and websites dedicated to questions at the intersection of technology and society from Germany and the United States of America. The texts have been retrieved by web crawling techniques. The resulting corpus is accessible through a search platform and also reproducible with freely accessible descriptors and software.