Comparing "parallel passages" in digital archives. Issue 1 (16th September 2019)
- Record Type:
- Journal Article
- Title:
- Comparing "parallel passages" in digital archives. Issue 1 (16th September 2019)
- Main Title:
- Comparing "parallel passages" in digital archives
- Authors:
- Harris, Martyn
Levene, Mark
Zhang, Dell
Levene, Dan - Abstract:
- Abstract : Purpose: The purpose of this paper is to present a language-agnostic approach to facilitate the discovery of "parallel passages" stored in historic and cultural heritage digital archives. Design/methodology/approach: The authors explore a novel, and relatively simple approach, using a character-based statistical language model combined with a tailored version of the Basic Local Alignment Tool to extract exact and approximate string patterns shared between groups of documents. Findings: The approach is applicable to a wide range of languages, and compensates for variability in the text of the documents as a result of differences in dialect, authorship, language change over time and errors due to inaccurate transcriptions and optical character recognition errors as a result of the digitisation process. Research limitations/implications: A number of case studies demonstrate that the approach is practical and generalisable to a wide range of archives with documents in different languages, domains and of varying quality. Practical implications: The approach described can be applied to any digital archive of modern and contemporary texts. This makes the approach applicable to digital archives recording historic texts, but also those composed of more recent news articles, for example. Social implications: The analysis of "parallel passages" enables researchers to quantify the presence and extent of text-reuse in a collection of documents, which can provide useful data onAbstract : Purpose: The purpose of this paper is to present a language-agnostic approach to facilitate the discovery of "parallel passages" stored in historic and cultural heritage digital archives. Design/methodology/approach: The authors explore a novel, and relatively simple approach, using a character-based statistical language model combined with a tailored version of the Basic Local Alignment Tool to extract exact and approximate string patterns shared between groups of documents. Findings: The approach is applicable to a wide range of languages, and compensates for variability in the text of the documents as a result of differences in dialect, authorship, language change over time and errors due to inaccurate transcriptions and optical character recognition errors as a result of the digitisation process. Research limitations/implications: A number of case studies demonstrate that the approach is practical and generalisable to a wide range of archives with documents in different languages, domains and of varying quality. Practical implications: The approach described can be applied to any digital archive of modern and contemporary texts. This makes the approach applicable to digital archives recording historic texts, but also those composed of more recent news articles, for example. Social implications: The analysis of "parallel passages" enables researchers to quantify the presence and extent of text-reuse in a collection of documents, which can provide useful data on author style, text genres and cultural contexts. Originality/value: The approach is novel and addresses a need by humanities researchers for tools that can identify similar documents and local similarities represented by shared text sequences in a potentially vast large archive of documents. As far as the authors are aware, there are no tools currently exist that provide the same level of tolerance to the language of the documents. … (more)
- Is Part Of:
- Journal of documentation. Volume 76:Issue 1(2020)
- Journal:
- Journal of documentation
- Issue:
- Volume 76:Issue 1(2020)
- Issue Display:
- Volume 76, Issue 1 (2020)
- Year:
- 2020
- Volume:
- 76
- Issue:
- 1
- Issue Sort Value:
- 2020-0076-0001-0000
- Page Start:
- 271
- Page End:
- 289
- Publication Date:
- 2019-09-16
- Subjects:
- Digital libraries -- Computer applications -- Archives -- Linguistics -- Probabilistic analysis -- Language and literature
Documentation -- Periodicals
Library science -- Periodicals
025 - Journal URLs:
- http://firstsearch.oclc.org ↗
http://www.emeraldinsight.com/journals.htm?issn=0022-0418 ↗
http://www.emeraldinsight.com/ ↗ - DOI:
- 10.1108/JD-10-2018-0175 ↗
- Languages:
- English
- ISSNs:
- 0022-0418
- Deposit Type:
- Legaldeposit
- View Content:
- Available online (eLD content is only available in our Reading Rooms) ↗
- Physical Locations:
- British Library DSC - 4970.000000
British Library DSC - BLDSS-3PM
British Library HMNTS - ELD Digital store - Ingest File:
- 22085.xml