Mining an English-Chinese parallel Dataset of Financial News. (18th March 2022)

• Record Type: Journal Article
• Authors: Turenne, Nicolas; Chen, Ziwei; Fan, Guitao; Li, Jianlong; Li, Yiwen; Wang, Siyuan; Zhou, Jiaqi
• Is Part Of: Journal of open humanities data. Volume 8(2022)
• Publication Date: 2022-03-18
• Subjects: English-Chinese -- text mining -- clustering -- classification -- patterns; Humanities -- Periodicals; 001.3
• DOI: 10.5334/johd.62
• Languages: English
• ISSNs: 2059-481X

Abstract

Parallel text datasets are a valuable for educational purposes, machine translation, and cross-language information retrieval, but few are domain-oriented. We have created a Chinese–English parallel dataset in the domain of finance technology, using the Financial Times website, from which we grabbed 60, 473 news items from between 2007 and 2021. This dataset is a bilingual Chinese–English parallel dataset of news in the domain of finance. It is open access in its original state without transformation, and has been made not for machine translation as has been used, but for intelligent mining, in which we conducted many experiments using up-to-date text mining techniques: clustering (topic modeling, community detection, k -means), topic prediction (naive Bayes, SVM, LSTM, Bert), and pattern discovery (dictionary based, time series). We present the usage of these techniques as a framework for other studies, not only as an application but with an interpretation.