BERT-based Contextual Semantic analysis for English Preposition Error Correction. (December 2020)

• Record Type: Journal Article
• Authors: Huang, Guimin; Wang, Jiahao; Tang, Hui; Ye, Xuan
• Is Part Of: Journal of physics. Volume 1693(2020)
• Publication Date: 2020-12
• Subjects: Physics -- Congresses; 530.5
• DOI: 10.1088/1742-6596/1693/1/012115
• Languages: English
• ISSNs: 1742-6588

Abstract

Abstract: In the writing of English as a Second Language (ESL) learners, preposition related errors account for nearly 30 percent in the all grammatical errors (Bitchener et al. 2005) [1] . Unlike verbs and nouns, isolated preposition does not mean anything, but in different contexts, prepositions usually have different meanings so that ESL students hardly master how to use all prepositions correctly. In this publication, we present a preposition error correction (PEC) model based BERT (Devlin et al., 2018) [2] which contains rich contextual semantic information, fine-tuned BERT models to intensify sentence semantic in output, and calculate the preposition matching scores according to the formula.