Construction and evaluation of gold standards for patent classification—A case study on quantum computing. (June 2020)

• Record Type: Journal Article
• Authors: Harris, Steve; Trippe, Anthony; Challis, David; Swycher, Nigel
• Is Part Of: World patent information. Volume 61(2020)
• Publication Date: 2020-06
• Subjects: Patent classification -- Evaluation -- Artificial intelligence -- Information retrieval -- Deep learning -- Gold standard; Patent literature -- Periodicals; Information storage and retrieval systems -- Patent documentation -- Periodicals; 608.05
• DOI: 10.1016/j.wpi.2020.101961
• Languages: English
• ISSNs: 0172-2190

Abstract

Abstract: This article discusses options for evaluation of patent and/or patent family classification algorithms by means of "gold standards". It covers the creation criteria, and desirable attributes of evaluation mechanisms, then proposes an example gold standard, and discusses the results of applying the evaluation mechanism against the proposed gold standard and an existing commercial implementation.