In search of disruptive ideas: outlier detection techniques in crowdsourcing innovation platforms. (10th October 2019)

• Record Type: Journal Article
• Authors: Westerski, Adam; Kanagasabai, Rajaraman
• Is Part Of: International journal of Web based communities. Volume 15:Number 4(2019)
• Page Start: 344
• Page End: 367
• Publication Date: 2019-10-10
• Subjects: idea management -- disruptive innovation -- outlier detection -- data analytics -- innovation management -- open innovation systems -- crowdsourcing; Online social networks -- Periodicals; Social media -- Periodicals; World Wide Web -- Periodicals; 302.30285
• Languages: English
• ISSNs: 1477-8394

Abstract

The key challenge for data science in open innovation web systems is to find best ideas among thousands of community submissions. To date, this has been done with metrics reflecting enterprise needs or community preferences. This article proposes to look in a different direction: inspired by theoretical studies on disruptive innovation, we frame the problem of valuable ideas as those rarely taken up by masses or organisations yet having potential to change industries. Our aim is to find technological means for automatic detection of such innovations to aid decision making. Following past findings from business sciences on nature of disruptive innovations, the article presents a comparative study of multiple outlier detection algorithms applied to two real-world datasets containing textual descriptions of ideas for different industries. Obtained results demonstrate capability of outlier detection and show k-NN algorithm with TF-IDF and cosine distance to be the best candidate for the task.