Which similarity measure to use in network analysis: Impact of sample size on phi correlation coefficient and Ochiai index. (December 2020)

• Record Type: Journal Article
• Authors: Kalgotra, Pankush; Sharda, Ramesh; Luse, Andy
• Is Part Of: International journal of information management. Volume 55(2020)
• Publication Date: 2020-12
• Subjects: Implicit network -- Analytics -- Comorbidity network -- Sample size -- Inferred network -- Ochiai coefficient -- Phi correlation coefficient; Social sciences -- Information services -- Periodicals; Social sciences -- Research -- Periodicals; Information science -- Periodicals; Management information systems -- Periodicals; Knowledge management -- Periodicals; Sciences sociales -- Documentation, Services de -- Périodiques; Sciences sociales -- Recherche -- Périodiques; Sciences de l'information -- Périodiques; Systèmes d'information de gestion -- Périodiques; Information science; Management information systems; Social sciences -- Information services; Social sciences -- Research; Periodicals; Electronic journals; 025.52068
• DOI: 10.1016/j.ijinfomgt.2020.102229
• Languages: English
• ISSNs: 0268-4012

Abstract

Highlights: Studied the impact of sample size on an implicit network inferred using Phi Correlation coefficient and Ochiai coefficient. Illustrated using a network of diseases developed using 22.1 Million patient records. Found Ochiai coefficient to be less sensitive to the sample size than Phi Correlation coefficient. The betweenness centrality was most affected by the sample size. Abstract: Some networks are explicit where members make direct connections (e.g. Facebook network), whereas other networks are implicit (e.g. co-citation network) in which an edge between two nodes is inferred using a similarity index. Choosing the right index to infer connections in an implicit/inferred network is important because conclusions can be biased if a network does not represent true relationships. In this study, we compared two indexes: Phi Correlation Coefficient ( PCC ) and Ochiai Coefficient ( Och ) based on their sensitivity to the sample size of transactions from where the network is inferred. For demonstration, we used an implicit network, called a comorbidity network, developed from health records of 22.1 million patients. The networks were compared based on their overall topologies and node centralities. Results showed that the network formed using Och was more robust to the sample size than PCC . The network using Och followed a small-world topology irrespective of the sample size whereas the structure of a network using PCC was inconsistent. Regarding node centralities, the betweenness centrality was most affected by the sample size. Our results lead us to recommend Och over PCC .