Classification and evaluation of IoT brokers: A methodology. Issue 3 (19th June 2020)

• Record Type: Journal Article
• Authors: Bertrand‐Martinez, Eddas; Dias Feio, Phelipe; Brito Nascimento, Vagner de; Kon, Fabio; Abelém, Antônio
• Other Names: Moraes Igor Monteiro guestEditor.; Albuquerque Célio guestEditor.; Ziviani Artur guestEditor.
• Is Part Of: International journal of network management. Volume 31:Issue 3(2021)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2020-06-19
• Subjects: Computer networks -- Management -- Periodicals; 004.6
• DOI: 10.1002/nem.2115
• Languages: English
• ISSNs: 1055-7148

Abstract

Summary: Since the term Internet of Things (IoT) was coined by Kevin Ashton in 1999, a number of middleware platforms have been developed to cope with important challenges such as the integration of different technologies. In this context of heterogeneous technologies, IoT message brokers become critical elements for the proper function of smart systems and wireless sensor networks (WSN) infrastructures. There are several evaluations made on IoT messaging middleware performance. Nevertheless, most of them ignore crucial aspects of the IoT context that also need to be included, such as reliability and other qualitative aspects. Thus, in this article, we propose a methodology for classification and evaluation of IoT brokers to help the scientific community and technology industry on evaluating them according to their interests, without leaving out important aspects for the context of smart environments. Our methodology bases its qualitative evaluations on the ISO/IEC 25000 (SQuaRE) set of standards and its quantitative evaluations on Jain's process for performance evaluation. We developed a case study to illustrate our proposal with 12 different open‐source brokers, validating the feasibility of our methodological approach. Abstract : This work defines a methodology for software quality evaluation of message brokers for Internet of Things. It provides also a theoretical framework for scientists to develop their own metrics system to evaluate quality in IoT middleware, and showcases a practical implementation of the methodology in order to make it more didactic.