IoT Big Data provenance scheme using blockchain on Hadoop ecosystem

Simple item page
dc.citation.issue1
dc.citation.volume8
dc.contributor.authorHonar Pajooh H
dc.contributor.authorRashid MA
dc.contributor.authorAlam F
dc.contributor.authorDemidenko S
dc.date.available30/08/2021
dc.date.issued2021-12
dc.description© The Author(s), 2021. Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the mate rial. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http:// creativecommons.org/licenses/by/4.0/
dc.description.abstractThe diversity and sheer increase in the number of connected Internet of Things (IoT) devices have brought significant concerns associated with storing and protecting a large volume of IoT data. Storage volume requirements and computational costs are continuously rising in the conventional cloud-centric IoT structures. Besides, dependencies of the centralized server solution impose significant trust issues and make it vulnerable to security risks. In this paper, a layer-based distributed data storage design and implementation of a blockchain-enabled large-scale IoT system are proposed. It has been developed to mitigate the above-mentioned challenges by using the Hyperledger Fabric (HLF) platform for distributed ledger solutions. The need for a centralized server and a third-party auditor was eliminated by leveraging HLF peers performing transaction verifications and records audits in a big data system with the help of blockchain technology. The HLF blockchain facilitates storing the lightweight verification tags on the blockchain ledger. In contrast, the actual metadata are stored in the off-chain big data system to reduce the communication overheads and enhance data integrity. Additionally, a prototype has been implemented on embedded hardware showing the feasibility of deploying the proposed solution in IoT edge computing and big data ecosystems. Finally, experiments have been conducted to evaluate the performance of the proposed scheme in terms of its throughput, latency, communication, and computation costs. The obtained results have indicated the feasibility of the proposed solution to retrieve and store the provenance of large-scale IoT data within the Big Data ecosystem using the HLF blockchain. The experimental results show the throughput of about 600 transactions, 500 ms average response time, about 2–3% of the CPU consumption at the peer process and approximately 10–20% at the client node. The minimum latency remained below 1 s however, there is an increase in the maximum latency when the sending rate reached around 200 transactions per second (TPS).
dc.description.publication-statusPublished
dc.identifierhttp://gateway.webofknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&KeyUT=WOS:000692404600002&DestLinkType=FullRecord&DestApp=ALL_WOS&UsrCustomerID=c5bb3b2499afac691c2e3c1a83ef6fef
dc.identifierARTN 114
dc.identifier.citationJOURNAL OF BIG DATA, 2021, 8 (1)
dc.identifier.doi10.1186/s40537-021-00505-y
dc.identifier.eissn2196-1115
dc.identifier.elements-id448228
dc.identifier.harvestedMassey_Dark
dc.identifier.urihttps://hdl.handle.net/10179/16583
dc.publisherBioMed Central Ltd
dc.relation.isPartOfJOURNAL OF BIG DATA
dc.relation.urihttps://journalofbigdata.springeropen.com/articles/10.1186/s40537-021-00505-y
dc.subjectInternet of Things
dc.subjectHyperledger fabric
dc.subjectBlockchain
dc.subjectBig Data
dc.subjectData provenance
dc.subjectHadoop
dc.subjectTraceability
dc.subject.anzsrc08 Information and Computing Sciences
dc.titleIoT Big Data provenance scheme using blockchain on Hadoop ecosystem
dc.typeJournal article
pubs.notesNot known
pubs.organisational-group/Massey University
pubs.organisational-group/Massey University/College of Sciences
pubs.organisational-group/Massey University/College of Sciences/School of Food and Advanced Technology
Files
Collections
Journal Articles