Abstract
The current development and growth in the social and industrial sectors have evolved the use of sensing and smart devices, collectively called the Internet of Things (IoT). Huge volume of information being produced and collected by these IoT devices is also called Big Data, which needs to be managed, processed, and analyzed for the development of the social sector such as health care, education and smart community, and industrial sectors like manufacturing and production. Big Data analytics and processing have contributed to the advancement of society as well as improved the industrial processes. High speed and continuous sensing generate huge volumes of complex data, and processing and analyzing these data in a certain time limit is a big challenge. For a real-time decision-making and monitoring system, data processing and analysis are challenging due to limited computational, communicational, and storage resources. Big Data analytics and processing tools can be applied over these massive data as per the type of application and outcome required. Different types of applications need to be supported by a variety of tools based on different principles and approaches. Big Data is a set of voluminous and heterogeneous information in a coordinate, semi-structured, and unstructured form. Modern innovation in machine learning (ML), deep learning (DL), and artificial intelligence (AI) fulfills the requirement of Big Data analytics processing for advanced real-time decision-making, monitoring, and controlling systems. Classification and processing of stream of data generated by sensing devices help predict future insights. It identifies information required to control and monitor decisions for an individual, a society, an organization, and an industrial application. In this chapter, we discuss the algorithm, principal tools, and technologies required for Big Data analytics and processing over data gathered by different sensing and Internet of Things devices.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Yaqoob, I., Hashem, I. A. T., Gani, A., Mokhtar, S., Ahmed, E., Anuar, N. B., & Vasilakos, A. V. (2016). Big data: From beginning to future. International Journal of Information Management, 36(6), 1231–1247.
https://www.soracom.io/blog/what-is-the-relationship-between-iot-and-big-data/
Gantz, J., & Reinsel, D. (2011). Extracting value from chaos. IDC iView, 1142, 1–12.
http://www.businessinsider.com/how-the-internet-ofthings-market-will-grow-2014-10
Golchha, N. (2015). Big Data–The information revolution. IJAR, 1(12), 791–794.
Tsai, C.-W., et al. (2015). Big data analytics: A survey. Journal of Big Data, 2(1), 1–32.
Al Nuaimi, E., et al. (2015). Applications of big data to smart cities. Journal of Internet Services and Applications, 6, 25.
Kambatla, K., et al. (2014). Trends in big data analytics. Journal of Parallel and Distributed Computing, 74(7), 2561–2573.
Borkar, V., Carey, M. J., & Li, A. C. Inside “big data management”: Ogres, onions, or parfaits? In Proceedings of the 15th international conference on extending database technology, EDBT ‘12, 2012 (pp. 3–14). ACM.
Gani, A., et al. (2016). A survey on indexing techniques for big data: Taxonomy and performance evaluation. Knowledge and Information Systems, 46(2), 241–284.
Kwon, O., Lee, N., & Shin, B. (2014). Data quality management, data usage experience and acquisition intention of big data analytics. International Journal of Information Management, 34(3), 387–394.
Mital, R., Coughlin, J., & Canaday, M. (2015). Using big data technologies and analytics to predict sensor anomalies. In S. Ryan (Ed.), Proceedings of the advanced Maui optical and space surveillance technologies conference, held in Wailea, Maui, Hawaii, September 15–18, 2014 (p. id. 84). The Maui Economic Development Board.
Oswal, S., & Koul, S. (2013). Big data analytic and visualization on mobile devices. In Proceedings of national conference on New Horizons in ITNCNHIT.
Candela, L., Castelli, D., & Pagano, P. (2012). Managing big data through hybrid data infrastructures. ERCIM News, 89, 37–38.
Menon, A. (2012). Big data@ facebook. In Proceedings of the 2012 workshop on management of big data systems (pp. 31–32). ACM.
Boellstorff, T. (2015). Coming of age in second life: An anthropologist explores the virtually human. Princeton University Press.
Silva, T. H., Vaz De Melo, P. O. S., Almeida, J. M., & Loureiro, A. A. F. (2014). Large-scale study of city dynamics and urban social behavior using participatory sensing. IEEE Wireless Communications, 21(1), 42–51.
Su, T., Zhu, C., Lv, Z., Liu, C., & Li, X. (2016). Multi-dimensional visualization of large-scale marine hydrological environmental data. Advances in Engineering Software, 95, 7–15.
Bashir, M. R., & Gill, A. Q. (2016). Towards an iot big data analytics framework: Smart buildings systems. In High performance computing and communications; IEEE 14th international conference on smart city; IEEE 2nd international conference on data science and systems (HPCC/SmartCity/DSS), 2016 IEEE 18th international conference on (pp. 1325–1332). IEEE.
https://erpsolutions.oodles.io/developer-blogs/Event-streaming-KAFKA/
Cortes, C., & Vapnik, V. (1995). Support-vector networks. Machine Learning, 20(3), 273–297.
Song, H., Fink, G., & Jeschke, S. (2017). Security and privacy in cyber-physical systems: Foundations and applications. Wiley.
Pantelis, K., & Aija, L. (2013). Understanding the value of (big) data. In Big data, 2013 IEEE international conference on IEEE (pp. 38–42). IEEE.
Chithaluru, P., Al-Turjman, F., Kumar, M., & Stephan, T. (2020). I-AREOR: An energy-balanced clustering protocol for implementing green IoT in smart cities. Sustainable Cities and Society, 102254. https://doi.org/10.1016/j.scs.2020.102254
Shankar, A., Pandiaraja, P., Sumathi, K., Stephan, T., & Sharma, P. (2020). Privacy preserving E-voting cloud system based on ID based encryption. Peer-to-Peer Networking and Applications. https://doi.org/10.1007/s12083-020-00977-4
Punitha, S., Al-Turjman, F., & Stephan, T. (2021). An automated breast cancer diagnosis using feature selection and parameter optimization in ANN. Computers and Electrical Engineering. https://doi.org/10.1016/j.compeleceng.2020.106958
Yadav, S. P., & Yadav, S. (2020). Image fusion using hybrid methods in multimodality medical images. Medical & Biological Engineering & Computing, 58, 669–687. https://doi.org/10.1007/s11517-020-02136-6
Yadav, S. P., & Yadav, S. (2020). Fusion of medical images in wavelet domain: A hybrid implementation. Computer Modeling in Engineering and Sciences, 122(1), 303–321. https://doi.org/10.32604/cmes.2020.08459
Dighriri, M., Lee, G. M., & Baker, T. (2018). Big data environment for smart healthcare applications over 5G mobile network. In M. Alani, H. Tawfik, M. Saeed, & O. Anya (Eds.), Applications of big data analytics. Springer. https://doi.org/10.1007/978-3-319-76472-6_1
Khine, K. L. L., & Nyunt, T. T. S. (2019). Predictive big data analytics using multiple linear regression model. In T. Zin & J. W. Lin (Eds.), Big data analysis and deep learning applications. ICBDL 2018 (Advances in intelligent systems and computing) (Vol. 744). Springer. https://doi.org/10.1007/978-981-13-0869-7_2
Meenakshi, R. A. C., Thippeswamy, M. N., & Bailakare, A. (2019). Role of hadoop in big data handling. In J. Hemanth, X. Fernando, P. Lafata, & Z. Baig (Eds.), International conference on intelligent data communication technologies and internet of things (ICICI) 2018. ICICI 2018 (Leecture notes on data engineering and communications technologies) (Vol. 26). Springer. https://doi.org/10.1007/978-3-030-03146-6_53
Grace Mary Kanaga, E., & Jacob, L. R. (2021). Smart solution for waste management: A coherent framework based on IoT and big data analytics. In J. Peter, S. Fernandes, & A. Alavi (Eds.), Intelligence in big data technologies—Beyond the hype (Advances in intelligent systems and computing) (Vol. 1167). Springer. https://doi.org/10.1007/978-981-15-5285-4_9
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Pal, P.K., Awasthi, C., Sehgal, I., Mishra, P.K. (2022). Big Data Analytics and Big Data Processing for IOT-Based Sensing Devices. In: Al-Turjman, F., Yadav, S.P., Kumar, M., Yadav, V., Stephan, T. (eds) Transforming Management with AI, Big-Data, and IoT. Springer, Cham. https://doi.org/10.1007/978-3-030-86749-2_2
Download citation
DOI: https://doi.org/10.1007/978-3-030-86749-2_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-86748-5
Online ISBN: 978-3-030-86749-2
eBook Packages: Computer ScienceComputer Science (R0)