ISSN (Online) 2394-2320 International Journal of Engineering Research in Computer Science and Engineering (IJERCSE) Vol 8, Issue 3, March 2021 An Empirical Study on the Current State of Internet of Multimedia Things (IoMT) [1] Dr. Yusuf Perwej, [2] Dr. Faiyaz Ahamad, [3] Dr. Mohammad Zunnun Khan, [4] Nikhat Akhtar [1] Associate Professor, Department of Computer Science & Engineering, India Professor, Department of Computer Science & Engineering, Integral University, Lucknow [3] Assistant Professor, Department of Computer Science & Engineering, Integral University, Lucknow [4] Research Scholar (Ph.D), Department of Computer Science & Engineering, Babu Banarasi Das University, Lucknow [2] Assistant Abstract: As the Internet continues to expand, immense people around the globe join the Internet. The Internet of Things (IoT) can be defined as the interconnection of peerless identifiable embedded computing devices within the current Internet infrastructure. This paradigm encompasses an infrastructure of software, hardware, and services that link tangible objects called things to the Internet. In Internet of Things technology, multimedia big data which is said to be the huge amount of data from multimedia devices will be generated with the swiftly rise of the multimedia gadgets and devices. The multimedia devices need higher processing and memory resources to process the obtained multimedia information. The Internet of Things systems are fiasco in realizing the multimedia devices connectivity unless they are able in processing multimedia gadgets and devices at a moment. In this paper, we are introduces a new concept of Internet of Multimedia Things (IoMT) for multimedia communications in Internet of Things (IoT). Internet of Multimedia Things (IoMT) communications play a vital role in Internet of Things (IoT) applications such as traffic control and handling, environmental monitoring, healthcare sector, observation & surveillance, event recognition and house monitoring and automation. In this paper, we present a comprehensive survey of IoMT and future research directions. The Internet of Multimedia Things (IoMT) applications such as real-time multimedia based security and monitoring in smart house, Smart Agriculture, multispecialty hospitals, metropolitan area, and smart transportation handling systems are of the most difficult systems to deploy. Keywords: Internet of Multimedia Things (IoMT), Cloud Computing, Internet of Thins (IoT), Quality of Things (QoT), Wireless Sensor Network (WSN), Machine to Machine (M2M), Machine to Human (M2H). 1. INTRODUCTION The Internet of Things (IoT) is a modern concept that has transformed conventional lifestyles into high-tech ones. The rise of intelligent environments [1] means that technologies are becoming more interconnected and that the Internet is being used more. The internet of things (IoT) is rapidly expanding, and the ability to link physical and virtual reality is opening new doors for innovation in almost every field of life [2]. The Internet of Things (IoT) is a set of heterogeneous objects or devices with varying computing and connectivity capabilities that can gather data from the physical world linked by the internet. Machine to machine (M2M) communications, on the other hand, would be the most prevalent technology in IoT concepts [3]. Sensors, actuators, cell phones, home automation systems, and smart grid devices all have the ability to have a huge impact on our lives and how we communicate with them. The Internet of Things (IoT) is a mixture of information technology, computer science, electronics, telecommunications, and other fields [4]. The concept of the Internet of Things (IoT) was introduced by Kevin Ashton in the year 1999. The Internet of Things (IoT) has shown that computers are not the only devices with Internet connectivity, and that various devices and artefacts have this capability. It has become the most vital research topic in the last 15 years [5], whose objective is based on everyday objects having identification, detection, and interconnection and processing capabilities to communicate with each other and with services via the Internet to unriddle a specific and useful need of people [6]. Internet of Things (IoT) is a broad-spectrum system which includes many integrated system. Wireless sensors in the Internet of Things communicate with one another via short-range wireless communication. A wireless sensor network (WSN) is a set of sensors linked to the Internet through one or more gateways [7]. Single-hop or multi-hop wireless communications can be used to communicate between the sensors and the sensor network's gateways [8]. The Internet of Multimedia Things (IoMT) is a new paradigm created by smart heterogeneous multimedia devices that communicate and cooperate with one another and with other devices through the Internet of Multimedia Things (IoMT). Smart objects in the Internet of All Rights Reserved © 2021 IJERCSE 25 ISSN (Online) 2394-6849 International Journal of Engineering Research in Computer Science and Engineering (IJERCSE) Vol 8, Issue 3, March 2021 Multimedia Things (IoMT) are usually [9] limited in terms of energy, memory capacity, and processing power. To make the devices smaller, cost effective and energy efficient, sensors are usually designed to be battery operated or solar powered with only a few kilobytes of memory, and limited processing power in megahertz [10]. Multimedia data is a set of unstructured characteristics that includes audio, images, and video. Transmission of such large, unstructured data over a network with limited bandwidth and computing power necessitates an efficient and intelligent network topology. Real-time multimedia contact due to bandwidth constraints and packet loss, IoT applications can experience network delays and congestion, lowering the quality of transmitted multimedia. To fix the aforementioned [11] concerns, multimedia communications in IoT have been proposed in recent years. In most IoMT smart systems, the intelligence generated by Deep learning methods is tightly bound to the application that implements it, restricting the provisioning [12] of that particular intelligence service to other applications, also within the same system domain [13]. For example, in a intelligence university campus scenario, it is reasoning that the same facial recognition system should be applied to register the presence of undergraduate & postgraduate students in the university classroom as well as to unlock a laboratory door for a researcher. This article presents a comprehensive state of the art survey on Internet of Multimedia Things (IoMT) [14]. Multimedia wireless sensor networks which process enormous multimedia traffic in real time IoT applications [15] namely traffic monitoring, remote system monitoring and home security monitoring, smart grid monitoring need huge memory and computational resources and consume more energy differentiate with traditional wireless sensor networks collecting information from the physical environment for example temperature, pressure, and light. The rest of this paper is organized as follows. The related work is presented in Section II. We describe the Internet of Multimedia Things (IoMT) in Section III and Internet of Multimedia Things (IoMT) architecture in Section IV. In Section V, we present the Internet of Multimedia Things (IoMT) in wireless sensor. We present Internet of Multimedia Things (IoMT) in cloud computing in Section VI. We provide Quality of Things (QoT) for Internet of Multimedia Things (IoMT) in Sections VII. We are discussing Internet of Multimedia Things (IoMT) enabling technologies in Sections VIII. We are widely discussing Internet of Multimedia Things (IoMT) applications in Sections IX. In Section X, we present Internet of Multimedia Things (IoMT) uncovered matter. We conclude this paper in Section XI. RELATED WORK Through numerous applications, the Internet of Things (IoT) has changed the use of the Internet in recent years. The internet-of-things (IoT) paradigm is one of the next evolutionary steps in internet-based computing, and it is already having a positive effect in a wide range of application domains, such as smart cities, sustainable living, healthcare, manufacturing, and more [16[. The foundation of IoT is served by integration of RFID tags, actuators, sensors etc and defines the communication between physical objects through internet and reaches common goals [17]. The various areas of Industry got affected by emergence of IoT and has many projects associated with it such as agriculture, food processing etc industry, security surveillance, environment monitoring etc.[18]. Yusuf Perwej et al. provide a technical overview of Internet of Things protection in multimedia data. Because, the protection was a major concern when just two devices were coupled [19]. Furthermore, multimedia data differs from scalar data in that it imposes quality-ofservice criteria on green communications IoT [20]. Physical devices layer, network layer, mixture layer, and background layer are the four layers proposed for the multimedia IoT in [21]. In [22], image and video frames were divided into important premium blocks and unimportant regular blocks to save energy on IoT devices and provide high QoE to end users. Many Cross layer protocols have been proposed in recent past [23] for WSN and they have optimized the various parameters of the layers. But these protocols require to be enhanced by the optimization model for multimedia IoT as proposed (IoMT) in this paper. IoMT services are real-time in nature and need to provide guaranteed quality and performance [24]. The first research to present the vision and standardisation of the Internet of Multimedia Things (IoMT) [25]. The paper introduces the “IoMT” paradigm, which allows multimedia objects to communicate with one another and connects to the Internet of Things to enable multimediabased services while keeping applications and users in the loop. Based on the use of multimedia content as IoT input and output, multimedia as IoT input, and multimedia as IoT output, the authors specified IoMT in three scenarios [26]. The paper suggested a layered QoE model for IoMT applications, presented a use case involving remote All Rights Reserved © 2021 IJERCSE 26 ISSN (Online) 2394-6849 International Journal of Engineering Research in Computer Science and Engineering (IJERCSE) Vol 8, Issue 3, March 2021 monitoring driving activities, and performed subjective QoE evaluations. It introduces architecture for IoMT and presented its possible use-cases and applications. Existing hardware and communication protocol layer technologies reviewed in paper [27]. Perera et al. [28] proposed an IoT middleware solution that can work on resource constrained mobile devices allowing them to collect and process data from sensors easily. Mobile sinks and mobile relays have been suggested for improving the performance of data collection in WSNs. one of the most important technologies of the 21st century. Now that we can connect everyday objects kitchen appliances, cars, thermostats, baby monitors to the internet via embedded devices, seamless communication is possible between people, processes, and things. IoT systems cannot successfully realize the notion of ubiquitous connectivity of everything [38] if they are not capable to truly include ’multimedia things’. We will show some glims of Multimedia before launching the Internet of Multimedia Things (IoMT). The survey [29] includes the most important work in the area of multimedia stream processing. In this paper develops a detailed taxonomy for multimedia big data (MMBD) computing in the context of the Internet of Things. It also looked at the literature on issues including scalability, usability, data durability, and heterogeneity. Bisnik et al. [30] studied the problem of providing quality coverage using mobile sensors and analyzed the effect of controlled mobility on the fraction of events captured. The existing survey on energy-efficient IoMT is presented in [31]. This study explains the working of each layer of the traditional IoT architecture; however, the intrinsic nature of multimedia data is not considered in any aspect. Xu et al. [32] further studied delay tolerant event collection in sensor networks with mobile sink which considers the spatial-temporal correlation of events in the sensing field. Kaaradi et al. [33] have presented the concept of Quality of Things (QoT) for IoMT. He et al. [34] analyzed the performance of data collection theoretically to evaluate service disciplines of MEs through a queuing model. Thiyagarajan et al. [35] have proposed a secure video transmission energy-aware encryption scheme for IoMT. Singh and Al Turjman [36] studied the use of heuristically accelerated learning techniques for improving the data delivery success rate in information-centric sensor networks. It examined the performance in terms of influence on the network lifetime, average good outcome and bad outcome rates, energy consumption, and the QoI at the accomplishment. Multimedia is a concept that combines the words multi and media. The term media (medium) has a double meaning: it refers to a device that stores data on a disc, CD, tape, semiconductor memory, and other devices. Second is the transmission of information carriers, such as numbers, text, sound, graphics and so on. Therefore, the corresponding term and multimedia is a single media, literally, the media is compounded by a single media. Multimedia is anything and everything that you watch and listen. It is graphics, audio, sound, text and many. This is usually recorded and played, displayed or accessed by information content processing devices such as computerized and electronic devices. INTERNET OF MULTIMEDIA THINGS (IoMT) The Internet of Things (IoT) is a term used to describe a system of interconnected, internet-connected devices that can capture and transmit data over a wireless network without the need for human interaction. Devices embedded with internet connectivity, sensors, and other hardware enable communication and control through the web in the Internet of Things (IoT) [37]. IoT has become Multimedia includes everything you see and hear in the form of text, images, audio, video, and other formats [39]. Information content processing systems, such as computerized and electronic devices, typically recode and play, view, or access this. We may use multimedia in the workplace, schools, residences, public spaces, and virtual reality. These have many functions to do many things and have made the things to more mobile. Multimedia enhanced simple, text-only computer interface and production acquisition and holding of attention and interest in measurable benefits. In short, is to improve multimedia information retention. When it’s properly constructed, can be profound and useful multimedia entertainment. Multimedia can be use in many way are business, school, home, public places and virtual reality. The Internet of Multimedia Things (IoMT) can be described as a “network of interconnected objects capable of acquiring multimedia contents from the real world and presenting information in a multimedia way” [40] by including multimedia content. The idea of combining multimedia and IoT is relatively new. The word "Internet of Multimedia Things" (IoMT) was recently coined to describe IoT-based multimedia communications. Multimedia objects, on the other hand, can be described as "objects capable of acquiring multimedia contents from All Rights Reserved © 2021 IJERCSE 27 ISSN (Online) 2394-6849 International Journal of Engineering Research in Computer Science and Engineering (IJERCSE) Vol 8, Issue 3, March 2021 the physical world while being equipped with multimedia devices". Processing of multimedia events and their execution environments are essential in IoMT for analyzing the huge amount of unstructured data generated in smart cities [41]. IoMT is described as the addition of IoT challenges, such as protection, routing, quality of service (QoS) and quality of experience (QoE) issues, heterogeneity of multimedia sensors, and so on [42]. IoMT devices need higher bandwidth, bulky memory resources, and higher computational power to analyze and process the procured multimedia data[43]. The traditional multimedia application involves the data transmission of multipointto-point communication for example the surveillance system of the entire smart metropolitan area and multipoint-to-multipoint scenarios. The table 1 represents a comparison of IoMT and IoT based technologies. Table 1. The Comparison of IoMT and IoT Based Technologies Around the globe multimedia systems have been employed a wide range of applications [44], including emergency response systems, traffic monitoring, medical Applications (for patient or child monitoring), crime inspection, smart cities, smart homes, smart hospitals, smart agriculture, video-surveillance devices might be deployed in various scenarios, such as within public transport management systems (managing buses, airplanes or road traffic), Internet of bodies (IoB), image processing, mobile computing [45], Industrial IoT (IIoT), smart systems, personal asset protection (within homes or construction sites) and many other applications [46]. Multimedia communication in the IoT faces enormous challenges due to dynamic networks, heterogeneous devices and data, strict QoS, and delay sensitivity and reliability requirements over resource-constrained IoMT [47]. The goal is to make these devices smart by allowing them to communicate with one another, effectively turning them into smart objects. INTERNET OF MULTIMEDIA THINGS (IoMT) ARCHITECTURE The orchestration of the Internet of Multimedia Things allows systems, apps, the cloud, and smart sensors to be integrated into a single platform. The IoMT works for both scalar and multimedia data [48]. The timely and efficient delivery of data is the most important feature of IoMT. As a result, stringent quality of service (QoS) standards is imposed, as well as effective network architecture. The rapid growth of multimedia traffic in IoT has led the way to innovating new techniques to meet its requirements [49]. The novel Internet of Multimedia Things (IoMT) architectures are presented in this section shown in figure 1. Multimedia traffic has drastically grown in the last few years. The robust increase in multimedia traffic necessitates an efficient network traffic management system. Rego et al. [50] propose an intelligent network management system for the IoT video surveillance system based on SDN and Artificial Intelligence [51]. SDN (Software Defined Networking) emerged as a technique for increasing network functionality while lowering costs, simplifying hardware, and encouraging groundbreaking research. Software specified networks (SDNs) enhance network management capabilities. Artificial intelligence, when combined with SDN, can provide network solutions based on classification and estimation techniques [52]. Artificial intelligence helps to manage resources and network traffic dynamically. Using AI to study the traffic of the network, we can discover the different types of flow that are being transmitted. Thus, traffic patterns can be obtained, which can then be applied in SDN decision making. All Rights Reserved © 2021 IJERCSE 28 ISSN (Online) 2394-6849 International Journal of Engineering Research in Computer Science and Engineering (IJERCSE) Vol 8, Issue 3, March 2021 Fig. 1 Internet of Multimedia Things (IoMT) Architecture Integrate artificial intelligence techniques with SDN, adaptive behaviors are achieved in order to improve the performance of the network. The Multi agent cloud computing-based architecture for multimedia communication in IoT due to the bulky and unstructured nature of multimedia content. Multimedia sensing, monitoring, and addressability, multimedia aware cloud, and multi-agent systems are the four key parts of this architecture. Kaeri et al. [53] further enhance the multi agent IoMT architecture to make it more practical by proposing and implementing the five layer architecture. An innovative agent based architecture for systems supporting remote collaboration based on an IoMT approach. Basic IoT elements and instruments, such as cameras, microphones, sensors, and multimedia communication lines, are used in these applications. This architecture is divided into five layers applications, service execution agents, resource connectors, IoMT services & resources, and IoMT devices & communications. Each interface and communication, such as touch screens, synchronous and asynchronous communication lines, and cloud storage, are represented by the bottom three layers. Parallel channels necessitate the simultaneous use of several graphical user interfaces and, more critically, a display surface. Those channels can be incorporated into applications dynamically by users to enhance the expandability of the IoMT system. Rahman et al. [54] propose a context-aware fog cloud hybrid based framework that integrates spatio temporal multimedia data from IoT mobile and stationary nodes for the massive ad-hoc crowd. In this article [55], a three-tier architecture mobile client tier, fog node tier, and remote cloud tier, is presented. The authors aim to optimize energy resource utilization and reduce end-toend delay for the massive crowd in the smart city. The mobile client tier includes service consumers. Fog nodes tier comprises Smartphone’s and other IoT fog nodes distributed in the city to assist in real-time processing of spatio-temporal collective or individual queries. To analytical compute, store, and process offline queries, the cloud tier is made up of IP-based massive big data architecture. A sustainability and energy efficiency model, as well as huge geo-tagged, multimedia big data architecture, are included in the communication architecture between mobile users and fog nodes, as well as between fog nodes and the cloud. The authors [56] suggested a six-layered IoMT architecture focused on big data aggregation, computation, and multimedia content extraction. Instead of using the word media, the writers used the term modal, which explains how data is perceived to convey meaning. Moreover, they have listed three main problems associated with multimodal big data computation that is to compute the huge amount of data, to detect and extract meaningful information and the current limitation of big data processing platforms for multimedia [57]. The six layers proposed in IoMT architecture. Moreover, the article presents a unique and efficient technique that is Divide and Conquers Principal Component Analysis (DCPCA) to reduce the dimensions, subdivides the data, process the subdivided data in parallel fashion, and fuse the final parallel processed data to extract the features. Mediaware Traffic Protection Architecture (MTSA) for IoMT was developed by Zhou and Chao [58] and consists of four key components. Key management, which involves service control, user control, flow control, scalable, and non-scalable schemes [59], is one of these elements. Watermarking is used to identify the origin of multimedia content, trace illegal distribution [60], and block unauthorized access by embedding a unique watermark into multimedia content [61]. Security is of critical importance for various multimedia applications in IoT. The media-aware traffic security architecture (MTSA) is applied to obtain satisfying traffic management based on the given media-aware traffic classification and analysis. MTSA is one of the first All Rights Reserved © 2021 IJERCSE 29 ISSN (Online) 2394-6849 International Journal of Engineering Research in Computer Science and Engineering (IJERCSE) Vol 8, Issue 3, March 2021 security-aware traffic manage- ment strategies for multimedia applications running over the IoT. For facilitating various multimedia applications in the Internet of Things, the author proposed an efficient [62] mediaaware security system. This system of multimedia traffic classification and analysis is designed to deal with the heterogeneity of various applications. To support multimedia content in various IoT applications, a standardized IoMT architecture is required. INTERNET OF MULTIMEDIA THINGS (IoMT) IN WIRELESS SENSOR The IoMT is an extension of the IoT, with one of its primary goals being to support video streaming as part of IoT implementation. In the Internet of Things, resourceconstrained low-cost, low-power heterogeneous multimedia devices can communicate with one another and be globally accessible via unique IP addresses, in the same way as computers and other networking devices connected via the Internet can. IoMT faces similar challenges to IoT, such as dealing with large quantities of data, requests, and computation, as well as some unique requirements. The multimedia devices in IoMT-based wireless multimedia networks [63] are expected to be small artefacts with a limited amount of power resources, which they must effectively use to extend network life time. Multimedia communication in the Internet of Things (IoT) can potentially reach into a vast array of areas and touch people’s lives in profound and different ways. For example, real For example, governments can allow its citizens to upload real-time multimedia data using some Smartphone applications to report about the road and traffic conditions within the cities. The real-time multimedia streaming information can be applied to the current emergency response services, e.g., 112 in Lucknow and 1090 in Lucknow woman helpline. It will allow an emergency response service to provide accurate information about the nature or seriousness of an incident, such as a robbery, accident, or domestic abuse, if the caller may send video or photographs of the incident or the incident location. The current trend is for devices and things to migrate away from non-multimedia data support and toward multimedia streaming, especially video streaming. Here upon, it is important to have an understanding of multimedia streaming and the sensor embedded in these devices, multimedia sensor nodes in this case. IoT technology enables massive data collection, which leads to the emergence of a large number of sensor-based applications. Wireless Sensor Networks (WSNs) have become the most common IoT-based data collection platforms. In Wireless Sensor Networks (WSNs), data collection is one of the most important operations [64]. In view of the characteristics of these data, we believe that very large-scale and heterogeneous WSNs can be very useful for collecting and processing these Big Data [65]. WSNs (Wireless Sensor Networks) have exploded in popularity over the last decade. In traditional WMS and WMSN, the sensors are constrained devices in terms of their energy, processing and computational resources. WMSN is a network of interconnected sensor nodes that sense the environment, and retrieve multimedia and ordinary data ubiquitously from the physical environment [66] shown in figure 2. Multimedia data include still images, audios, and videos and even live media streams that are supported by sensor nodes with installed cameras and microphones. At the multimedia unit, the massive amount of multimedia data acquired is compressed using various pre-transmission processing procedures such as transformation, quantization, estimation, entropy coding, and so on, in order to minimize bandwidth requirements during transmission [67]. These processes are computationally complex and consume significant amount of energy. IoMT devices exhibit limited bandwidth capacity, but enabling a good video quality needs high compression that is infeasible due to high energy consumption. Wireless Multimedia Sensor Networks are a special type of Wireless Sensor Network (WSN) where huge amounts of multimedia data are transmitted over networks composed of low power devices [68]. The majority of wireless multimedia devices are supposed to run on batteries. Since multimedia retrieval and processing are both energy-intensive processes. Multimedia data processing is a computationally intensive task. Local multimedia processing necessitates the temporary storage of data during sensing and manipulation. The volume of data in WMSNs is much bigger as compared to WSNs primarily due to the use of video and audio streaming. IoMT based multimedia devices have limited energy and processing capability, so the complexity should be shifted to the cloud. Intelligent traffic control systems, military software, security All Rights Reserved © 2021 IJERCSE 30 ISSN (Online) 2394-6849 International Journal of Engineering Research in Computer Science and Engineering (IJERCSE) Vol 8, Issue 3, March 2021 systems, and wildlife monitoring are only a few of the areas where WMSNs have found use. Since they require both non-multimedia and multimedia knowledge, all of these applications are heterogeneous in nature [64]. Fig. 2 Internet of Multimedia Things (IoMT) Wireless Communication The ultra-wideband (UWB) is normally used as a shortrange, wireless communication standard for sending and receiving multimedia information data and that operates through radio waves. Ultra-wideband is used for a bandwidth (BW) that is larger or equal to 500 MHz or a fractional bandwidth (FBW) greater than 20% where FBW = BW/fc, where fc is the center frequency. In contrast, various WPAN standards such as, Zigbee, Bluetooth [69], IEEE 802:15:4. ZigBee has been adopted for IoT due to its energy efficient operation. Multimedia sensing demands high processing and continuous data acquisition, which results in higher energy consumption. Since, the IoMT devices are expected to be operated on batteries that may not last longer due to demanding nature of multimedia data [70]. Thus, efficient energy harvesting procedures need to be devised to energize sensors and prolong the network lifetime. without having to physically acquire them [71]. Cloud computing generally includes Infrastructure as a service (IaaS), Platform as a Service (PaaS), and Software as a Service (SaaS). Reduce the computation time and to overcome the storage space shortage issues, most of the organizations nowadays shifting to cloud computing from the traditional process of computation. It manly focuses on distributing data and computations over a scalable data centers of network. Nowadays users can easily access the multimedia content over the internet at any time. Here the user can efficiently store the multimedia content of any type and of any size in the cloud after subscribing it with no difficulties. The cloud provides a stable environment in which data can be accessed, stored, and processed in a transparent manner. Users have higher expectations when it comes to multi-screen applications. Users can access the cloud's multimedia content through multiple devices, with a wide range of video, audio codecs, aspect ratios, and screen sizes supported on a live or pay-per-use basis. In addition, the Cloud multimedia has to provide application & service specific QoS adaptation, in terms of bandwidth and delay while performing tasks such as storage, delivery, sharing, submission, and retrieval, for enormous number of heterogeneous end-user devices [73]. INTERNET OF MULTIMEDIA THINGS (IoMT) IN CLOUD COMPUTING Cloud computing is a new IT technology that is being used in computation today. Previously, we stored our data on hard drives in computers. Hard drive technology has been replaced by cloud storage services. Cloud computing is defined as the delivery of resources such as storage, databases, servers, networking, and software over the Internet. It is a green technology that allows users to access, compute, and store resources over the internet Fig. 3 Internet of Multimedia Things (IoMT) in Cloud’s Cloud multimedia computing provides cost-effective services to service providers by efficiently multiplexing media contents such as audio, video, and image by All Rights Reserved © 2021 IJERCSE 31 ISSN (Online) 2394-6849 International Journal of Engineering Research in Computer Science and Engineering (IJERCSE) Vol 8, Issue 3, March 2021 offering a common infrastructure, using the server, optimization, virtualization, accessibility, and automatic processing [74] as shown in figure 3. The use of Blockchain technology in IoMT may have a number of advantages [75]. Blockchain is a cutting-edge technology that has been employed to security via data access management, tamper proof recording [76], transparency, support for smart contracts, and trustless consensus properties, which indicates it has the potential to be utilized to protect service discovery for IoMT [77]. However, integrating a cloud platform into IoMT and IoT systems is a difficult task that comes with numerous challenges, including management, synchronization, reliability, and enhancement. For real-time multimedia services, Video Service Providers (VSPs) are shifting their infrastructures to public clouds [78]. The integration of cloud computing with IoMT & IoT enables the user to access their desired data anywhere and anytime. If the services and applications are properly managed on cloud platforms, users will not only be able to access the data but, will control their systems too. For example, the users can be enabled to ubiquitously access the sensor data from remote sensor devices as a Sensing as a Service (SaaS) [79], rule engines can be implemented to control the actuators operation automatically from the cloud as a Sensing and Actuation as a Service (SAaaS) [80], providing control to identity and policy management systems Identity and Policy Management as a Service (IPMaaS) [81], enabling access to video analyses and streaming of recorded video content in the cloud video surveillance as a service (VSaaS) [82]. The IoMT & IoT are multi-layer technologies that are used to control and automate connected devices. To put it another way, this aids you in getting physical objects online. This platform will give you the tools you need to attach devices for machine-to-machine communication. Table 2. The IoMT & IoT Cloud Platforms Characteristics The IoMT & IoT is software that connects the edge hardware, access points, and data networks to the other end which is usually the end user application. The ZWave has demonstrated acceptable performance and despite being somehow more expensive than ZigBee, it has been used widely in smart home applications. Furthermore, Z-Wave applications can benefit from the flexibility and security of this protocol. For real-time M2M communications, the Data Distribution Service (DDS) is a published subscribes protocol. Data Distribution Service (DDS) has 23 QoS policies that cover a broad range of communication criteria such as security, urgency, priority, durability, and reliability, among others. At this time numerous cloud platforms are available in market and these cloud platforms are designed to support different applications and organizational requirements. The table 2 provides a summary of cloud platforms currently available for IoMT & IoT [83]. These services include, support for WAN via gateways, configuration support, delivery and billing of services provided by various application layer protocols and in this table yes stands for support and no stands for lack of support shown in table 2. QUALITY OF THINGS (QoT) FOR INTERNET OF MULTIMEDIA THINGS (IoMT) Multimedia communications in real time IoT applications may experience network delay and congestions due to bandwidth constraints and packet loss, which have an adverse impact on the delivered multimedia quality [84]. All Rights Reserved © 2021 IJERCSE 32 ISSN (Online) 2394-6849 International Journal of Engineering Research in Computer Science and Engineering (IJERCSE) Vol 8, Issue 3, March 2021 Millions of users connect, store, share, edit, compute, and transmit multimedia data over the internet, which has strict QoS and QoE specifications in terms of bandwidth, latency, and jitter, which would be a bottleneck for ordinary cloud providers [85]. As a result, general purpose cloud providers face unsatisfied users in terms of media traffic Quality-of-Service (QoS) and Quality-ofExperience (QoE) [86]. In order to fulfill these needs cloud providers requires huge storage capacity, faster graphical processing units (GPUs), strong security aids, high speed network connectivity, and longer battery life. Non-functional properties of objects are captured by a QoT model. These characteristics apply to the ability of things to perform tasks such as detecting, actuating, and communicating. It is important to design and build a quality aware IoT architecture to ensure the quality of multimedia content such as audio, video, and image to be received, processed, and distributed in IoMT applications. However, M2M communications will be the dominant applications in IoT. The concept of QoT comes into consideration for M2M communications in IoMT [87]. In general, QoT stands for Quality of Things, and it refers to the smooth operation of an IoT device. In an IoT setting, it focuses on the quality of multimedia data to be recorded, processed, and delivered between two or more devices and objects. The aim of the QoT is for an IoT object to meet the minimum quality requirement of an IoT application. It focuses on the minimum quality of multimedia data captured by the camera node to be processed and delivered by edge and cloud nodes. As a result, the edge and cloud nodes will process and deliver appropriate QoE for multimedia data. The Quality of Things metrics are critical for improving device-to-device or machine-tomachine communication. For machine to human communications such as E-health monitoring and navigation systems, it takes the QoE metrics into consideration such as end-user devices, preferences, satisfaction, and background. The main QoT factors for IoMT applications that can affect service & application performance which includes monitoring, data collection, processing, and delivery [88]. These factors are described as follows. IoT applications can be impacted. For example, the information or data collected by multimedia devices and sent to the network gateway must be accurate enough to be used for further processing, such as physical location, time, and temperature. B. Device Influence In an IoT platform, real-time multimedia monitoring can result in high energy consumption. As a result, system influences such as device type, device transmission, and battery may affect the device's life time based on its current state. C. Network Influence The network efficiency is affected by network influences such as packet loss and jitter. For example, packet loss would result in data loss, lowering the quality of data transmission. D. Application Influence To meet the requirements of an IoMT device, application impact such as application and codec types are oriented. For example, instead of H264, a codec like H265 may be used to save network bandwidth while still delivering high-quality video transmission. INTERNET OF MULTIMEDIA THINGS (IoMT) ENABLING TECHNOLOGIES IoMT is enabled by several technologies including wireless sensor networks, cloud computing, communication protocols, Machine to Machine (M2M), and Machine to Human (M2H). In this section, we are discussing five enabling technologies towards IoMT shown in figure 4. A. Ecosystem Influence In this situation, QoT specifications on ecosystems such as physical location, temperature, and time accuracy for All Rights Reserved © 2021 IJERCSE 33 ISSN (Online) 2394-6849 International Journal of Engineering Research in Computer Science and Engineering (IJERCSE) Vol 8, Issue 3, March 2021 resources to users as metered services in a "pay as you go" model [91]. Cloud computing is a service that is PaaS (Platform as a Service), IaaS (Infrastructure as a service) and SaaS (Software as a service). Cloud computing provides a variety of capabilities, such as flexible computing and storage space. Devices can be monitored and controlled at any time and from any place. Fog & edge computing has recently become a common method for dealing with delay-sensitive IoMT applications [92]. The provisioning of resources is a completely automated operation. Cloud computing resources can be accessed over the network using standard access mechanisms that provide platform independent access through the use of heterogeneous client platforms such as the workstations, laptops, tablets, and Smartphone’s. Fig. 4 Internet of Multimedia Things (IoMT) Enabling Technologies A. Wireless Sensor Networks (WSN) A wireless sensor network is made up of sensors that are spread across the network and are used to detect environmental and physical conditions. A WSN is made up of several end-nodes, routers, and a coordinator. End Nodes are equipped with a number of sensors and can also serve as routers. The data packets are routed via routers from end-nodes to the coordinator. The coordinator collects the data from all the nodes [89]. Coordinator also acts as a gateway that connects the WSN to the internet. Deploying WSN for IoMT applications is gaining attraction from the both academia and the industry in areas such as home & building energy monitoring and environment monitoring. Using WSN including camera sensors and actuator sensors that can sense scalar data such as temperature, pressure, humidity, and multimedia information from the surrounding environment can improve the efficiency, reliability, and safety of an IoMT application. For example wireless multimedia sensors are able to monitor the renewable energy sources such as sun & wind intensity and direction, and predict the information. Also real-time multimedia monitoring system such as CCTV can be used to monitor critical aspects [90]. B. Cloud Computing Cloud computing is a transformative computing paradigm that entails distributing software and services over the internet. It entails provisioning of computing, networking, and storage resources on demand and offering these C. Communication Protocols Communication protocols act as the foundation of IoT and IoMT systems, allowing for network connectivity and device coupling. Devices can share data over a network using communication protocols [93]. Multiple protocols are sometimes used to denote various aspects of a single communication. A group of protocols designed to work together are known as a protocol suite, when implemented in software they are a protocol stack. The Voice packets and the Video packet are transmitted in the existing infrastructure using the Voice over Internet Protocol (VoIP). VoIP (Voice over IP, VoIP and IP telephony) has become more popular in the recent years due to its advantage of low-priced calls than to the existing Public Switch Telephone Network [94]. D. Machine to Machine (M2M) M2M (machine-to-machine) communication is a promising technology for next-generation communication systems. M2M, or machine-to-machine communication, is just what it sounds like: two machines “communicating,” or exchanging data, without the need for human interaction [95]. Without any human contact, this refers to multimedia communication between two or more devices. For example in traffic control system there are camera sensors used to monitor variables such as traffic speed, accidents, and road congestions. There is detection software used to send all the information across the computers that controls the traffic by showing traffic lights and signs. All Rights Reserved © 2021 IJERCSE 34 ISSN (Online) 2394-6849 International Journal of Engineering Research in Computer Science and Engineering (IJERCSE) Vol 8, Issue 3, March 2021 E. Machine to Human (M2H) Machine to human interaction is a form of communication in which humans collaborate with AI systems and other machines rather than using them as tools or devices. The aim of this human-machine partnership is to leverage each other's strengths, physical abilities, and weaknesses. Multimedia contact between computers and humans is referred to as this. The most popular M2H application is E-health monitoring, which is an application and service that allows doctors to monitor patients remotely. Smart sensors capture patient data and display it in a multimedia format so that doctors can learn more about the patient's health. Another application of M2H is navigation system, which is a service where roads equipped with camera sensors provide accurate information (such as traffic delays) to the end-user, so that the user could select a better route. INTERNET OF MULTIMEDIA THINGS (IoMT) APPLICATIONS The Internet of Multimedia Things (IoMT) infrastructure opens up a slew of possibilities for bettering services and applications by maximizing the use of multimedia data. Multimedia data is jam-packed with useful details. The multimedia content in the IoMT app is used to display a geographical region, which can be both outdoor and indoor. In this section, we are talk about the Internet of Multimedia Things (IoMT) applications. microwave radars to deal with this issue. These traditional methods have high installation and maintenance costs, as well as a lack of precision. The researcher put forward IoMT based techniques to effectively detect and identify the volume of traffic and predict the reason for a traffic jam. C. Behavioral Interpretation in IoMT Behavioral analytics focused on multimedia content has recently emerged as a useful tool. Unusual activity in video streams can be detected automatically, and autonomous reactive measures, such as alerts, can be initiated. A truck with prohibited dimensions or a vehicle going in the wrong direction, for example, may be detected and warnings issued. Multimedia networks the behavioral analytics can be done at smart camera nodes to interpret the event and appropriate reactive approaches can be executed such as reporting to a public safety department, triggering alarms to notify the responsible personnel, calling for medical or other types of assistance. D. Crime Detection in IoMT In this paper authors is [97] presented a novel concept of IoMT based crime detection in a smart city by analyzing human emotions and CCTV videos. After detection and identification of crime, it is stored in the database and visualized using a Geographic Information System (GIS). E. Surveillance in IoMT A. Real Time Multimedia in IoMT The Web is the most widely used system for transmitting multimedia documents, which include text, audio, video (natural or synthetic), and other types of information. Multimedia data are fundamentally continuous, heterogeneous, and isochronous, three characteristics that when combined have significant real-time implications. Multimedia services, like video-on-demand or distributed simulation, are real-time applications with sophisticated temporal functionalities in their user interface. Real time multimedia will be very demanding is terms of bandwidth. B. Traffic Monitoring in IoMT One of the big problems in the smart city is effective traffic management and regulation. There are various solutions based on infrared detectors, magnetic loops, and Until now, the authentication scheme relied on the use of passwords. However, to close security gaps, the researcher has suggested a variety of IoT security and surveillance systems based on multimedia data, such as retina scanning, biometric scanning, voice recognition, and video surveillance systems. IoMT can tremendously enhance the capabilities of the traditional surveillance and security systems. F. Telemedicine in IoMT The IoMT paradigm has the potential to improve the applicability of telemedicine and bring significant advancements in tele-healthcare technology, especially in rural areas. IoMT's technical solutions have the potential to be particularly beneficial to developing countries. The patients under observation in a hospital can be examined by doctors from a remote location via multimedia devices. All Rights Reserved © 2021 IJERCSE 35 ISSN (Online) 2394-6849 International Journal of Engineering Research in Computer Science and Engineering (IJERCSE) Vol 8, Issue 3, March 2021 Data collected from these patients can enable doctors to identify any indication of upcoming severe event so that necessary action may be taken pre-determinedly. G. Public Warning in IoMT When a disaster strikes and local or national authorities need to warn residents to take precautions, IoMT devices such as bus stop displays, connected billboards or road displays, and even displays within buses and connected cars may help disseminate reliable and timely information to those in the affected area, whether on a local or national scale. H. Retina Authentication in IoMT The researcher proposes different strategies for implementing retina scanning and iris recognition to further improve the protection level of IoT using multimedia communication [98] describes a retina-based face recognition authentication method. In this article, retina modeling is improved by accurate truncation adaption, illumination classification, and lighting estimation. Yale B database is utilized to validate their model. I. Multimedia Security in IoMT A type of content-based defense is multimedia security. Content alludes to a higher level representation or semantics of the data in the sense of knowledge generation, processing, transmission, and storage [99]. Digital watermarking, data encryption, multimedia authentication, digital rights management, and other security issues are addressed by IoMT security. Network security does not sufficiently address the needs of content security because they often process information at the bitlevel which does not allow appropriate consideration of the semantics of the information. K. Smart Agriculture in IoMT Another important industrial field is agriculture. Researchers are attempting to use IoMT to revolutionize the agriculture sector and increase productivity. Authors is [100] present automatic irrigation and an infected area monitoring system using a wireless camera in the crop field to aid farmers. l. Health Monitoring in IoMT Multimedia data provides the medium to communicate, monitor, and cooperate with various aspects of daily life at numerous levels of granularity across various applications, which in terms of health is known as personal health media. Zafra et al. [101] addressed the issue of coexistence wearable devices for e-health with traditional three-layered IoT architecture and proposed a pervasive layered architecture to integrate M2M communication between e-health wearable and IoT devices. J. Recommendation Systems in IoMT In IoMT scenarios, a large number of services and applications are created, making it difficult for users to identify the most applicable ones. In this context, recommendation systems [102] are important enablers that allow for the identification of suitable resources and applications [103]. Recommendation systems suggest items of relevance examples of such recommendations [104] in IoMT scenarios are apps to be installed on a gateway, additional devices to be deployed and managed by a gateway. Further applications of recommendation technologies in the IoT context are the recommendation of health monitoring, traffic monitoring, smart agriculture, multimedia security prediction etc. UNCOVERED MATTER IN THE INTERNET OF MULTIMEDIA THINGS (IoMT) J. Societal Interaction in IoMT In the presence of IoMT multimedia devices, the concepts of smart societies and social interactions, which are currently a hot topic in science, can be given a new dimension. The societal and communal impact of the multimedia devices is huge and the increase in offered functionalities enabled by multimedia sensor devices is reshaping people-to-people interaction, people-to-device interaction and inter-devices interaction. The IoMT technology creates large amounts of multimedia data. IoMT technology faces a difficult challenge in managing large amounts of multimedia data. It's difficult to keep produced big multimedia data consistent, reusable, and reconcilable without proper management. Low-cost and small IoMT multimedia devices with limited memory resources are required [105]. Thus, efficient data acquisition methodologies should be developed which can alleviate the burden on All Rights Reserved © 2021 IJERCSE 36 ISSN (Online) 2394-6849 International Journal of Engineering Research in Computer Science and Engineering (IJERCSE) Vol 8, Issue 3, March 2021 memory resources. The need for higher data rates in the IoT communication stack to enable multimedia communication is one of the most important challenges. Since IEEE 802.15.4 was never designed to handle multimedia traffic [106], IoMT can rely on unlicensed wireless technology with higher data rates, such as Wi-Fi. Video is the element most often associated with the term multimedia. The communications channel capacity and storage requirements for transmitting and storing digital video are the most demanding of the multimedia elements. One minute of high-quality uncompressed video can consume 500 megabytes (MB) of storage space. Since the processing power of IoMT multimedia devices is restricted, existing multimedia encoding schemes cannot be used on these devices. As a result, less computationally complex encoding techniques are required; compressive sensing-based encoding techniques appear to be a promising technology in this regard. The multimedia streaming support of end-user devices can vary dramatically, from a mobile phone with minimal cellular bandwidth to a high end desktop computer with high-speed broadband Internet access. Therefore, real time streaming protocols are required to initialize sessions and retrieve multimedia content from servers, considering the processing capability and the Internet bandwidth of the user device. Higher compression of acquired multimedia raw data needs higher processing resources as a result the transmission bandwidth requirement is relaxed and vice versa. Therefore, it is a trade off between the level of compression achieved and the bandwidth requirement. To reduce the processing and energy consumption overheads from the multimedia sensing devices in the IoMT system, the acquired multimedia video must be encoded using low complexity encoders. Due to the demanding nature of multimedia data, IoMT devices are required to run on batteries that may not last very long [107]. Thus, efficient energy harvesting procedures need to be devised to energize sensors and prolong the network lifetime. CONCLUSION The world is undergoing a choreographic rapid change from isolated systems to widespread Internet based enabled ‘things’ competent of interacting each other and generating data that can be analyzed to bring out valuable information. This highly linked worldwide network structure known as Internet of Things (IoT) will enrich everybody existence. The smart distinct multimedia devices that interact and cooperate with one another and with other devices via the Internet create a new emerging paradigm called the Internet of Multimedia Things (IoMT). The Internet of Multimedia Things (IoMT) devices are totally distinct from IoT devices. The Multimedia Internet of Things (IoT) is the collection of interfaces, protocols, and allied multimedia associated information representations that enable advanced services and applications based on human to device and device to device interlink in naturalistic and virtual environments. It needs large memory, higher computational power, and more power peckish with higher bandwidth. The Internet of Multimedia Things (IoMT) orchestration enables the unification of systems, software, cloud, and smart sensors device into a solitary platform. In this paper, we present an extensive review of Internet of Multimedia Things (IoMT) and enabling technologies. We have also discussed some of the architectures of IoMT environment along with their applications and the future research challenges. Ultimately, novel solutions for multimedia data processing and management in the IoMT ecosystem can renovate comfortably quality of life, metropolitan environment, and smart city administration. Finally, this paper points out the open and prospective research areas that need to be solved in future Internet of Multimedia Things systems. REFERENCES [1] Yusuf Perwej, Mahmoud Ahmed AbouGhaly, Bedine Kerim and Hani Ali Mahmoud Harb. “An Extended Review on Internet of Things (IoT) and its Promising Applications”, f Communications on Applied Electronics (CAE), New York, USA, Volume 9, Number 26, Pages 8 – 22, February 2019, DOI: 10.5120/cae2019652812 [2] E. Park, Y. Cho, J. Han, and S. J. Kwon, ``Comprehensive approaches to user acceptance of Internet of Things in a smart home environment,'' IEEE Internet Things J., vol. 4, no. 6, pp. 2342 2350, Dec. 2017 [3] Yusuf Perwej, Majzoob K. Omer, Osama E. Sheta, Hani Ali M. Harb, Mohmed S. Adrees, “The Future of Internet of Things (IoT) and Its Empowering Technology” , International Journal of Engineering Science and Computing (IJESC), Volume 9, Issue No.3, Pages 20192 – 20203, March 2019 [4] L. Atzori, A. Iera, and G. Morabito, “The Internet of Things: A survey'', Comput. Netw., vol. 54, no. 15, pp. 2787 - 2805, 2010 [5] Akyildiz, I. F., Pierobon, M., Balasubramaniam, S., All Rights Reserved © 2021 IJERCSE 37 ISSN (Online) 2394-6849 International Journal of Engineering Research in Computer Science and Engineering (IJERCSE) Vol 8, Issue 3, March 2021 & Koucheryavy, Y. “ The internet of Bio-Nano things”, IEEE Communications Magazine, 53(3), pp. 32 – 40, 2015 [6] Whitmore, A., Agarwal, A., & Da Xu, L. “The Internet of Things - A survey of topics and trends”, Information Systems Frontiers, 17(2), pp. 261–274, 2015 [7] Firoj Parwej, Nikhat Akhtar, Yusuf Perwej, “An Empirical Analysis of Web of Things (WoT)”, International Journal of Advanced Research in Computer Science, Volume 10, No. 3, Pages 32-40, 2019, DOI: 10.26483/ijarcs.v10i3.6434 [8] Z. Sheng et al., “A survey on the ietf protocol suite for the Internet of Things: Standards, challenges, and opportunities,” IEEE Wireless Commun., vol. 20, no. 6, pp. 91–98, Dec. 2013 [9] A. Floris and L. Atzori, "Managing the quality of experience in the multimedia Internet of Things: A layered-based approach", Sensors, vol. 16, no. 12, pp. 2057, Dec. 2016 [10] S. A. Alvi, B. Afzal, G. A. Shah, L. Atzori, and W. Mahmood, ``Internet of multimedia things: Vision and challenges,'' Ad Hoc Netw., vol. 33, pp. 87_111, Oct. 2015 [11] R. Yao, W. Wang, M. Farrokh-Baroughi, H. Wang, and Y. Qian, “Quality-driven energy-neutralized power and relay selection for smart grid wireless multimedia sensor based iots,” IEEE Sensors Journal, vol. 13, no. 10, pp. 3637–3644, 2013 [12] Yusuf Perwej, “An Evaluation of Deep Learning Miniature Concerning in Soft Computing”, International Journal of Advanced Research in Computer and Communication Engineering, Volume 4, Issue 2, Pages 10 - 16, February 2015, DOI: 10.17148/IJARCCE.2015.4203 [13] E. Ramos, R. Morabito, and J. Kainulainen, “Distributing intelligence to the edge and beyond [research frontier],” IEEE Computational Intelligence Magazine, vol. 14, no. 4, pp. 65–92, Nov 2019 [14] S. Rani, S. H. Ahmed, R. Talwar, J. Malhotra, and H. Song, ``IoMT: A reliable cross layer protocol for Internet of multimedia things,'' IEEE Internet Things J., vol. 4, no. 3, pp. 832-839, Jun. 2017 [15] Yusuf Perwej , Kashiful Haq, Firoj Parwej, M. M. Mohamed Hassan,“ Internet of Things (IoT) and its Application Domains”, for published in the International Journal of Computer Applications, Volume 182, No.49, Pages 36- 49, April 2019 , DOI: 10.5120/ijca2019918763 [16] T. Qiu, N. Chen, K. Li, M. Atiquzzaman and W. Zhao, "How can heterogeneous Internet of Things build our future: A survey", IEEE Commun. Surveys Tuts., vol. 20, no. 3, pp. 2011-2027, 3rd Quart. 2018 [17] K. Ashton. Internet of things. RFID Journal [Online]. Available: http://www.rfidjournal.com/articles/view?4986 [18] Y. Li, M. Hou, H. Liu, and Y. Liu. Towards a theoretical framework of strategic decision, supporting capability and information sharing under the context of Internet of Things. Information Technology Management, vol. 13(4), pp. 205-216, 2012 [19] Yusuf Perwej, Firoj Parwej, Mumdouh Mirghani Mohamed Hassan, Nikhat Akhtar, “The Internet-ofThings (IoT) Security: A Technological Perspective and Review”, International Journal of Scientific Research in Computer Science Engineering and Information Technology (IJSRCSEIT), Volume 5, Issue 1, Pages 462-482, February 2019, DOI: 10.32628/CSEIT195193 [20] Mahmood, W. Energy efficient green routing protocol for Internet of Multimedia Things. In IEEE Tenth International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP), pp. 1-6, 2015 [21] loris, A., & Atzori, L. Quality of Experience in the Multimedia Internet of Things: Definition and practical use-cases. In IEEE International Conference on Communication Workshop (ICCW), pp. 17471752, 2015 [22] W. Wang, Q. Wang, and K. Sohraby,“Multimedia sensing as a service (MSaaS): exploring resource saving potentials of at cloud⁃edge IoTs and Fogs,”IEEE In ternet of Things Journal, vol. 4, no. 2, pp. 487-495, Jun. 2016 [23] Al-Anbagi, I., Erol Kantarci, M., & Mouftah, H. T. “A survey on cross layer quality of service approaches in WSNs for delay and reliability aware applications”, IEEE Communications Surveys and Tutorials, vol. 18(1), pp. 525-552, 2014 [24] P. Schulz, M. Matthe, H. Klessig, M. Simsek, G. Fettweis, J. Ansari, S. A. Ashraf, B. Almeroth, J. Voigt, I. Riedel et al., “Latency critical iot applications in 5g: Perspective on the design of radio interface and network architecture,” IEEE Communications Magazine, vol. 55, no. 2, pp. 70–78, 2017 [25] Sheeraz A. Alvi, Bilal Afzal, Ghalib A. Shah, Luigi Atzori, Waqar Mahmood, Internet of multimedia things: Vision and challenges, Ad Hoc Netw. 33 All Rights Reserved © 2021 IJERCSE 38 ISSN (Online) 2394-6849 International Journal of Engineering Research in Computer Science and Engineering (IJERCSE) Vol 8, Issue 3, March 2021 (2015) 87–111. [26] A. Floris and L. Atzori,“Quality of experience in the multimedia internet of things: definition and practical use cases,”in IEEE International Conference on Communication Workshop (ICCW), London, UK, Jun. 2015, pp. 1747-1752 [27] Atif Sharif, Vidyasagar Potdar, Elizabeth Chang, Wireless multimedia sensor network technology: A survey, 2009 7th IEEE International Conference on Industrial Informatics, IEEE 2009, pp. 606–613 [28] C. Perera, P. P. Jayaraman, A. Zaslavsky, P. Christen, and D. Georgakopoulos, “MOSDEN: An Internet of Things middleware for resource constrained mobile devices,” in Proc. 47th Hawaii Int. Conf. Syst. Sci., Waikoloa Village, HI, USA, Jan. 2014, pp. 1053– 1062 [29] Aparna Kumari, Sudeep Tanwar, Sudhanshu Tyagi, Neeraj Kumar, Michele Maasberg, Kim-Kwang Raymond Choo, Multimedia big data computing and internet of things applications: A taxonomy and process model, J. Netw. Comput. Appl. 124 (2018) 169–195 [30] N. Bisnik, A. Abouzeid, and V. Isler, “Stochastic event capture using mobile sensors subject to a quality metric,” in Proc. ACM MobiCom, Los Angeles, CA, USA, pp. 98–109, 2006 [31] M. A. Hoque, M. Seik., and J. K. Nurminen, ``Energy efficient multimedia streaming to mobile devices_A survey,'' IEEE Commun. Surveys Tuts., vol. 16, no. 1, pp. 579_597, 2014 [32] X. Xu, J. Luo, and Q. Zhang, “Delay tolerant event collection in sensor networks with mobile sink,” in Proc. INFOCOM, San Diego, CA, USA, Mar. 2010, pp. 1–9. [33] A. Karaadi, L. Sun, and I.-H. Mkwawa, ``Multimedia communications in Internet of Things QoT or QoE?'' in Proc. IEEE Int. Conf. Internet Things (iThings) IEEE Green Comput. Commun. (GreenCom) IEEE Cyber., Phys. Social Comput. (CPSCom) IEEE Smart Data (SmartData), Exeter, U.K., Jun. 2017 [34] L. He, Z. Yang, J. Pan, L. Cai, and J. Xu, “Evaluating service disciplines for mobile elements in wireless ad hoc sensor networks,” in Proc. INFOCOM, Orlando, FL, USA, 2012, pp. 576–584 [35] K. Thiyagarajan, R. Lu, K. El-Sankary, and H. Zhu, ``Energy-aware encryption for securing video transmission in Internet of Multimedia Things,'' IEEE Trans. Circuits Syst. Video Technol., vol. 29, no. 3, pp. 610_624, Mar. 2019 [36] G. T. Singh and F. M. Al-Turjman, “Learning data delivery paths in QoI aware information-centric sensor networks,” IEEE Internet Things J., vol. 3, no. 4, pp. 572–580, Aug. 2016 [37] P. Hu, H. Ning, L. Chen and M. Daneshmand, "An open Internet of Things system architecture based on software-defined device", IEEE Internet Things J., vol. 6, no. 2, pp. 2583-2592, Apr. 2019 [38] Yusuf Perwej, “An Experiential Study of the Big Data”, International Transaction of Electrical and Computer Engineers System (ITECES), USA, Science and Education Publishing, Volume 4, No. 1, Pages 14-25, March 2017 DOI: 10.12691/iteces-41-3 [39] N. A. Loan, N. N. Hurrah, S. A. Parah, J. W. Lee, J. A. Sheikh and G. M. Bhat, "Secure and robust digital image watermarking using coefficient differencing and chaotic encryption", IEEE Access, vol. 6, pp. 19876-19897, 2018 [40] W. Zhu, P. Cui, Z. Wang, G. Hua, "Multimedia big data computing", IEEE Multi.Mag., vol. 22, no. 3, pp. 96-103, 2015 [41] Ling Guan, Yifeng He, Sun-Yuan Kung, Multimedia Image and Video Processing, CRC press, 2012 [42] Alessandro Floris, Luigi Atzori, Quality of experience in the multimedia internet of things: Definition and practical use-cases, Communication Workshop (ICCW), IEEE International Conference on, IEEE, pp. 1747–1752, 2015 [43] Nikhat Akhtar, Yusuf Perwej, “The Internet of Nano Things (IoNT) Existing State and Future Prospects”, GSC Advanced Research and Reviews (GSCARR), Volume 5, Issue 2, Pages 131-150, 2020, DOI: 10.30574/gscarr.2020.5.2.0110 [44] Y. B. Zikria, M. K. Afzal and S. W. Kim, "Internet of multimedia things (IoMT): Opportunities challenges and solutions", Sensors, vol. 20, no. 8, pp. 2334, Apr. 2020 [45] F. Alshahwan, "Adaptive security framework in Internet of Things (IoT) for providing mobile cloud computing" in Mobile Computing Technology and Applications, London, U.K.:IntechOpen, 2018 [46] Aslam, A.; Curry, E. Towards a Generalized Approach for Deep Neural Network Based Event Processing for the Internet of Multimedia Things. IEEE Access, 2018 [47] A. Karaadi, L. Sun and I.-H. Mkwawa, "Multimedia communications in Internet of Things QoT or QoE?", Proc. IEEE Int. Conf. Internet Things (iThings) IEEE Green Comput. Commun. (GreenCom) IEEE Cyber. Phys. Social Comput. (CPSCom) IEEE Smart Data All Rights Reserved © 2021 IJERCSE 39 ISSN (Online) 2394-6849 International Journal of Engineering Research in Computer Science and Engineering (IJERCSE) Vol 8, Issue 3, March 2021 (SmartData), Jun. 2017 [48] Guojie Yang at.al.,” Interoperability and Data Storage in Internet of Multimedia Things: Investigating Current Trends, Research Challenges and Future Directions ”,IEEE, Volume: 8, PP. 124382 – 124401, June 2020 [49] Qadri, Y.A.; Nauman, A.; Zikria, Y.B.; Vasilakos, A.V.; Kim, S.W. “The Future of Healthcare Internet of Things: A Survey of Emerging Technologies” IEEE Commun. Surv. Tutor, 2020 [50] A. Rego, A. Canovas, J. M. Jimenez, and J. Lloret, ``An intelligent system for video surveillance in IoT environments,'' IEEE Access, vol. 6, pp. 3158031598, 2018 [51] Yusuf Perwej, Firoj Parwej, “A Neuroplasticity (Brain Plasticity) Approach to Use in Artificial Neural Network”, International Journal of Scientific & Engineering Research (IJSER), France , Volume 3, Issue 6, Pages 1- 9, June 2012, DOI: 10.13140/2.1.1693.2808 [52] Nikhat Akhtar, “Perceptual Evolution for Software Project Cost Estimation using Ant Colony System”, International Journal of Computer Applications, Volume 81, No.14, Pages 23 – 30, 2013, DOI: 10.5120/14185-2385 [53] Y. Kaeri, C. Moulin, K. Sugawara, and Y. Manabe, ``Agent-based system architecture supporting remote collaboration via an Internet of Multimedia Things approach,'' IEEE Access, vol. 6, pp. 17067_17079, 2018 [54] M. A. Rahman, M. S. Hossain, E. Hassanain, and G. Muhammad, ``Semantic multimedia fog computing and IoT environment: Sustainability perspective,'' IEEE Commun. Mag., vol. 56, no. 5, pp. 80_87, May 2018 [55] Yusuf Perwej, S. A. Hannan, Firoj Parwej, Nikhat Akhtar , “A Posteriori Perusal of Mobile Computing”, International Journal of Computer Applications Technology and Research (IJCATR), ATS (Association of Technology and Science), Volume 3, Issue 9, Pages 569 - 578, 2014, DOI: 10.7753/IJCATR0309.1008 [56] K. P. Seng and L.-M. Ang, ``A big data layered architecture and functional units for the multimedia Internet of Things,'' IEEE Trans. Multi-Scale Comput. Syst., vol. 4, no. 4, pp. 500_512, Oct. 2018 [57] X. Huang, K. Xie, S. Leng, T. Yuan and M. Ma, "Improving quality of experience in multimedia Internet of Things leveraging machine learning on big data", Future Gener. Comput. Syst., vol. 86, pp. 1413-1423, Sep. 2018 [58] L. Zhou and H.-C. Chao, ``Multimedia traf_c security architecture for the Internet of Things,'' IEEE Netw., vol. 25, no. 3, pp. 35_40, May 2011 [59] D. Kundur,W. Luh, U. Okorafor, and T. Zourntos, ``Security and privacy for distributed multimedia sensor networks,'' Proc. IEEE, vol. 96, no. 1, pp. 112_130, Jan. 2008 [60] A. M. Eskicioglu, ``Multimedia security in group communications: Recent progress in key management, authentication, and watermarking,'' Multimedia Syst., vol. 9, no. 3, pp. 239_248, Sep. 2003 [61] Yusuf Perwej, Asif Perwej, Firoj Parwej, “An Adaptive Watermarking Technique for the copyright of digital images and Digital Image Protection”, International Journal of Multimedia & Its Applications (IJMA), Academy & Industry Research Collaboration Center (AIRCC) , USA , Volume 4, No.2, Pages 2138, 2012, DOI: 10.5121/ijma.2012.4202 [62] Liang Zhou, Han-Chieh Chao,” Multimedia Traffic Security Architecture for the Internet of Things”, IEEE Network , Volume 25, Issue 3, Page 35 – 40, 2011 [63] T. AlSkaif, B. Bellalta, M. G. Zapataa and J. M. Barcelo-Ordinas, "Energy efficiency of MAC protocols in low data rate wireless multimedia sensor networks: A comparative study", Ad Hoc Netw., vol. 56, pp. 141-157, Mar. 2017 [64] Hamidouche, R.; Aliouat, Z.; Gueroui, A.M.; Ari, A.A.A.; Louail, L. Classical and bio-inspired mobility in sensor networks for IoT applications. J. Netw. Comput. Appl., 121, pp. 70–88, 2018 [65] Nikhat Akhtar, Firoj Parwej, Yusuf Perwej, “A Perusal of Big Data Classification and Hadoop Technology”, International Transaction of Electrical and Computer Engineers System (ITECES), USA, Volume 4, No. 1, Pages 26-38, May 2017, DOI: 10.12691/iteces-4-1-4 [66] W. Robitza, A. Ahmad, P. A. Kara, L. Atzori, M. G. Martini, A. Raake, and L. Sun, ``Challenges of future multimedia QoE monitoring for Internet service providers,'' Multimedia Tools Appl., vol. 76, no. 21, pp. 22243_22266, Nov. 2017 [67] F. Al-Turjman and A. Radwan, "Data delivery in wireless multimedia sensor networks: Challenging and defying in the IoT era", IEEE Wireless Commun., vol. 24, no. 5, pp. 126-131, Oct. 2017 [68] Garcia-Sanchez AJ, Losilla F, Rodenas-Herraiz D, All Rights Reserved © 2021 IJERCSE 40 ISSN (Online) 2394-6849 International Journal of Engineering Research in Computer Science and Engineering (IJERCSE) Vol 8, Issue 3, March 2021 Cruz-Martinez F, Garcia-Sanchez F ,””On the feasibility of wireless multimedia sensor networks over ieee 802.15.5 mesh topologies.”, Sensors 16:5, 2016 [69] Yusuf Perwej, Kashiful Haq, U. Jaleel , S. Saxena , “Some Drastic Improvements Found in the Analysis of Routing Protocol for the Bluetooth Technology Using Scatternet”, Special Issue on the International Conference on Computing, Communications and Information Technology Applications (CCITA2010), Ubiquitous Computing and Communication Journal (UBICC), Seoul, South Korea, ISSN Online: 1992-8424, ISSN Print: 1994-4608, Volume CCITA2010, Number 5 , Pages 86-95, 2010 [70] A. Canovas, J. M. Jimenez, O. Romero and J. Lloret, "Multimedia data flow traffic classification using intelligent models based on traffic patterns", IEEE Netw., vol. 32, no. 6, pp. 100-107, Nov. 2018 [71] K. S. Dar, A. Taherkordi and F. Eliassen, "Enhancing Dependability of Cloud-Based IoT Services through Virtualization", 2016 IEEE First International Conference on Internet-of-Things Design and Implementation (IoTDI), pp. 106-116, 2016 [72] R. D. Hartman, "Architecture and measured characteristics of a cloud based internet of things", Collaboration Technologies and Systems (CTS) 2012 International Conference on. IEEE, pp. 6-12, 2012 [73] Wenwu Zhu, Chong Luo, Jianfeng Wang, Shipeng Li, Multimedia cloud computing, IEEE Signal Process. Mag. 28 (3) (2011) 59–69 [74] Mingfeng Tan, Xiao Su, Media cloud: when media revolution meets rise of cloud computing, in: IEEE 6th International Symposium on Service Oriented System Engineering (SOSE), 2011, IEEE, 2011, pp. 251–261 [75] Yusuf Perwej, “A Pervasive Review of Blockchain Technology and Its Potential Applications”, Open Science Journal of Electrical and Electronic Engineering (OSJEEE), New York, USA, Volume 5, No. 4, Pages 30 - 43, October, 2018 [76] Yusuf Perwej, Nikhat Akhtar, Firoj Parwej, “A Technological Perspective of Blockchain Security”, International Journal of Recent Scientific Research (IJRSR), ISSN: 0976-3031, Volume 9, Issue 11, (A), Pages 29472 – 29493, November 2018, DOI: 10.24327/ijrsr.2018.0911.2869 [77] Xi Lin, Jianhua Li, Jun Wu, Haoran Liang, and Wu Yang. ,“ Making knowledge tradable in edge AI enabled IoT: A consortium blockchain-based efficient and incentive approach”, IEEE Trans. Industr. Info. No. 15, vol. 12, pp. 6367–6378, 2019 [78] Z. Huang, C. Mei, L. E. Li, T.Woo, ``CloudStream: Delivering highquality streaming videos through a cloud-based SVC proxy,'' in Proc. IEEE INFOCOM, Apr., pp. 201-205, 2011 [79] Sanjit Kumar Dash, Subasish Mohapatra, Prasant Kumar Pattnaik, A survey on applications of wireless sensor network using cloud computing, Int. J. Comput. Sci. Eng. Technol. 1 (4), 50–55 (EISSN:2044-6004), 2010 [80] B.B.P. Rao, P. Saluia, N. Sharma, A. Mittal, S.V. Sharma, Cloud computing for Internet of things & sensing based applications, in: Sixth International Conference on Sensing Technology (ICST), 2012, IEEE, pp. 374–380, 2012 [81] Arkady Zaslavsky, Charith Perera, Dimitrios Georgakopoulos, Sensing as a Service and Big Data,.1301.0159, 2013 [82] Andrea Prati, Roberto Vezzani, Michele Fornaciari, Rita Cucchiara, Intelligent video surveillance as a service, in: Intelligent Multimedia Surveillance, Springer, pp. 1–16, 2013 [83] C. Raskar and N. Shikha, ``A review on Internet of Things,'' in Proc. Int. Conf. Intell. Sustain. Syst., pp. 479-484, 2019 [84] Eisa, M., Younas, M., Basu K.: Analysis representation of QoS attributes in cloud service selection. In: Proceedings of the 32nd International Conference on Advanced Information Networking and Applications, Cracow, Poland, 2018 [85] Q. Zhang, Z. Ji, W. Zhu, and Y.-Q. Zhang, “Powerminimized bit allocation for video communication over wireless channels,” IEEE Trans. Circuits Syst. Video Technol., Vol. 12, No. 6, pp. 398–410, June 2002 [86] K. Kilkki, “Quality of experience in communications ecosystem,” J. Universal Computer Sci., Vol. 14, No. 5, pp. 615–624, 2008 [87] V. Gazis, “A survey of standards for machine to machine (m2m) and the internet of things (iot),” IEEE Communications Surveys & Tutorials, 2016 [88] D. Rivera, N. Kushik, C. Fuenzalida, A. Cavalli, and N. Yevtushenko,“QoE Evaluation based on QoS and QoBiz Parameters applied to an OTT service”, IEEE International Conference on Web Services, (New York, NY, USA), pp. 57–64, 2015 [89] K. Chelli, "Security Issues in Wireless Sensor Networks: Attacks and Countermeasures", Proceedings of the World Congress on Engineering 2015 Vol I, July 1 - 3, 2015 All Rights Reserved © 2021 IJERCSE 41 ISSN (Online) 2394-6849 International Journal of Engineering Research in Computer Science and Engineering (IJERCSE) Vol 8, Issue 3, March 2021 [90] H. Wang, Y. Qian, and H. Sharif, “Multimedia communications over cognitive radio networks for smart grid applications,” IEEE wireless communications, vol. 20, no. 4, pp. 125–132, 2013 [91] C. Wang, Q. Wang, K. Ren, N. Cao and W. Lou, "Towards Secure and Dependable Storage Services in Cloud Computing", IEEE Transactions on Cloud Computing Date of Publication, vol. 5, no. 2, AprilJune 2012 [92] P. Garcia Lopez, A. Montresor, D. Epema, A. Datta, T. Higashino, A. Iamnitchi, M. Barcellos, P. Felber, and E. Riviere, “Edge-centric computing: Vision and challenges,” ACM SIGCOMM Computer Communication Review, vol. 45, no. 5, pp. 37–42, 2015 [93] O Bello, S Zeadally and M Badra, Network layer inter-operation of Device-to-Device communication technologies in Internet of Things (IoT) [M], Elsevier Science Publishers B. V, 2017 [94] Yusuf Perwej, Firoj Parwej, “Perceptual Evolution of Playout Buffer Algorithm for Enhancing Perceived Quality of Voice Transmission Over IP”, International Journal of Mobile Network Communications & Telematics (IJMNCT), Academy & Industry Research Collaboration Center (AIRCC) , USA , Volume 2, No. 2, Pages 1- 19, 2012, DOI: 10.5121/ijmnct.2012.2201 [95] V. Gazis, “A survey of standards for machine to machine (m2m) and the internet of things (iot),” IEEE Communications Surveys & Tutorials, 2016 [96] Michele S., Cristian P.,” Next generation architecture for real time multimedia applications”, AEIT International Annual Conference, IEEE, Cagliari, 2017 [97] J. Y. Byun and A. Nasridinov, ``Internet of Things for smart crime detection,'' Contemp. Eng. Sci., vol. 7, no. 15, pp. 749_754, 2014 [98] Y. Cheng, L. Jiao, Z. Li, and X. Cao, ``An improved retinal modeling for illumination face recognition,'' in Proc. IEEE Int. Conf. Image Process. (ICIP), Paris, Italy, Oct. 2014 [99] Wenjun Zeng and Shawmin Lei, "Efficient frequency domain selective scrambling of digital video", Proc. of the IEEE Transactions on Multimedia, pp. 118129, 2002 [100] G. Nisha and J. Megala, ``Wireless sensor network based automated irrigation and crop field monitoring system,'' in Proc. 6th Int. Conf. Adv. Comput. (ICoAC), India, 2014 [101] A. R. Zafra, K. Benghazi, C. Mavromoustakis, and M. Noguera, ``An IoT-aware architectural model for smart habitats,'' in Proc. IEEE 16th Int. Conf. Embedded Ubiquitous Comput. (EUC), Bucharest, Romania, Oct. 2018 [102] Nikhat Akhtar, Devendera Agarwal, “A Literature Review of Empirical Studies of Recommendation Systems”, International Journal of Applied Information Systems (IJAIS), ISSN : 22490868, Foundation of Computer Science FCS, New York, USA, Volume 10, No.2, Pages 6 – 14, December 2015, DOI: 10.5120/ijais2015451467 [103] Felfernig, A., Jeran, M., Ninaus, G., Reinfrank, F., and Reiterer, S. Toward the Next Generation of Recommender Systems: Applications and Research Challenges, Multimedia Services in Intelligent Environments, Smart Innovation, Systems and Technologies, 24:81-98, Springer , 2013 [104] Nikhat Akhtar, Devendera Agarwal, “An Efficient Mining for Recommendation System for Academics”, International Journal of Recent Technology and Engineering (IJRTE), ISSN 22773878 (online), SCOPUS, Volume-8, Issue-5, Pages 1619-1626, January 2020, DOI: 10.35940/ijrte.E5924.018520 [105] Verma, S., Kawamoto, Y., Fadlullah, Z., Nishiyama, H., ,”& Kato, N. (). A survey on network methodologies for real-time analytics of massive IoT data and open research issues”, IEEE Communications Surveys & Tutorials, 19, 1457– 1477, 2017 [106] S. Rashwand, J. Misic and H. Khazaei, "IEEE 802.15.6 under saturation: Some problems to be expected", Communications and Networks Journal, vol. 13, no. 2, pp. 142-148, April 2011 [107] H. Li, K. Wang, X. Liu, Y. Sun and S. Guo, "A selective privacy-preserving approach for multimedia data", IEEE Multimedia, vol. 24, no. 4, pp. 14-25, Oct./Dec. 2017 All Rights Reserved © 2021 IJERCSE 42