Lesson 2

Data Acquiring and Storing Functions for IoT/M2M

Devices Data and Messages

Chapter-5 L02: "Internet of Things " , Raj Kamal,

2017 1
Publs.: McGraw-Hill Education
 (Collect + Assemble +Manage) for analytics and Acquire, Organize and Analyse
Intelligence) Manage applications, services, enterprise and
Cloud Infrastructure Device business processes and Intelligence

Informix Time Data Centre Server Mgmt Identity Mgmt

Assemble events from the IoT into logic flows in

series service Mgmt. & access Data Centre Server Mgmt
Mgmt. Mgmt.
Device
Register Analytics In-memory
and connect and Intelligence Analytics
Big Big and Business

Database Firewall
Data Store Data Store Intelligence

Internet Firewall

Database Firewall
Internet Firewall

Device Key Value

Collect from
NoSQL Access Data Store
things.
Mgmt
Device Database
Manage Relational Time Identity RDBMS Complex
time-series Series service Mgmt
view of data Enterprise Applicati
Device ons
Mgmt. Integration
Spatial Storage and Integratio
Manage Real Time Analytics n and
Data Routing &
connections and Mgmt. SoA
Analysis
Subscriptions

SoA: Service Oriented Architecture

Consumer/Business
(a) (b)

Fig. 5.1 (a) Connect + Collect + Assemble +Manage IBM conceptual framework (b) Manage, Acquire, Organise and 2
2017 Analyse Oracle’s framework in the IoT Architecture
 Data Generation
• IoT/M2M devices data
• Events data
• Real time data generation
• Analytics, Intelligence and Processes

Chapter-5 L02: "Internet of Things " , Raj Kamal,

2017 3
Publs.: McGraw-Hill Education
 Passive Devices Data
• Data generates at the device or system
• Data following the result of interactions
• A passive device does not have own power source
• An external source makes that device to send data
• RFID or an ATM debit card

Chapter-5 L02: "Internet of Things " , Raj Kamal,

2017 4
Publs.: McGraw-Hill Education
 Passive Device
• A contactless card have or may not have an associated
microcontroller, Memory and transceiver
• Level or barcode not have an associated microcontroller

Chapter-5 L02: "Internet of Things " , Raj Kamal,

2017 5
Publs.: McGraw-Hill Education
 Active Devices Data
• Data generates at the device or system
• Data following the result of interactions
• Active device own power source
• Examples: Active RFIDs, streetlight sensor, wireless
sensor node.
• Active device associated microcontroller, memory and
transceiver.

Chapter-5 L02: "Internet of Things " , Raj Kamal,

2017 6
Publs.: McGraw-Hill Education
 Event Data from Device
• Generating data on an event once only
• Detection of the traffic or on dark ambient conditions, that
signals an event. Then event communicates a need for the
lighting up a group of streetlights.

Chapter-5 L02: "Internet of Things " , Raj Kamal,

2017 7
Publs.: McGraw-Hill Education
 Event Data from Device
• A system consisting of security cameras generating data
on an event of security breach or on intrusion detection
• A waste container with associate circuit generating data in
the event of getting it 90% or above filled up.

Chapter-5 L02: "Internet of Things " , Raj Kamal,

2017 8
Publs.: McGraw-Hill Education
 Event Data from Device
• The components and devices in an automobile generate
data of their performance and functioning, and
communicate to Internet as and when the automobile
reaches near a Wi-Fi access point

Chapter-5 L02: "Internet of Things " , Raj Kamal,

2017 9
Publs.: McGraw-Hill Education
 Example of Event Driven device Data

• A device receives command from Controller and

Monitor, and
• Then performs actions using an actuator.
• When the action completes, then device sends an
acknowledgement.

Chapter-5 L02: "Internet of Things " , Raj Kamal,

2017 10
Publs.: McGraw-Hill Education
 Example of Event driven Data

• An Application seeks status of a device, then the

device communicating the status

Chapter-5 L02: "Internet of Things " , Raj Kamal,

2017 11
Publs.: McGraw-Hill Education
 Device Real Time Data:
• An ATM generating data and communicates to Server
instantaneously through Internet
• Then initiating and enabling Online Transactions
Processing (OLTP) in real time.

Chapter-5 L02: "Internet of Things " , Raj Kamal,

2017 12
Publs.: McGraw-Hill Education
 Data Acquisition
• Data acquisition means acquiring the data from IOT/M2M
devices
• The data communicate after the interactions with a Data
acquisition system (Application)

Chapter-5 L02: "Internet of Things " , Raj Kamal,

2017 13
Publs.: McGraw-Hill Education
 Data Acquisition
• The Application interacts and communicates with number
of devices for acquiring the needed data
• The devices send data on demand or at the programmed
intervals
• Data of devices communicate using the network, transport
and security layers.

Chapter-5 L02: "Internet of Things " , Raj Kamal,

2017 14
Publs.: McGraw-Hill Education
 Device management software
• Provisioning for the device ID or address, activation,
• Configuring (managing device parameters and settings),
• Registering, deregistering,
• Attaching, detaching.

Chapter-5 L02: "Internet of Things " , Raj Kamal,

2017 15
Publs.: McGraw-Hill Education
 Data Validation
• Data needs validation checks
• Data validation software do the validation checks
• Validation software applies logic, rules and semantic
annotations.

Chapter-5 L02: "Internet of Things " , Raj Kamal,

2017 16
Publs.: McGraw-Hill Education
 Data Validation
• Must as the Applications/services/Processes depend on
valid data
• Then only the analytics, predictions/ prescriptions/
diagnosis/decisions acceptable

Chapter-5 L02: "Internet of Things " , Raj Kamal,

2017 17
Publs.: McGraw-Hill Education
 Data Store
• Database
• Relational database
• Flat file
• Spreadsheet
• Mail server
• Web server

Chapter-5 L02: "Internet of Things " , Raj Kamal,

2017 18
Publs.: McGraw-Hill Education
 Data Store
• The acquired data stores in the databases at a server

Chapter-5 L02: "Internet of Things " , Raj Kamal,

2017 19
Publs.: McGraw-Hill Education
 Data Storage Three Categories
1. On-line or real time or streaming data needing the
processing, and only the results of processing and analysis
need storage

Chapter-5 L02: "Internet of Things " , Raj Kamal,

2017 20
Publs.: McGraw-Hill Education
 Data Storage Three Categories
2. Data called once, only the results of processing at a later
time and of analysis store,

Chapter-5 L02: "Internet of Things " , Raj Kamal,

2017 21
Publs.: McGraw-Hill Education
 Data Storage Three Categories
3. Data needing repeated calls store for reference or audit in
future.,

Chapter-5 L02: "Internet of Things " , Raj Kamal,

2017 22
Publs.: McGraw-Hill Education
 Data Store
• VMware at one node or distributed multiple nodes
• A Data Store is a data repository of a set of objects
which integrate into the Store.

Chapter-5 L02: "Internet of Things " , Raj Kamal,

2017 23
Publs.: McGraw-Hill Education
 Data Store Features
• Objects in a Data Store model using Classes which
the database schemas define.
• Data Store may be distributed over multiple nodes,
(Apache Cassandra is example of distributed Data
Store.)

Chapter-5 L02: "Internet of Things " , Raj Kamal,

2017 24
Publs.: McGraw-Hill Education
 Data Store
• A Data Store may consist of multiple schemas or may
consist of data in only one scheme. (Example of only
one scheme Data Store is relational database.)

Chapter-5 L02: "Internet of Things " , Raj Kamal,

2017 25
Publs.: McGraw-Hill Education
 Data Store at Server

• For short reaction times, Optimised performance and

high security

Chapter-5 L02: "Internet of Things " , Raj Kamal,

2017 26
Publs.: McGraw-Hill Education
 Data Centre Data Store

• Data security and protection using the advanced tools,

full data backups along with data recovery, redundant
data communication connections and full system
power

Chapter-5 L02: "Internet of Things " , Raj Kamal,

2017 27
Publs.: McGraw-Hill Education
 Data Store Management

• Data Store requires Data Centre management or Server

management.

Chapter-5 L02: "Internet of Things " , Raj Kamal,

2017 28
Publs.: McGraw-Hill Education
 Spatial storage
• Spatial database optimised to store, enables querying
the data objects defined in a geometric space, and
which is a database for 2D and 3D objects

Chapter-5 L02: "Internet of Things " , Raj Kamal,

2017 29
Publs.: McGraw-Hill Education
 Spatial storage

• Topological coverage, linear networks, triangular

irregular networks or other complex structures.

Chapter-5 L02: "Internet of Things " , Raj Kamal,

2017 30
Publs.: McGraw-Hill Education
 Summary
We learnt
• Data of Passive and Active Devices
• Events generated data
• Real time Data
• Data Acquisition
• Data Validation
• Data Store

Chapter-5 L02: "Internet of Things " , Raj Kamal,

2017 31
Publs.: McGraw-Hill Education
 End of Lesson 2 on
Data Acquiring and Storing Functions for IoT/M2M
Devices Data and Messages

Chapter-5 L02: "Internet of Things " , Raj Kamal,

2017 32
Publs.: McGraw-Hill Education