Data Science with Python

Day 1 - Introduction to Data Science

18008338228 +65 31586636 +1(973) 598-3969 44 203-808-4216 www.cognixia.com • bdg@cognixia.com

 Data Science with Python

Today’s Agenda

✓ Data Science Introduction ✓ Job outlook

• What is Data Science? • What are the opportunities?
• Some Examples of Data Science ✓ Target Audience & Prerequisites
Project Objective • Who is more suitable?
✓ Data Science Toolkit • What is expected?
• What you need to learn? ✓ Your Specific Questions

18008338228 +65 31586636 +1(973) 598-3969 44 203-808-4216 www.cognixia.com • bdg@cognixia.com

 Data Science with Python

Data Science Introduction

What is Data Science?

“Data science, also known as data-driven science, is an interdisciplinary field about scientific methods,
processes, and systems to extract knowledge or insights from data present in various forms, either
structured or unstructured.”

Data science employs techniques and theories drawn from a wide range of disciplines like Mathematics,
Statistics, Information Science, and Computer Science, in particular from the subdomains of Machine learning,
Classification, Association, Cluster analysis, Data mining, forecasting and Visualization in order to understand
and analyze actual phenomena with data.

Data Science : Data + Science = Knowledge

18008338228 +65 31586636 +1(973) 598-3969 44 203-808-4216 www.cognixia.com • bdg@cognixia.com

 Data Science with Python

Examples of Data Science Project Objectives

▪ Regression Analysis – Finding the relationship between a dependent variable and one or
more independent variables - Predicting Diamond price based on Carat, Cut & Clarity
▪ Classification Analysis – Dividing objects into 2 or more known classes - Distinguishing cancer and
normal cells
▪ Anomalies Detection(Outliers Analysis) - Finding unusual - Credit card transactions
▪ Association Analysis – Finding links - Shopping cart analysis
▪ Cluster Analysis (Segmentation) – Grouping similar objects together - Grouping customers into
different clusters based on their previous shopping data/transactions.
▪ Time Series Analysis – Time dependent Data - Stock prediction

18008338228 +65 31586636 +1(973) 598-3969 44 203-808-4216 www.cognixia.com • bdg@cognixia.com

 Data Science with Python

Data Science Toolkit

What you need to learn?

✓ Data Engineering – Getting and Processing the data - Python, R, PL/SQL, SAS, ETL, Big Data
✓ Data Analysis – Exploratory Data Analysis, Predictive and Descriptive Analysis - Python, R, SAS
✓ Statistics & Probabilities – Basic and advance concepts of Statistics and Probability, Inferential Statistics -
Python, R, SAS.
✓ Analytics & Visualization – Interactive visual Presentation of data and findings - Python, R, MATLAB, SAS,
Tableau or other visualization tools.
✓ Machine Learning – To Apply the algorithm on data - Python, R, SAS & other IDEs like Microsoft Azure ML
Studio, IBM SPSS, SAP Predictive Analytics.

++ Business or Domain Knowledge ++

18008338228 +65 31586636 +1(973) 598-3969 44 203-808-4216 www.cognixia.com • bdg@cognixia.com

 Data Science with Python

What are the opportunities?

“Data Science is not a Technology but a whole New world”

▪ Data Engineer
▪ Dashboard/Analytics Expert
▪ Data Analyst
▪ Machine Learning Expert
▪ Data Scientist – One for ALL!!

18008338228 +65 31586636 +1(973) 598-3969 44 203-808-4216 www.cognixia.com • bdg@cognixia.com

 Data Science with Python

Prerequisites & Target Audience

Prerequisite or who is suitable to get into Data Science?

Most Suitable : Professional already working as Data Analyst, Analytics Expert, BI Developers/Architects,
ETL/Big data Engineer/Architects, DWH Designer/Architects.

Minimum Criteria :
✓ Basic understanding of programming concepts like PL/SQL,C, C++, Java & RDBMS.
✓ Basic knowledge of Mathematics and Statistics Concepts.
✓ Basic Knowledge of Reporting or Visualization like Tableau, Spotfire, SAP Business Objects or any other
reporting tools.

Great Determinations! Dedications! Consistency! and Confidence !!

18008338228 +65 31586636 +1(973) 598-3969 44 203-808-4216 www.cognixia.com • bdg@cognixia.com

 Data Science with Python

Get Set Ready!!!

Homework
▪ Do some more Research on What is Data Science & Machine Learning

▪ Try to understand CRISP-DM Methodology

https://www.the-modeling-agency.com/crisp-dm.pdf

18008338228 +65 31586636 +1(973) 598-3969 44 203-808-4216 www.cognixia.com • bdg@cognixia.com

 Data Science with Python

“Qs & As”

18008338228 +65 31586636 +1(973) 598-3969 44 203-808-4216 www.cognixia.com • bdg@cognixia.com

18008338228 +65 31586636 +1(973) 598-3969 44 203-808-4216 www.cognixia.com • bdg@cognixia.com
Data Science with Python
Day 2 - Data Science Project Life Cycle

18008338228 +65 31586636 +1(973) 598-3969 44 203-808-4216 www.cognixia.com • bdg@cognixia.com

 Data Science with Python

Today’s Agenda

✓ Data Science Project Life Cycle ✓ Basics of Statistics

• CRISP - DM Process Model • Random Variable
• CRISP - DM Phases • Type of Random Variables
o Business understanding • Central Tendencies
o Data understanding o Mean
o Data preparation o Mode
o Modeling o Median
o Evaluation • Probability, Probability Distribution of
o Deployment Random Variables

18008338228 +65 31586636 +1(973) 598-3969 44 203-808-4216 www.cognixia.com • bdg@cognixia.com

 Data Science with Python

Data Science Project Life Cycle

What is CRISP-DM ?
CRISP-DM was conceived in late 1996 by three veterans of the young and
immature data mining market. CRISP Stands for “CRoss-Industry Standard
Process for Data Mining”

This Process model for data mining provides an overview of the life cycle of a
data mining project. It contains all the phases of a project, their respective tasks,
and the relationships between these tasks. Relationships could exist between any
data mining tasks depending on the goals, the background, and the interest of the
user–and most importantly–on the data.

18008338228 +65 31586636 +1(973) 598-3969 44 203-808-4216 www.cognixia.com • bdg@cognixia.com

 Data Science with Python

Data Science Project Life Cycle

CRISP-DM Phases
The life cycle of a data mining project consists of six phases as shown –

1. Business understanding - This initial phase focuses on understanding the project

objectives and requirements from a business perspective, then converting this knowledge into a
data mining problem definition and a preliminary plan designed to achieve the objectives.

2. Data understanding -The data understanding phase starts with initial data collection and
proceeds with activities that enable you to become familiar with the data.

3. Data preparation - The data preparation phase covers all activities needed to construct
the final dataset or data that will be fed into the modeling tool(s) from the initial raw data. Tasks
include table, record, and attribute selection, as well as transformation and cleaning of data for
modeling tools.

18008338228 +65 31586636 +1(973) 598-3969 44 203-808-4216 www.cognixia.com • bdg@cognixia.com

 Data Science with Python

Data Science Project Life Cycle

CRISP-DM Phases

4. Modeling - In this phase, various modeling techniques are selected and applied,
and their parameters are calibrated to optimal values.

5. Evaluation - At this stage you have built a model (or models) that appears to
have high quality from a data analysis perspective. Before proceeding to final
deployment of the model, it is important to thoroughly evaluate it and review the
steps executed to create it, to be certain the model properly achieves the business
objectives. A key objective is to determine if there is some important business issue
that has not been sufficiently considered.

18008338228 +65 31586636 +1(973) 598-3969 44 203-808-4216 www.cognixia.com • bdg@cognixia.com

 Data Science with Python

Data Science Project Life Cycle

CRISP-DM Phases

6. Deployment- Creation of the model is generally not the end of the

project. Even if the purpose of the model is to increase knowledge of the
data, the knowledge gained will need to be organized and presented in a way
that the customer can use it. It often involves applying “live” models within
an organization's decision making processes. Depending on the
requirements, the deployment phase can be as simple as generating a report
or as complex as implementing a repeatable data mining process across the
enterprise

18008338228 +65 31586636 +1(973) 598-3969 44 203-808-4216 www.cognixia.com • bdg@cognixia.com

 Data Science with Python

Data Science Project Life Cycle

CRISP-DM Phases

https://www.the-modeling-agency.com/crisp-dm.pdf

18008338228 +65 31586636 +1(973) 598-3969 44 203-808-4216 www.cognixia.com • bdg@cognixia.com

Data Science with Python
Day 2 – Basics Of Statistics

18008338228 +65 31586636 +1(973) 598-3969 44 203-808-4216 www.cognixia.com • bdg@cognixia.com

 Data Science with Python

Basics Of Statistics
What is Statistics?
Statistics is a branch of Mathematics dealing with the collection, analysis,
interpretation, presentation, and organization of data.

Random variable
A Variable which is used to store value corresponding to each outcome of a Random Experiment/Event/Activity. Ex. Coin Flip, RV=
{H,T}

Type of Random variable

Based on the nature of outcome RV can be Discrete or Continues.
Discrete - Finite measurement, no decimals, Ex. Number of people
Continues - Infinite measurements between 2 consecutive values, Ex. Weight, Age

https://en.wikipedia.org/wiki/Statistics Hemant Rathore

18008338228 +65 31586636 +1(973) 598-3969 44 203-808-4216 www.cognixia.com • bdg@cognixia.com
 Data Science with Python

Basics Of Statistics

Central Tendencies- Mean Mode, Median

Type Description Example Result

Sum of values of a data set divided by number of

Mean (1+2+2+3+4+7+9) / 7 4
values:

Middle value separating the greater and lesser

Median 1, 2, 2, 3, 4, 7, 9 3
halves of a data set

Mode Most frequent value in a data set 1, 2, 2, 3, 4, 7, 9 2

https://en.wikipedia.org/wiki/Mode_(statistics)

18008338228 +65 31586636 +1(973) 598-3969 44 203-808-4216 www.cognixia.com • bdg@cognixia.com

 Data Science with Python

Basics Of Statistics

Basic Probability

Probability is the measure of the likelihood that an event will occur. In case of
Random variable we are interested in knowing the Probabilities of getting different
values.

Probability - P(X=Xi) = F(Xi) / FTotal

Ex. Rolling Dices, P(Output=1) = 1/6

Hemant Rathore
18008338228 +65 31586636 +1(973) 598-3969 44 203-808-4216 www.cognixia.com • bdg@cognixia.com
 Data Science with Python

Basics Of Statistics
Probability Distribution of RV
Table/ Chart/Formula to show relationship between Values and Corresponding Probabilities or
shows the distribution of probabilities by values.

Type of Probability Distribution

Based on type of RV, Probability Distribution can also be either Discrete or Continuous

1. Discrete Probability Distribution – Probability Mass Function (PMF)

Discrete Probability Distribution (PMF)

Values(X) 1 2 3 4 5 6

P(X) 1/6 1/6 1/6 1/6 1/6 1/6

Hemant Rathore
18008338228 +65 31586636 +1(973) 598-3969 44 203-808-4216 www.cognixia.com • bdg@cognixia.com
 Data Science with Python

Basics Of Statistics

Type of Probability Distribution

AGE #PERSONS(X) P(X) CP(X)
GROUP (IN K)
2. Continuos Probability Distribution – Probability Density Function (PDF)
0-10 11 0.105 0.105

10-20 15 0.143 0.248

20-30 18 0.171 0.419

30-40 24 0.229 0.648

40-50 21 0.200 0.848

50-60 16 0.152 1

Total 105 1

Hemant Rathore
18008338228 +65 31586636 +1(973) 598-3969 44 203-808-4216 www.cognixia.com • bdg@cognixia.com
 Data Science with Python

“Qs & As”

18008338228 +65 31586636 +1(973) 598-3969 44 203-808-4216 www.cognixia.com • bdg@cognixia.com

18008338228 +65 31586636 +1(973) 598-3969 44 203-808-4216 www.cognixia.com • bdg@cognixia.com