Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
SlideShare a Scribd company logo
Getting More From Your Data with Azure
Cosmos DB, Synapse, and Confluent
Cloud
Session Speakers
Sr. Product Marketing Manager – Partnerships
Peter Kennedy is a product marketer at Confluent
focused on accelerating partnerships and joint go-to-
market activities surrounding Confluent Cloud. Prior to
Confluent, he worked for Microsoft as a product and
partner marketer in the IoT portfolio.
Peter Kennedy, Confluent
Sr. Specialist, Azure Cosmos DB/NoSQL Global Black Belt
Luciano Moreira is an Azure Cosmos DB specialist at
Microsoft who helps companies tackle challenging data
scenarios, successfully building performance and resilient
solutions with Azure.
Luciano Moreira, Microsoft
Real-time
Data
A Sale
A shipment
A Trade
A Customer
Experience
Data streaming fuels modern data platforms
“We need to shift our thinking from everything
at rest, to everything in motion.” —
Real-Time Data Streaming
Rich Front-End Customer
Experiences
Real-Time Backend
Operations
Companies move to the cloud to build
modern data platforms
Agile Elastic Cost-saving
Fast
deployment
“More than 45% of IT spending on infrastructure and application software
will shift from on-prem to cloud by 2024.” – Gartner
These cloud-native data platforms power
business critical applications and analytics
5
Self-Managed Data Platforms
● Inflexible architecture makes it hard
to integrate with other systems
● Expensive in both upfront and
ongoing maintenance costs
● Slow to scale to meet evolving
demands
Cloud Data Platforms
● Lowers TCO by decoupling storage
from compute and leveraging
consumption- based pricing
● Increases flexibility and agility
● Simplifies operations with built into
auto-scaling and maintenance cycles
Integrating multiple systems to the cloud
is challenging
1. Wastes time and resources
Replacing or refactoring legacy data
systems across environments is not easy.
During which, data visibility can be limited.
1. Conceals blind spots
Getting actionable data from disparate data
sources is cumbersome. Most data insight
comes from nightly loads, merges, and
batch updates to create a complete view.
1. Creates data silos
Difficulties with integrating multiple data
silos and data formats.
On-Prem
Legacy Data
Store
Cloud
Cloud Data
Store
CRM
SaaS
App
Nightly
Reporting
Applications ETL App
Batch Jobs
Confluent helps you modernize and
integrate legacy with the cloud
1. Accelerate and simplify
migration
Link on-prem and cloud for easier data
movement across environments with real-
time event streaming to start migrating
immediately
1. Enhance data in real-time
Process data in flight with ksqlDB and use
our fully managed service to enrich or
transform your data before inserting into
the cloud database
1. Reduces TCO
Leverage fully managed services and
avoid prohibitive licensing costs from
existing solutions offered by legacy vendors
On-Prem Cloud
Legacy Data
Store
Cloud Data
Store
Apache
Kafka
120+ Pre-built
Connectors
Stream
Processing
with ksqlDB
CRM
SaaS App
The Confluent Advantage
Everywhere
Maintain flexibility with
deployments on Azure
and connect across
clouds and on-premises
that sync in real-time
Complete
Go beyond Kafka to
build real-time apps on
Azure quickly, reliably,
and securely
Cloud-Native
Apache Kafka re-
architected to harness
the power of the cloud
on Azure
Stream confidently on a highly available platform built by the world's utmost
Apache Kafka experts with built-in enterprise-ready security, compliance, and privacy controls
Confluent and Microsoft
Trusted by Azure, Partners, and Customers
Direct integration with
popular services
Unified operations
and billing experience
Deep relationship and
solution preference
Azure Native Services
3rd-Party ISV Services
Unified Billing Experience
Transact directly through Azure
Marketplace to remove friction and
burn down existing Azure commits
on your M.A.C.C. agreement.
Unified security & management
Trusted enterprise-grade security
with default encryption, private
networking, and single sign-on.
Process cybersecurity data from 120+
sources to increase enterprise
visibility.
Microsoft Strategic Alliance
Confluent & MSFT announced our
strategic partnership in January of 2021,
and due to unprecedented customer
demand we announced the expansion
and extension of our partnership in April
of 2022
Microsoft Preferred Solution
Confluent Cloud has been validated by a
team of Microsoft experts and has
proven to generate business impact,
technology transformation, and cross-
organizational improvements for its
customers.
Azure
Synapse
Azure Event
Hub
Azure
Cosmos DB
Azure Data
Lake Storage
Azure Blob
Storage
Azure
Functions
Understanding the architecture
Azure
On-Prem
Oracle HDFS Teradata,
Netezza
Mainframe
KSQL
Confluent Platform Confluent Cluster Linking
App
OSS Kafka Confluent Cluster Linking
Oracle HDFS Teradata,
Netezza
Mainframe
App
Cloud Apps
3rd party data
Additional Regions or Clouds
Confluent Cluster Linking
Cosmos DB
Azure
Functions
Azure Cosmos DB
Azure Cosmos DB is a fully
managed NoSQL database
service for modern app
development. Get
guaranteed single-digit
millisecond response times
and 99.999-percent
availability, backed by
SLAs, automatic and
instant scalability, and
open-source APIs for
MongoDB and Cassandra.
Azure Cosmos DB
● Unlimited scalability
● Global distribution
● Multi-master
● Low latency (< 10ms)
● Flexible schema
● Multiple SDKs
● Autoscale
● Serverless
● Consistency models
Azure Cosmos DB
Reference (2021)
Azure Cosmos DB Conf
Azure Cosmos DB use cases
Azure
Understanding the architecture:
Azure Cosmos DB
On-Prem
Oracle HDFS Teradata,
Netezza
Mainframe
KSQL
Confluent Platform Confluent Cluster Linking
App
OSS Kafka Confluent Cluster Linking
Oracle HDFS Teradata,
Netezza
Mainframe
App
Cloud Apps
3rd party data
Additional Regions or Clouds
Confluent Cluster Linking
Cosmos DB
Azure
Functions
Synapse
Cosmos DB
Cosmos DB
Global replication
Azure Functions +
Change Feed
Global
distribution
SDKs
Azure ML
Power BI
Data Science and Business Analytics
view data in very different ways
DATA SCI ENCE BUSI NESS ANALY TI CS
Big data
Experimentation
Fast exploration
Semi-structured
OR
Relational data
Proven security & privacy
Dependable performance
Structured
DATA WAREHOUSE
DATA L AKE
Ease of use
Fast expl or at i on
Qui ck to st ar t
Proven secur i t y
Ai r t i ght pr i vacy
Dependabl e per f or mance
Azure meets these challenges
with a single service to provide limitless analytics
The first unified, cloud
native platform for
converged analytics
Data
Warehouse
Data
Lake
Event
Brokers
Azure Synapse Link
Cosmos DB Dataverse
Near real-time
analytics
No managed ETL
Built for convergence
Azure Synapse Link
Azure Cosmos DB
Auto-Sync
Transactional Store
Row store optimized for
transactional reads and writes
Analytical Store
Column store optimized
for analytical queries
Operational
Data Container
Synapse Link
Cloud-Native HTAP
SQL
Azure Synapse Analytics
Reduce architectural complexity
with cloud-native HTAP
Azure
Understanding the architecture:
Azure Cosmos DB & Synapse
On-Prem
Oracle HDFS Teradata,
Netezza
Mainframe
KSQL
Confluent Platform Confluent Cluster Linking
App
OSS Kafka Confluent Cluster Linking
Oracle HDFS Teradata,
Netezza
Mainframe
App
Cloud Apps
3rd party data
Additional Regions or Clouds
Confluent Cluster Linking
Cosmos DB
Azure
Functions
Synapse
Cosmos DB
Cosmos DB
Global replication
Azure Functions +
Change Feed
Global
distribution
SDKs
Power BI
Azure ML
Next steps
Get started
Try Azure for free
azure.microsoft.com/en-us/free/
Visit the Microsoft booth
Microsoft
Get started
Try Confluent for free with $400
in free credits
confluent.io/confluent-cloud
Visit the Confluent booth
Confluent

More Related Content

Luciano Moreira_Jacob Bogie-BRSP005-10.3_22_FINAL.pdf

  • 1. Getting More From Your Data with Azure Cosmos DB, Synapse, and Confluent Cloud
  • 2. Session Speakers Sr. Product Marketing Manager – Partnerships Peter Kennedy is a product marketer at Confluent focused on accelerating partnerships and joint go-to- market activities surrounding Confluent Cloud. Prior to Confluent, he worked for Microsoft as a product and partner marketer in the IoT portfolio. Peter Kennedy, Confluent Sr. Specialist, Azure Cosmos DB/NoSQL Global Black Belt Luciano Moreira is an Azure Cosmos DB specialist at Microsoft who helps companies tackle challenging data scenarios, successfully building performance and resilient solutions with Azure. Luciano Moreira, Microsoft
  • 3. Real-time Data A Sale A shipment A Trade A Customer Experience Data streaming fuels modern data platforms “We need to shift our thinking from everything at rest, to everything in motion.” — Real-Time Data Streaming Rich Front-End Customer Experiences Real-Time Backend Operations
  • 4. Companies move to the cloud to build modern data platforms Agile Elastic Cost-saving Fast deployment “More than 45% of IT spending on infrastructure and application software will shift from on-prem to cloud by 2024.” – Gartner
  • 5. These cloud-native data platforms power business critical applications and analytics 5 Self-Managed Data Platforms ● Inflexible architecture makes it hard to integrate with other systems ● Expensive in both upfront and ongoing maintenance costs ● Slow to scale to meet evolving demands Cloud Data Platforms ● Lowers TCO by decoupling storage from compute and leveraging consumption- based pricing ● Increases flexibility and agility ● Simplifies operations with built into auto-scaling and maintenance cycles
  • 6. Integrating multiple systems to the cloud is challenging 1. Wastes time and resources Replacing or refactoring legacy data systems across environments is not easy. During which, data visibility can be limited. 1. Conceals blind spots Getting actionable data from disparate data sources is cumbersome. Most data insight comes from nightly loads, merges, and batch updates to create a complete view. 1. Creates data silos Difficulties with integrating multiple data silos and data formats. On-Prem Legacy Data Store Cloud Cloud Data Store CRM SaaS App Nightly Reporting Applications ETL App Batch Jobs
  • 7. Confluent helps you modernize and integrate legacy with the cloud 1. Accelerate and simplify migration Link on-prem and cloud for easier data movement across environments with real- time event streaming to start migrating immediately 1. Enhance data in real-time Process data in flight with ksqlDB and use our fully managed service to enrich or transform your data before inserting into the cloud database 1. Reduces TCO Leverage fully managed services and avoid prohibitive licensing costs from existing solutions offered by legacy vendors On-Prem Cloud Legacy Data Store Cloud Data Store Apache Kafka 120+ Pre-built Connectors Stream Processing with ksqlDB CRM SaaS App
  • 8. The Confluent Advantage Everywhere Maintain flexibility with deployments on Azure and connect across clouds and on-premises that sync in real-time Complete Go beyond Kafka to build real-time apps on Azure quickly, reliably, and securely Cloud-Native Apache Kafka re- architected to harness the power of the cloud on Azure Stream confidently on a highly available platform built by the world's utmost Apache Kafka experts with built-in enterprise-ready security, compliance, and privacy controls
  • 9. Confluent and Microsoft Trusted by Azure, Partners, and Customers Direct integration with popular services Unified operations and billing experience Deep relationship and solution preference Azure Native Services 3rd-Party ISV Services Unified Billing Experience Transact directly through Azure Marketplace to remove friction and burn down existing Azure commits on your M.A.C.C. agreement. Unified security & management Trusted enterprise-grade security with default encryption, private networking, and single sign-on. Process cybersecurity data from 120+ sources to increase enterprise visibility. Microsoft Strategic Alliance Confluent & MSFT announced our strategic partnership in January of 2021, and due to unprecedented customer demand we announced the expansion and extension of our partnership in April of 2022 Microsoft Preferred Solution Confluent Cloud has been validated by a team of Microsoft experts and has proven to generate business impact, technology transformation, and cross- organizational improvements for its customers. Azure Synapse Azure Event Hub Azure Cosmos DB Azure Data Lake Storage Azure Blob Storage Azure Functions
  • 10. Understanding the architecture Azure On-Prem Oracle HDFS Teradata, Netezza Mainframe KSQL Confluent Platform Confluent Cluster Linking App OSS Kafka Confluent Cluster Linking Oracle HDFS Teradata, Netezza Mainframe App Cloud Apps 3rd party data Additional Regions or Clouds Confluent Cluster Linking Cosmos DB Azure Functions
  • 11. Azure Cosmos DB Azure Cosmos DB is a fully managed NoSQL database service for modern app development. Get guaranteed single-digit millisecond response times and 99.999-percent availability, backed by SLAs, automatic and instant scalability, and open-source APIs for MongoDB and Cassandra.
  • 12. Azure Cosmos DB ● Unlimited scalability ● Global distribution ● Multi-master ● Low latency (< 10ms) ● Flexible schema ● Multiple SDKs ● Autoscale ● Serverless ● Consistency models
  • 13. Azure Cosmos DB Reference (2021) Azure Cosmos DB Conf
  • 14. Azure Cosmos DB use cases
  • 15. Azure Understanding the architecture: Azure Cosmos DB On-Prem Oracle HDFS Teradata, Netezza Mainframe KSQL Confluent Platform Confluent Cluster Linking App OSS Kafka Confluent Cluster Linking Oracle HDFS Teradata, Netezza Mainframe App Cloud Apps 3rd party data Additional Regions or Clouds Confluent Cluster Linking Cosmos DB Azure Functions Synapse Cosmos DB Cosmos DB Global replication Azure Functions + Change Feed Global distribution SDKs Azure ML Power BI
  • 16. Data Science and Business Analytics view data in very different ways DATA SCI ENCE BUSI NESS ANALY TI CS Big data Experimentation Fast exploration Semi-structured OR Relational data Proven security & privacy Dependable performance Structured DATA WAREHOUSE DATA L AKE
  • 17. Ease of use Fast expl or at i on Qui ck to st ar t Proven secur i t y Ai r t i ght pr i vacy Dependabl e per f or mance Azure meets these challenges with a single service to provide limitless analytics
  • 18. The first unified, cloud native platform for converged analytics Data Warehouse Data Lake Event Brokers Azure Synapse Link Cosmos DB Dataverse
  • 19. Near real-time analytics No managed ETL Built for convergence Azure Synapse Link
  • 20. Azure Cosmos DB Auto-Sync Transactional Store Row store optimized for transactional reads and writes Analytical Store Column store optimized for analytical queries Operational Data Container Synapse Link Cloud-Native HTAP SQL Azure Synapse Analytics Reduce architectural complexity with cloud-native HTAP
  • 21. Azure Understanding the architecture: Azure Cosmos DB & Synapse On-Prem Oracle HDFS Teradata, Netezza Mainframe KSQL Confluent Platform Confluent Cluster Linking App OSS Kafka Confluent Cluster Linking Oracle HDFS Teradata, Netezza Mainframe App Cloud Apps 3rd party data Additional Regions or Clouds Confluent Cluster Linking Cosmos DB Azure Functions Synapse Cosmos DB Cosmos DB Global replication Azure Functions + Change Feed Global distribution SDKs Power BI Azure ML
  • 22. Next steps Get started Try Azure for free azure.microsoft.com/en-us/free/ Visit the Microsoft booth Microsoft Get started Try Confluent for free with $400 in free credits confluent.io/confluent-cloud Visit the Confluent booth Confluent