Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
SlideShare a Scribd company logo

Session: Modern Data WareHouse

•Download as PPTX, PDF•
•
K
Karina Matos

This document discusses the challenges of modern apps and how Microsoft's Azure cloud services provide solutions. It focuses on Azure Cosmos DB, a globally distributed database service that can scale massive amounts of data across any workload. Cosmos DB provides elastic scaling, guaranteed low latency, comprehensive security and compliance, and helps companies optimize operations and gain insights from IoT and big data.

1 of 25
Session: Modern Data WareHouse
Cloud AI Data The world is changing
Welcome to data obesity
constantly expanding
M O D E R N A P P S FAC E N E W C H A L L E N G E S Processing and analyzing large, complex data Offering low-latency to users Managing and syncing data distributed around the globe Delivering highly-responsive, real-time personalization Scaling both throughput and storage on demand Modernizing existing apps and data
Challenges for on- premises solutions Tedious set-up and maintenance requirements Optimizing for performance Complex to achieve end-to-end security & compliance Challenging and costly to achieve scale Unpredictable costs Expensive and complex HA solutions
Session: Modern Data WareHouse
$100M Additional average operating income for the most digitally transformed enterprises Companies that embrace data estate modernization with cloud, data, and AI Nearly double higher average net income on revenue more revenue per employee Source: Keystone Strategy 2016 operating margin $40k 50%+
Microsoft’s cloud solution Azure Data Services Data warehouses Operational databases Data lakes & analytics Azure SQL Database for relational data Hyperscale auto-scaling up to 100TB per database Azure SQL Data Warehouse for complex queries across petabytes of data 40 Azure regions, most availability among all cloud-based data warehouse providers Azure Data Lake for processing and analytics on data of any size, shape, and speed 99.9% SLA Azure Cosmos DB for non-relational/NoSQL data Guarantees high availability and <10ms latency SLAs. Can be used for a variety of workloads Azure databases for MySQL, PostgreSQL, and MariaDB for open source Enterprise-ready, fully managed database as a service Azure Databricks for big data analytics and AI solutions Apache spark-based analytics Azure HDInsight for open source analytics Enterprise-grade with over 30 compliance certifications Security and performanceFlexibility of choiceReason over any data, anywhere
A FULLY-MANAGED GLOBALLY DISTRIBUTED DATABASE SERVICE BUILT TO GUARANTEE EXTREMELY LOW LATENCY AND MASSIVE SCALE FOR MODERN APPS A Z U R E C O S M O S D B
Turnkey global distribution Elastic scale out of storage & throughput Guaranteed low latency at the 99th percentile Comprehensive SLAs Five well-defined consistency models Table API W H AT I S A Z U R E C O S M O S D B SQL MongoDB Column-family DocumentKey-value Graph A globally distributed, massively scalable, multi-model database service
We take care of database chores Your work so far How Cosmos DB helps Hardware purchasing and management Built-in scale on-demand Protect data with backups (with health checks and retention) Built-in backup and restore High availability implementation Built-in 99.99% SLA Disaster recovery implementation Built-in geo-redundancy and geo-replication Ensure compliance with standards on your own Built-in easy to use features Secure your data from malicious users and mistakes Built-in easy to use features Role out updates and upgrades Built-in updates and upgrades Monitor, troubleshoot, and manage at scale Built-in easy to use features Tune and maintain for predictable performance Built-in easy to use features
On-prem IaaS Azure Cosmos DB Throughput Storage Bandwidth Cost components of On-Prem, IaaS, and PaaS databases Up to 6x savings
A Z U R E C O S M O S D B I N D U S T R Y I OT + M A N U FA C T U R I N G S C E N A R I O S • Device Telemetry • Device Registry • Supply Chain Management
I OT TO P C H A L L E N G E S Ability to be agile and able to quickly respond to issues Leverage data from multiple devices to build differentiated experiences/ enhance processes or leverage for analytics Ingest huge volumes of data from multiple sources worldwide
E L A S T I C S C A L E O U T O F S TO R A G E A N D T H R O U G H P U T SCALES AS YOUR APPS’ NEEDS CHANGE Independently and elastically scale storage and throughput across regions – even during unpredictable traffic bursts – with a database that adapts to your app’s needs. • Elastically scale throughput from 10 to 100s of millions of requests/sec across multiple regions • Support for requests/sec for different workloads • Pay only for the throughput and storage you need
H A N D L E A N Y D ATA W I T H N O S C H E M A O R I N D E X I N G R E Q U I R E D Azure Cosmos DB’s schema-less service automatically indexes all your data, regardless of the data model, to delivery blazing fast queries. Item Color Microwave safe Liquid capacity CPU Memory Storage Geek mug Graphite Yes 16ox ??? ??? ??? Coffee Bean mug Tan No 12oz ??? ??? ??? Surface book Gray ??? ??? 3.4 GHz Intel Skylake Core i7- 6600U 16GB 1 TB SSD • Automatic index management • Synchronous auto-indexing • Freedom from schema + index management • Works across every data model • Ingest and serve data back out in milliseconds GEEK
C O M P R E H E N S I V E S L A s RUN YOUR APP ON WORLD-CLASS INFRASTRUCTURE Azure Cosmos DB is the only service with financially-backed SLAs for millisecond latency at the 99th percentile, 99.999% HA and guaranteed throughput and consistency HALatency <10 ms 99th percentile 99.999% Throughput Consistency Guaranteed Guaranteed
T R U S T Y O U R D ATA TO I N D U S T R Y - L E A D I N G S E C U R I T Y & C O M P L I A N C E Azure is the world’s most trusted cloud, with more certifications than any other cloud provider. • Enterprise grade security • Encryption at Rest and Transit • Encryption is enabled automatically by default • Comprehensive Azure compliance certification
Azure Cosmos DB was built to support modern app patterns and use cases. It enables industry-leading organizations to unlock the value of data, and respond to global customers and changing business dynamics in real-time. P O W E R I N G G LO B A L S O L U T I O N S Data distributed and available globally Puts data where your users are Build real-time customer experiences Enable latency-sensitive personalization, bidding, and fraud detection. Ideal for gaming, IoT & eCommerce Predictable and fast service, even during traffic spikes Simplified development with serverless architecture Fully-managed event- driven micro-services with elastic computing power Run Spark analytics over operational data Accelerate insights from fast, global data Lift and shift NoSQL data Lift and shift MongoDB and Cassandra workloads
Azure Cosmos DB (How Customers Use It) Operational database = Analytics database = Hot Updatable Data Lake = Database for Serverless = Database for AI = Database for IoT/Time-series data = Cloud-born database for modern apps
Cosmos DB By Industries (Our Customers) Retail Manufacturing Government / Edu Automotive/IoT Financial Services Professional Services
Find a better way to monitor remote wells and collect data on performance • Must be cost efficient • Unified device management and streaming • Automate IOT and analytics O P T I M I Z E O P E R AT I O N S AT E X X O N M O B I L S U B S I D I A R Y We had a team of five people working on this, and they built it from scratch. The ease of use of the Azure services and the support we got from Microsoft made that possible. .
M A S S I V E S C A L E T E L E M E T R Y S TO R E S F O R I OT Diverse and unpredictable IoT sensor workloads require a responsive data platform • Seamless handling of any data output or volume • Data made available immediately, and indexed automatically • High writes per second, with stable ingestion and query performance
S E R V I N G I N D U S T R Y - L E A D I N G E N T E R P R I S E C U S TO M E R S

More Related Content

Session: Modern Data WareHouse

  • 5. M O D E R N A P P S FAC E N E W C H A L L E N G E S Processing and analyzing large, complex data Offering low-latency to users Managing and syncing data distributed around the globe Delivering highly-responsive, real-time personalization Scaling both throughput and storage on demand Modernizing existing apps and data
  • 6. Challenges for on- premises solutions Tedious set-up and maintenance requirements Optimizing for performance Complex to achieve end-to-end security & compliance Challenging and costly to achieve scale Unpredictable costs Expensive and complex HA solutions
  • 8. $100M Additional average operating income for the most digitally transformed enterprises Companies that embrace data estate modernization with cloud, data, and AI Nearly double higher average net income on revenue more revenue per employee Source: Keystone Strategy 2016 operating margin $40k 50%+
  • 9. Microsoft’s cloud solution Azure Data Services Data warehouses Operational databases Data lakes & analytics Azure SQL Database for relational data Hyperscale auto-scaling up to 100TB per database Azure SQL Data Warehouse for complex queries across petabytes of data 40 Azure regions, most availability among all cloud-based data warehouse providers Azure Data Lake for processing and analytics on data of any size, shape, and speed 99.9% SLA Azure Cosmos DB for non-relational/NoSQL data Guarantees high availability and <10ms latency SLAs. Can be used for a variety of workloads Azure databases for MySQL, PostgreSQL, and MariaDB for open source Enterprise-ready, fully managed database as a service Azure Databricks for big data analytics and AI solutions Apache spark-based analytics Azure HDInsight for open source analytics Enterprise-grade with over 30 compliance certifications Security and performanceFlexibility of choiceReason over any data, anywhere
  • 10. A FULLY-MANAGED GLOBALLY DISTRIBUTED DATABASE SERVICE BUILT TO GUARANTEE EXTREMELY LOW LATENCY AND MASSIVE SCALE FOR MODERN APPS A Z U R E C O S M O S D B
  • 11. Turnkey global distribution Elastic scale out of storage & throughput Guaranteed low latency at the 99th percentile Comprehensive SLAs Five well-defined consistency models Table API W H AT I S A Z U R E C O S M O S D B SQL MongoDB Column-family DocumentKey-value Graph A globally distributed, massively scalable, multi-model database service
  • 12. We take care of database chores Your work so far How Cosmos DB helps Hardware purchasing and management Built-in scale on-demand Protect data with backups (with health checks and retention) Built-in backup and restore High availability implementation Built-in 99.99% SLA Disaster recovery implementation Built-in geo-redundancy and geo-replication Ensure compliance with standards on your own Built-in easy to use features Secure your data from malicious users and mistakes Built-in easy to use features Role out updates and upgrades Built-in updates and upgrades Monitor, troubleshoot, and manage at scale Built-in easy to use features Tune and maintain for predictable performance Built-in easy to use features
  • 13. On-prem IaaS Azure Cosmos DB Throughput Storage Bandwidth Cost components of On-Prem, IaaS, and PaaS databases Up to 6x savings
  • 14. A Z U R E C O S M O S D B I N D U S T R Y I OT + M A N U FA C T U R I N G S C E N A R I O S • Device Telemetry • Device Registry • Supply Chain Management
  • 15. I OT TO P C H A L L E N G E S Ability to be agile and able to quickly respond to issues Leverage data from multiple devices to build differentiated experiences/ enhance processes or leverage for analytics Ingest huge volumes of data from multiple sources worldwide
  • 16. E L A S T I C S C A L E O U T O F S TO R A G E A N D T H R O U G H P U T SCALES AS YOUR APPS’ NEEDS CHANGE Independently and elastically scale storage and throughput across regions – even during unpredictable traffic bursts – with a database that adapts to your app’s needs. • Elastically scale throughput from 10 to 100s of millions of requests/sec across multiple regions • Support for requests/sec for different workloads • Pay only for the throughput and storage you need
  • 17. H A N D L E A N Y D ATA W I T H N O S C H E M A O R I N D E X I N G R E Q U I R E D Azure Cosmos DB’s schema-less service automatically indexes all your data, regardless of the data model, to delivery blazing fast queries. Item Color Microwave safe Liquid capacity CPU Memory Storage Geek mug Graphite Yes 16ox ??? ??? ??? Coffee Bean mug Tan No 12oz ??? ??? ??? Surface book Gray ??? ??? 3.4 GHz Intel Skylake Core i7- 6600U 16GB 1 TB SSD • Automatic index management • Synchronous auto-indexing • Freedom from schema + index management • Works across every data model • Ingest and serve data back out in milliseconds GEEK
  • 18. C O M P R E H E N S I V E S L A s RUN YOUR APP ON WORLD-CLASS INFRASTRUCTURE Azure Cosmos DB is the only service with financially-backed SLAs for millisecond latency at the 99th percentile, 99.999% HA and guaranteed throughput and consistency HALatency <10 ms 99th percentile 99.999% Throughput Consistency Guaranteed Guaranteed
  • 19. T R U S T Y O U R D ATA TO I N D U S T R Y - L E A D I N G S E C U R I T Y & C O M P L I A N C E Azure is the world’s most trusted cloud, with more certifications than any other cloud provider. • Enterprise grade security • Encryption at Rest and Transit • Encryption is enabled automatically by default • Comprehensive Azure compliance certification
  • 20. Azure Cosmos DB was built to support modern app patterns and use cases. It enables industry-leading organizations to unlock the value of data, and respond to global customers and changing business dynamics in real-time. P O W E R I N G G LO B A L S O L U T I O N S Data distributed and available globally Puts data where your users are Build real-time customer experiences Enable latency-sensitive personalization, bidding, and fraud detection. Ideal for gaming, IoT & eCommerce Predictable and fast service, even during traffic spikes Simplified development with serverless architecture Fully-managed event- driven micro-services with elastic computing power Run Spark analytics over operational data Accelerate insights from fast, global data Lift and shift NoSQL data Lift and shift MongoDB and Cassandra workloads
  • 21. Azure Cosmos DB (How Customers Use It) Operational database = Analytics database = Hot Updatable Data Lake = Database for Serverless = Database for AI = Database for IoT/Time-series data = Cloud-born database for modern apps
  • 22. Cosmos DB By Industries (Our Customers) Retail Manufacturing Government / Edu Automotive/IoT Financial Services Professional Services
  • 23. Find a better way to monitor remote wells and collect data on performance • Must be cost efficient • Unified device management and streaming • Automate IOT and analytics O P T I M I Z E O P E R AT I O N S AT E X X O N M O B I L S U B S I D I A R Y We had a team of five people working on this, and they built it from scratch. The ease of use of the Azure services and the support we got from Microsoft made that possible. .
  • 24. M A S S I V E S C A L E T E L E M E T R Y S TO R E S F O R I OT Diverse and unpredictable IoT sensor workloads require a responsive data platform • Seamless handling of any data output or volume • Data made available immediately, and indexed automatically • High writes per second, with stable ingestion and query performance
  • 25. S E R V I N G I N D U S T R Y - L E A D I N G E N T E R P R I S E C U S TO M E R S