Azure Databricks—Apache Spark as a Service with Sascha Dittmann
•
0 likes•709 views
The driving force behind Apache Spark (Databricks Inc.) and Microsoft have designed a joint service to quickly and easily create Big Data and Advanced Analytics solutions. The combination of the comprehensive Databricks Unified Analytics platform and the powerful capabilities of Microsoft Azure make it easy to analyse data streams or large amounts of data, as well asthe training of AI models. Sascha Dittmann shows in this session how the new Azure service can be set up and used in various real-world scenarios. He also shows, how to connect the various Azure Services to the Azure Databricks service.
Report
Share
Azure Databricks—Apache Spark as a Service with Sascha Dittmann
- 1. Sascha Dittmann, Microsoft Deutschland GmbH Azure Databricks Spark as a Service #SAISDS6 @SaschaDittmann
- 3. CONTROL EASE OF USE Azure Data Lake Store Azure Storage BIGDATA STORAGE BIGDATA ANALYTICS ReducedAdministration Data Engineering in a Job-as-a-service model Azure Data Lake Analytics Big Data as-a-service Any Hadoop technology, any distribution Azure Marketplace HDP | CDH | MapR IaaS Clusters Workload optimized, managed clusters Managed Clusters Azure HDInsight Frictionless & Optimized Spark clusters Azure Databricks #SAISDS6 @SaschaDittmann
- 4. Cloud storage Data warehouses Hadoop storage IoT / streaming data Machine learning models BI tools Data exports Data warehouses Azure Databricks Enhance Productivity Build on secure & trusted cloud Scale without limits #SAISDS6 @SaschaDittmann
- 5. DEMO How to get started with Azure Databricks #SAISDS6 @SaschaDittmann
- 6. Use Case Wind Farms #SAISDS6 @SaschaDittmann
- 7. #SAISDS6 @SaschaDittmann computed batch view serving layer computed batch view master dataset batch layer pre- compute storage speed layer structured streaming real-time view
- 8. DEMO Use Case: Wind Farms #SAISDS6 @SaschaDittmann
- 9. Use Case Heating Systems #SAISDS6 @SaschaDittmann
- 10. Azure Cosmos DB #SAISDS6 @SaschaDittmann
- 11. master dataset computed batch view #SAISDS6 @SaschaDittmann batch layer serving layer speed layer pre- compute storage structured streaming computed batch view real-time view change feed
- 12. #SAISDS6 @SaschaDittmann master dataset computed batch view collections computed batch view pre- compute
- 13. #SAISDS6 @SaschaDittmann master dataset computed batch view collections computed batch viewchange feed structured streaming real-time view
- 14. DEMO Use Case: Heating Systems #SAISDS6 @SaschaDittmann