The Right Data Warehouse: Automation Now, Business Value Thereafter
- 1. Grab some coffee and enjoy the pre-show banter before the top of the hour!
- 2. The Right Data Warehouse: Automation Now, Business Value Thereafter The Briefing Room
- 3. Twitter Tag: #briefr The Briefing Room Welcome Host: Eric Kavanagh eric.kavanagh@bloorgroup.com @eric_kavanagh
- 4. ! Reveal the essential characteristics of enterprise software, good and bad ! Provide a forum for detailed analysis of today’s innovative technologies ! Give vendors a chance to explain their product to savvy analysts ! Allow audience members to pose serious questions... and get answers! Twitter Tag: #briefr The Briefing Room Mission
- 5. Twitter Tag: #briefr The Briefing Room Topics This Month: BIG DATA May: DATABASE June: ANALYTICS & MACHINE LEARNING 2014 Editorial Calendar at www.insideanalysis.com/webcasts/the-briefing-room
- 6. “ The first rule of any technology used in a business is that automation applied to an efficient operation will magnify the efficiency. The second is that automation applied to an inefficient operation will magnify the inefficiency. -Bill Gates “
- 7. Twitter Tag: #briefr The Briefing Room Analyst: Robin Bloor Robin Bloor is Chief Analyst at The Bloor Group robin.bloor@bloorgroup.com @robinbloor
- 8. Twitter Tag: #briefr The Briefing Room WhereScape ! WhereScape is a data warehousing software company ! It offers WhereScape 3D, software for planning and reality-testing data warehousing and business intelligence projects; and WhereScape RED, an integrated development environment used for building, deploying and managing data warehouses and data marts. ! WhereScape RED allows developers to automate the data warehousing life cycle
- 9. Twitter Tag: #briefr The Briefing Room Guest: Mark Budzinski Mark Budzinski is the President of WhereScape USA. In this role, Mark sees firsthand the challenges that IT organizations face and their desire to better serve the business community with agile, rapid development of data warehouses and related data driven projects. His career has spanned management positions at Intel, Sequent Computer Systems, RadiSys, and Applied Microsystems. He holds an MBA from the Univ. of Oregon, a Master’s Degree in Computer Science from the Univ. of Southern California, a BS in Industrial Engineering from Lehigh Univ., and is a graduate of The Buckley School of Public Speaking.
- 10. Mark Budzinski President WhereScape USA, Inc. WhereScape Bloor Group Briefing Big Data: Are We There Yet? April 1, 2014
- 11. So What Problem Are We Trying to Solve, Again? ¡ Big data = new insights from new sources to answer old questions ¡ Hadoop is a fabulous new technology, not a religion ¡ Business value is *still* where the holy grail is found ¡ Connecting *all* data, in the right form to the business constituency at the pace the business needs it…isn’t *that* the problem worth solving?
- 12. Eh, Do You See That Animal Over There? ¡ IT has its hands full ¡ ETL has we know it, isn’t helpful ¡ The business employs all kinds of tricks to work around IT ¡ We hide the whole mess in human capital ¡ Consultants ¡ Politics ¡ Excuses
- 13. WhereScape: What We Believe ¡ Getting the data right is critically important, yet business users can seldom articulate what they want until they see it ¡ Business users/consumers of data must be served at their pace ¡ Automate as much of the process as possible ¡ Standards matter ¡ Document everything; later changes demand it ¡ The historical record that “data warehouses take too long to build and are too hard to change” must evolve to a paradigm whereby IT delivers value continuously, manages ongoing changes cost effectively, and mitigates risk throughout
- 14. Some of Our Customers
- 15. ETL Is Not The Same Thing As… Move Data Transform Data Load Data From Sources including OLTP, files, Hadoop, etc. Create Database Objects such as Models, Views, Facts, Dimensions, Indexes Documentation
- 16. WhereScape Value Proposition ¡ We empower IT organizations to build, deploy, and manage their data in a timeframe and manner that creates utter enthusiasm in the business community ¡ Time to results dramatically decreases - faster ¡ Costs decrease: license and human capital - cheaper ¡ Quality is higher: documentation & transparency - better ¡ Risk is mitigated: automation & methodology – with confidence By automating development, you get more from your “data investment”
- 17. Data Warehouse Automation Software: RED RED is an Automated Data Warehouse Development Platform That Builds Native Target Database Objects, Documents Them, And Schedules Data To Be Loaded. RED Works Well With ETL Tools, or as an ELT Solution Using Native Loaders (e.g. Teradata TPT)
- 18. Automation Use Cases End-to-End Data Warehouse Development Tool Including All ETL Complement to Enterprise ETL, Used For Rapid/Agile Build Out of a View or Semantic Layer Green Field Clean Up Hand-Written Code and Scripts Manage Deployments Rewrite & Recast Heterogeneous Database Solutions Big Data Integration ELT 2.0 Configuration Management Semantic Layer
- 19. “WhereScape RED’s tight integration with the target database and built-in best practices are empowering our resource-constrained development team to tackle a large implementation that will enable us to quickly deliver value to our institution and members.” Su Rayburn, Director of Business Intelligence Services
- 20. “Our results using WhereScape have been extremely impressive. WhereScape enabled us to design, develop, document and deploy a production-ready solution in 6-8 weeks. Using traditional data warehouse development methods would have taken us 6-8 months. Ryan Fenner, VP, Data Solutions Architect, Union Bank
- 21. “We estimate the development lifecycle is 20-25% of what it was previously when we were hand coding.” Dan Mosher, Director of Enterprise Data Warehousing
- 22. Summary WhereScape’s approach with data warehouse automation yields customer results that are stunning: faster, cheaper, and more manageable
- 23. Twitter Tag: #briefr The Briefing Room Perceptions & Questions Analyst: Robin Bloor
- 25. Is the Data Warehouse Dead? u It’s all about data flow u The number of data sources is increasing dramatically; some (like the weather) don’t directly relate to corporate data entities u Inconvenient data structures (documents, text, etc.) make a single database engine an impossibility u No database product can handle the scale required
- 26. Is the Data Warehouse Dead? u It’s all about data flow, and there needs to be a control point (or several) for that flow u There needs to be a comprehensive integrated map of all data used by the business u This means that there needs to be a LOGICAL data warehouse u Whether there is a single physical data warehouse is a detail of the implementation
- 27. Big Data and the Data Reservoir
- 28. The Biological System Analog u Our human control system works at different speeds: • Almost instant reflex • Swift response • Considered response u Organizations will gradually implement similar control systems u This suggests a data-flow-based architecture u Memory is the Data Warehouse
- 29. Data Warehouse Design The design issue: u In the past a data warehouse design could remain fairly static for a while – it rarely saw dramatic change u Those days are probably over for many businesses u The warehouse design process now needs to have a maintenance aspect u It also needs to embrace Hadoop and think in terms of “logical warehouse”
- 30. u How does the typical WhereScape engagement proceed in terms of: product only/training/ consultancy? u What is the typical time frame from project initiation to operating warehouse (green field)? u What factors impact that time frame? u What are your customers (who use Hadoop) using it for?
- 31. u How would you characterize the role of Hadoop in the data warehouse? u Do you become involved in database migrations? If so, what are the contexts for such projects? u Do you have any direct competition?
- 32. Twitter Tag: #briefr The Briefing Room
- 33. This Month: BIG DATA May: DATABASE June: ANALYTICS & MACHINE LEARNING www.insideanalysis.com/webcasts/the-briefing-room Twitter Tag: #briefr The Briefing Room Upcoming Topics 2014 Editorial Calendar at www.insideanalysis.com
- 34. Twitter Tag: #briefr THANK YOU for your ATTENTION! Images borrowed from the Internet: Slide 29: http://evaporatedpast.com/2013/09/07/art-is-never-finished- only-abandoned-leonardo-da-vinci/ The Briefing Room