The document discusses modern data architectures. It presents conceptual models for data ingestion, storage, processing, and insights/actions. It compares traditional vs modern architectures. The modern architecture uses a data lake for storage and allows for on-demand analysis. It provides an example of how this could be implemented on Microsoft Azure using services like Azure Data Lake Storage, Azure Data Bricks, and Azure Data Warehouse. It also outlines common data management functions such as data governance, architecture, development, operations, and security.
5. RDBMS
Source
Flat files
Unstructured
data
Security & Governance
MODERN ARCHITECTURE - AZURE
Business Apps
API’s
Reporting
Azure Data
Factory
Azure Data
Lake Storage
Azure Data
Bricks
Azure
Cosmos DB
Ingest Store Prepare Model Serve
Azure
Data warehouse
Data
Virtualization
* Proposed Architecture using Azure Cloud, if the business is subscriber of other cloud providers then propose services with similar functionalities
6. DATA MANAGEMENT FUNCTIONS
Data
Governance
Data
Architecture
Data
Development
Data
Operations
Data Security
Reference &
Master DM
DW & BI
Document &
Content
Metadata
Data Quality
•Authority to plan, monitor and enforce
standards and policies for data assetsData Governance
•Enterprise modelling
•Value chain analysisData Architecture
•Analysis
•Data modelling & DesignData development
•Acquisition, Recovery, Tuning
•Retention and archivalData Operations
•Standards, Administration
•Authentication, AuditingData Security
•External & Internal codes
•Primary data: Customer, ProductReference & MDM
•Architecture, Implementation
•Training, Monitoring & TuningDW & BI
•Acquisition & Storage,
•Backup, Retrieval. Content mgmtDocument & Content
•Architecture, Integration
•Control, MonitorMetadata
•Specification, Analysis
•Measurement, ImprovementDQM