ENT305 Migrating Your Databases to AWS: Deep Dive on Amazon Relational Database Service
•
1 like•581 views
Amazon RDS allows you to launch an optimally configured, secure and highly available database with just a few clicks. It provides cost-efficient and resizable capacity, automates time-consuming database administration tasks, and provides you with six familiar database engines to choose from: Amazon Aurora, Oracle, Microsoft SQL Server, PostgreSQL, MySQL and MariaDB. In this session, we will take a close look at the capabilities of Amazon RDS and explain how it works. We’ll also discuss the AWS Database Migration Service and AWS Schema Conversion Tool, which help you migrate databases and data warehouses with minimal downtime from on-premises and cloud environments to Amazon RDS and other Amazon services. Gain your freedom from expensive, proprietary databases while providing your applications with the fast performance, scalability, high availability, and compatibility they need.
Report
Share
ENT305 Migrating Your Databases to AWS: Deep Dive on Amazon Relational Database Service
- 1. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. July 27, 2017 Migrating Your Databases to AWS: Deep Dive on Amazon Relational Database Service Kwesi Edwards, Business Development Manager, AWS Tim Rogers, Director, Cloud Technology Solutions, Sierra-Cedar Inc.
- 2. Agenda • Why migrate? • RDS value • Administering RDS • Database migrations • Sierra-Cedar Inc.’s migration • Q&A
- 3. Why migrate? Database management is expensive. Moving to RDS reduces management cost, moving to open source engines on AWS can reduce costs by 90% or more. Proprietary databases are risky. Moving to open-source engines on RDS removes avoidable risk. Costs Risks
- 4. Where do DBAs spend their time? Application Optmization Installation, Upgrades, and Patching Backup and Recovery, Data Import and Export, Licensing, Training, Security 8
- 5. Customers succeeding with Amazon RDS
- 6. DBaaS report “AWS not only has the largest adoption of DBaaS, it also offers the widest range of offerings to support analytical, operational, and transactional workloads.” “AWS’s key strengths lay in its dynamic scale, automated administration, flexibility of database offerings, strong security, and high-availability capabilities, which make it a preferred choice for customers.” The Forrester Wave™ is copyrighted by Forrester Research, Inc. Forrester and Forrester Wave™ are trademarks of Forrester Research, Inc. The Forrester Wave™ is a graphical representation of Forrester's call on a market and is plotted using a detailed spreadsheet with exposed scores, weightings, and comments. Forrester does not endorse any vendor, product, or service depicted in the Forrester Wave. Information is based on best available resources. Opinions reflect judgment at the time and are subject to change.
- 7. Amazon RDS Engines Commercial Open source Cloud native MySQL Compatible PostgreSQL Compatible Amazon Aurora
- 8. Highly available Durable, PITR, snapshots Scalable Secure & compliant Encryption in transit and at rest TDE with Oracle Database and SQL Server Compliance realms Integration across AWS ... And a lot more RDS Key Features
- 9. Automated Backups MySQL, PostgreSQL, MariaDB, Oracle, SQL Server • Scheduled daily volume backup of entire instance • Archive database change logs • 35-day retention • Multiple copies in each AZ when running Multi-AZ • Taken from standby when running Multi-AZ Amazon Aurora • Automatic, continuous, incremental backups • No impact on database performance • 35-day retention Every day during your backup window, the RDS service creates a storage volume snapshot of your database Every five minutes, RDS backs up the transaction logs of your database If database is Multi-AZ, the snapshot is taken from the standby • Single-AZ deployment = multiple backup copies in one AZ • Multi-AZ deployment = multiple backup copies in multiple AZs
- 10. Scaling instances up/down AWS Management Console
- 12. There’s an API for that • Modify instances • Instance type • Storage size/type • Versions, parameters, options, and more • Applied immediately or in next maintenance window • Reboot instances • Restore instances
- 14. Database Upgrades Prod Instance RDBMS 12.1.0.2.v6 1 Prod Instance RDBMS 12.1.0.2.v7 1. ModifyDBInstance
- 15. Database Upgrades Prod Instance Clone instance RDBMS 12.1.0.2.v6 Clone instance RDBMS 12.1.0.2.v7 1 2 3 1. RestoreDBInstance 2. ModifyDBInstance 3. DeleteDBInstance
- 16. Multi-AZ Failover Timeline UP Identify failure Crash recovery UP DNS propagation Typical failover time 1-2 minutest0 tN
- 17. Snapshots • Always incremental • I/O happens in the backend • Amazon S3 99.999999999% durability • Inherit encryption • Copy across accounts • Copy across regions • Copy automatic to manual to save
- 19. Database Freedom What is it? • Database Freedom is an initiative to support our customers free themselves from the high cost and technical lock in of the Oracle Database. How to determine a good migration opportunity? • Workload Qualification Framework Category Workload Type Ease of migration Man-hour consumption 1 ODBC/JDBC workload Easy Light 2 Light Oracle feature workload Easy Medium 3 Heavy Oracle feature workload Hard Heavy 4 Oracle specific application framework Difficult to migrate N/A 5 OCI workloads Hard Heavy
- 20. Migration Options If you’re not switching engines and can take downtime: - SQL Server: bak file import - MySQL: read replicas - Oracle SQL Developer, Data Pump, Export/Import - PostgreSQL: pg_dump
- 21. What are AWS DMS and AWS SCT? AWS Database Migration Service (DMS) easily and securely migrate and/or replicate your databases and data warehouses to AWS AWS Schema Conversion Tool (SCT) convert your commercial database and data warehouse schemas to open-source engines or AWS-native services, such as Amazon Aurora and Amazon Redshift We migrated over 30,000 unique databases. And counting…
- 22. Know before you migrate with SCT Assessment Report AWS SCT helps with converting tables, views, and code
- 23. AWS Database Migration Partners
- 25. • Sierra-Cedar, Inc is part of The Sierra-Cedar Group, one of the largest independent North American IT Services companies. • Headquarters, located in Alpharetta, GA • 960 employees • Oracle application services provider since 1989 • Private Cloud Managed Services provider since 1999 • Public Cloud / AWS Managed provider since 2015 Sierra-Cedar at a glance 25 • 2000+ successful Oracle projects • 100+ managed services clients • Oracle Platinum Partner • AWS Consulting Partner Important Facts Business Highlights
- 26. The Goal • Migrate from a traditional data center model to the cloud • Greater agility and flexibility of services to the business • Improve efficiency of support resources • Minimize maintenance window downtime • Leverage automation Private Cloud
- 27. The Journey Evaluated cloud stack, open stack Evaluated various cloud providers All paths led to AWS • Expanse of AWS services • Access to APIs to facilitate automation • Continued investment in the platform • Responsiveness in addressing issues
- 28. The Initial Scope PeopleSoft Financials v9.2 • 5 non-production instances • 1 production instance • DB size – 660GB • 2000+ users PeopleSoft Human Capital Management v9.2 • 5 non-production instances • 1 production instance • DB size – 100GB • 2000+ users
- 29. The Dilemma (RDS vs. EC2) • RDS vs. EC2 • Didn’t like the idea of RDS • Too restrictive/loss of control • No direct access to the box • “It’s doing my job” • DBAs conducted a full review with an open mind
- 30. The Dilemma (RDS vs. EC2) EC2 ● Pros – Flexibility w/ full access – Access to the Oracle utilities (Dataguard, RMAN, etc.) – Similar to the way it’s managed today ● Cons – Self-deployed – High administrative overhead (all tasks manual - self installation, patching, backups, etc.) RDS ● Pros – Managed Service = reduced overhead (easy deployment, automated patching and backups, etc.) – Multi-AZ option for HA – Parameter and Option groups – Flexible license model with BYOL option ● Cons – Don’t have access to all the Oracle utilities – One-off DB patching not supported
- 31. HTTPS HTTP Load Balanced HTTP Load Balanced TNS TNS Elastic Load Balancer Private subnet-10.125.8.0/24 Public Subnet-10.125.10.0/24 DNS Server US East N. Virginia – 1d US East N. Virginia – 1e Internet Gateway - VPC NAT Gateway NAT Gateway TNS PSNTPSUNX TNS Private subnet-10.125.11.0/24Public Subnet-10.125.7.0/24 AMI AMI AWS S3 for Backups EFS for Linux PS_HOME Web Servers App Servers Web Servers App Servers Process Schedulers Process Schedulers Terminal ServersTerminal Servers PS_HOME File Server - Windows AMI File Server - Windows EBS for Windo ws PS_H OME Production Architecture Active-Active deployment between 2 AZs RDS DB instance RDS DB instance standby (Multi-AZ) Synchronous Replication Internal Load Balancer Jolt Jolt Jolt Jolt VPC – 10.125.0.0/16 Admin Subnet-10.125.2.0/24 DC - mycmsc AMI Admin Subnet-10.125.9.0/24 DC - mycmsc AMI Sierra-Cedar’s AWS Environment Technologies include… • Network: VPC w/Subnets, IGW, NGW, Route Tables and VPN • Storage: EBS, EFS, S3 and Amazon Glacier • Messaging: SES and SNS • Compute: EC2 and Elastic Load Balancer • Management Tools: CloudWatch and CloudTrail • Security: Security Groups, IAM (roles, groups, users) and Inspector • Database: RDS (Oracle) • Automation: Autoscaling, Weekend shutdowns, Environment Deployments
- 32. The Journey Continues Production Go-Live – May 2017 Core challenges • Change is tough • Retraining and Developing new AWS skills • Rethinking administration and infrastructure designs (which never stops!) • Adjusting processes and procedures • Development of automation designed to enhance and in some cases replace the need for administration (ongoing) Many more AWS projects to come
- 33. Summary • Why migrate? • RDS value • Administering RDS • Database migrations • Sierra-Cedar Inc.’s migration • Q&A
- 34. Questions?
- 35. Thank you!