Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
SlideShare a Scribd company logo
Architecting Digital Media Archive Migrations with AWS (STG357) - AWS re:Invent 2018
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Architecting Digital Media Archive
Migrations with AWS
Aaron Tunnell
Media & Entertainment BD
AWS
S T G 3 5 7
Paul Reed
Principal Product Manager
AWS
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Agenda
What challenges are customers facing with
media moving?
Media asset migration architecture
Introduction to AWS DataSync
service
Demo
Customer Q+A/whiteboarding
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What are customers
saying?
• Retire on-prem archives and legacy
middleware
• Bring value and discoverability to existing
assets
• Standardize mezzanine and proxy video
formats and containers
• Sync multiple sites, silos, asset managers,
and archives
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Where are the
challenges?
• AWS Snowball is great for big migrations
• Large LTO libraries not always a fit for
mass migrations
• How do we deal with daily puts and gets?
• How do we integrate to on premise
storage tiers?
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Asset management migration solution
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What is AWS DataSync?
Online transfer service that simplifies, automates, and
accelerates moving data between on-premises storage and AWS
Fast data
transfer
Cost-
effective
Combines the speed and reliability of network acceleration software
with the cost-effectiveness of open source tools
Easy to use Secure and
reliable
Cloud
integrated
AWS
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Shared
file system
NFS TLS
How AWS DataSync works
On-Premise
Amazon S3
bucket
AWS Storage resources
AWS
DataSync
Agent deployed
on-premises for
fast access to local
storage
Region
Amazon EFS
file system
AWS DataSync
agent
Data transfer over
the WAN via
efficient purpose-
built protocol
Managed from
AWS Console or
AWS Command
Line Interface (CLI)
Service in AWS
writes or reads
data from AWS
storage services
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Transfers at speeds up to 10 Gbps per agent
Purpose-built scale-out transfer protocol
Multithreaded with large file parallelization
Data-reduction through incremental transfers,
inline compression, and sparse file detection
Optimized read and write for Amazon Simple
Storage Service (Amazon S3) and Amazon Elastic
File Service (Amazon EFS)
Configurable throughput limits
Fast data
transfer
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Spend less money
Cost-
effective
Pay $0.04 per-GB of data copied, with no
minimum commitments or upfront fees
For example, transferring 100 GB into Amazon S3 costs
$4
AWS infrastructure is fully managed
and scaled based on usage
On-premises agents automatically updated and
patched
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Asset management migration solution
AWS DataSync AWS DataSync
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aaron Tunnell
Tunnella@amazon.com
Chris Kuthan
Kuthan@amazon.com
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

More Related Content

Architecting Digital Media Archive Migrations with AWS (STG357) - AWS re:Invent 2018

  • 2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Architecting Digital Media Archive Migrations with AWS Aaron Tunnell Media & Entertainment BD AWS S T G 3 5 7 Paul Reed Principal Product Manager AWS
  • 3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Agenda What challenges are customers facing with media moving? Media asset migration architecture Introduction to AWS DataSync service Demo Customer Q+A/whiteboarding
  • 4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. What are customers saying? • Retire on-prem archives and legacy middleware • Bring value and discoverability to existing assets • Standardize mezzanine and proxy video formats and containers • Sync multiple sites, silos, asset managers, and archives
  • 5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Where are the challenges? • AWS Snowball is great for big migrations • Large LTO libraries not always a fit for mass migrations • How do we deal with daily puts and gets? • How do we integrate to on premise storage tiers?
  • 6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Asset management migration solution
  • 7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. What is AWS DataSync? Online transfer service that simplifies, automates, and accelerates moving data between on-premises storage and AWS Fast data transfer Cost- effective Combines the speed and reliability of network acceleration software with the cost-effectiveness of open source tools Easy to use Secure and reliable Cloud integrated AWS
  • 8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Shared file system NFS TLS How AWS DataSync works On-Premise Amazon S3 bucket AWS Storage resources AWS DataSync Agent deployed on-premises for fast access to local storage Region Amazon EFS file system AWS DataSync agent Data transfer over the WAN via efficient purpose- built protocol Managed from AWS Console or AWS Command Line Interface (CLI) Service in AWS writes or reads data from AWS storage services
  • 9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Transfers at speeds up to 10 Gbps per agent Purpose-built scale-out transfer protocol Multithreaded with large file parallelization Data-reduction through incremental transfers, inline compression, and sparse file detection Optimized read and write for Amazon Simple Storage Service (Amazon S3) and Amazon Elastic File Service (Amazon EFS) Configurable throughput limits Fast data transfer
  • 10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Spend less money Cost- effective Pay $0.04 per-GB of data copied, with no minimum commitments or upfront fees For example, transferring 100 GB into Amazon S3 costs $4 AWS infrastructure is fully managed and scaled based on usage On-premises agents automatically updated and patched
  • 11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Asset management migration solution AWS DataSync AWS DataSync
  • 12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 15. Thank you! © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aaron Tunnell Tunnella@amazon.com Chris Kuthan Kuthan@amazon.com
  • 16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.