Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
SlideShare a Scribd company logo
Deep Dive on Cloud File System Offerings: What to Use, Where, and Why (STG392) - AWS re:Invent 2018
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Deep Dive on Cloud File System Offerings:
What to Use, Where, Why
S T G 3 9 2
Joe Disher
Sr. Product Marketing Marketing
Storage
Prashanth Bungale
Sr. Product Manager
Amazon FSx
Geert Jansen
Sr. Product Manager
Amazon EFS
Paul Reed
Principal Product Manager
Data transfer & Hybrid Storage
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Agenda
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Panel of experts
Paul Reed
Product Manager
AWS Storage Gateway
& AWS DataSync
Prashanth Bungale
Product Manager
Amazon FSx
Geert Jansen
Product Manager
Amazon EFS
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Portfolio breadth and depth
Amazon
EFS
AWS Storage
Gateway
family
Amazon
S3
Amazon
EBS
Amazon
EC2
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
More choice—Best fit File storage
EFS Standard
EFS Infrequent Access
COMING
SOON!
Amazon
EFS
AWS Storage
Gateway family
Amazon
S3
NEW!
Amazon FSx
for Lustre
Amazon FSx for
Windows File Server
Amazon
EBS
Amazon
EC2
NEW!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
File storage and transfer services
IN-CLOUD FILE
SYSTEMS
DATA
TRANSFER
HYBRID
STORAGE
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
PERFORMANCE
Amazon EFS
Scalable, elastic, cloud-native Linux file system
SHARED ACCESS HIGHLY AVAILABLE
AND DURABLE
ELASTIC AND
SCALABLE
SECURE AND
COMPLIANT
STORAGE
CLASSES
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Fully managed third-party file systems
Native
compatibility,
features,
performance
Cost-optimizedSimple and
fully managed
AWS
integrations
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon FSx for Windows File Server
Lift and shift your Windows file storage with fully managed windows file servers
Fully managed
Fast and flexible
performance
Native Windows
compatibility
Broad accessibility
Enterprise-ready
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Making high-performance Lustre file systems accessible and simple
Seamlessly integrated with your existing data repositories
Easy to launch and run with virtually unlimited scalability
A fully managed parallel file system on AWS
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What is Lustre?
15+
Open-sourceParallel file system Years of
experience
Top 100 fastest
supercomputers
60%
Electronic
design
automation
Financial
modeling
Seismic
processing
Media rendering
and transcoding
Geospatial
analysis
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon FSx for Lustre
Fully managed Lustre file system for compute-intensive workloads
Native file
system interface
Fully managedSeamless access to
your data repositories
Massively scalable
performance
Cost-optimized for
compute-intensive workloads
Secure
and compliant
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
More options for data transfer
AWS
Direct Connect
Amazon
Kinesis Data
Firehose
AWS
Snowball
AWS
Snowmobile
AWS
Storage
Gateway
Amazon S3
Transfer
Acceleration
AWS
DataSync
AWS
Transfer
for SFTP
AWS
Snowball Edge
Storage Optimized
Amazon Kinesis
Data Streams
Amazon Kinesis
Video Streams
NEW!
AWS
Snowball Edge
Compute
Optimized
NEW! NEW!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
More options for data transfer
AWS
Direct Connect
AWS
Storage
Gateway
AWS
DataSync
AWS
Transfer
for SFTP
NEW!NEW! NEW!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS DataSync
Simplifies, automates, and accelerates your online data transfer
Transfers
up to
10 Gbps per
agent
Pay as
you go
Simple data
movement to
Amazon S3 or
Amazon EFS
Secure and
reliable
transfers
Combines the speed and reliability of network acceleration
software with the cost-effectiveness of open source tools
AWS
integrated
AWS
Migrate active
application data
Transfer data for
timely processing
Replicate for data
protection and recovery
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Transfer for SFTP
Fully managed service makes it easy to integrate SFTP-based file transfers into AWS
Move your existing SFTP workflows to AWS in three steps
Seamless migration
of existing workflows
Data available for
archiving and
processing in
Amazon S3
Simple
to use
Cost
effective
Fully managed,
highly available, and
elastically scalable
1 2 3
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Storage Gateway
Hybrid cloud service enabling on-premises apps to seamlessly use AWS storage
STANDARD STORAGE PROTOCOLS
Seamlessly connect to AWS storage
without modifying applications
FULLY MANAGED CACHE
Frequently used data cached locally
for low-latency access
OPTIMIZED DATA TRANSFER
Secure upload of changed data and
downloads requested data
AWS INTEGRATED
Manage on-premise gateways in AWS console
and use your data across the entire portfolio
of AWS applications and services
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
File, volume, and tape storage types
Store and access objects
in Amazon Simple Storage
Service (Amazon S3) from
file-based applications
with local caching
Block storage on-premises
backed by cloud storage
with local caching, Amazon
Elastic Block Store (Amazon
EBS) snapshots, and clones
Drop-in replacement for
physical tape infrastructure
backed by cloud storage
with local caching
File Gateway Volume Gateway Tape Gateway
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
File storage and transfer services
IN-CLOUD FILE
SYSTEMS
DATA
TRANSFER
HYBRID
STORAGE
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Related breakouts and chalk talks
STG301-R1 | Deep Dive on Amazon Elastic File System (Amazon EFS)
Thursday | 12:15PM | Venetian | Breakout
STG312 | Got Files? We Got You Covered! Deploy Your File Workloads Quickly & Easily with AWS
Thursday | 4:00PM | Venetian | Breakout
STG322-R / STG322-R1 | Deep Dive on Amazon FSx for Windows File Server
Thursday | 3:15PM | Venetian | Breakout
Friday | 8:30AM | Venetian | Breakout
STG357 | Architecting Digital Media Archive Migrations with AWS
Thursday | 4:00PM | Aria | Chalk Talk
STG205-R1 | Migrating Data to the Cloud: Exploring Your Options from AWS
Friday | 8:30AM | Venetian | Breakout
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Sessions you can watch on-demand after re:Invent
STG202 | Optimizing Storage for Enterprise Workloads and Migrations
STG213-L | AWS Storage Leadership Session: What's New in Amazon S3, Amazon EFS, Amazon EBS, and More
STG301-R | Deep Dive on Amazon Elastic File System (Amazon EFS)
STG305-R | Deep Dive: Build Hybrid Cloud Storage Architectures with Storage Gateway
STG317 | NEW! Amazon FSx for Lustre: Introducing a New Fully Managed High-Performance File System
STG324 | NEW! Introducing AWS DataSync—Simplify, Automate, and Accelerate Online Data Transfer
STG326 | NEW! Introducing AWS Transfer for SFTP, a Fully Managed SFTP Service for Amazon S3
STG327 | NEW! Learn How Amazon EFS Infrequent Access Will Optimize File System Costs
Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Joe Disher
jdisher@amazon.com
Prashanth Bungale
bungale@amazon.com
Geert Jansen
gerardu@amazon.com
Paul Reed
paulreed@amazon.com
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

More Related Content

Deep Dive on Cloud File System Offerings: What to Use, Where, and Why (STG392) - AWS re:Invent 2018

  • 2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Deep Dive on Cloud File System Offerings: What to Use, Where, Why S T G 3 9 2 Joe Disher Sr. Product Marketing Marketing Storage Prashanth Bungale Sr. Product Manager Amazon FSx Geert Jansen Sr. Product Manager Amazon EFS Paul Reed Principal Product Manager Data transfer & Hybrid Storage
  • 3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Agenda
  • 4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Panel of experts Paul Reed Product Manager AWS Storage Gateway & AWS DataSync Prashanth Bungale Product Manager Amazon FSx Geert Jansen Product Manager Amazon EFS
  • 5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Portfolio breadth and depth Amazon EFS AWS Storage Gateway family Amazon S3 Amazon EBS Amazon EC2
  • 7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. More choice—Best fit File storage EFS Standard EFS Infrequent Access COMING SOON! Amazon EFS AWS Storage Gateway family Amazon S3 NEW! Amazon FSx for Lustre Amazon FSx for Windows File Server Amazon EBS Amazon EC2 NEW!
  • 8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. File storage and transfer services IN-CLOUD FILE SYSTEMS DATA TRANSFER HYBRID STORAGE
  • 9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. PERFORMANCE Amazon EFS Scalable, elastic, cloud-native Linux file system SHARED ACCESS HIGHLY AVAILABLE AND DURABLE ELASTIC AND SCALABLE SECURE AND COMPLIANT STORAGE CLASSES
  • 12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Fully managed third-party file systems Native compatibility, features, performance Cost-optimizedSimple and fully managed AWS integrations
  • 14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon FSx for Windows File Server Lift and shift your Windows file storage with fully managed windows file servers Fully managed Fast and flexible performance Native Windows compatibility Broad accessibility Enterprise-ready
  • 15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Making high-performance Lustre file systems accessible and simple Seamlessly integrated with your existing data repositories Easy to launch and run with virtually unlimited scalability A fully managed parallel file system on AWS
  • 17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. What is Lustre? 15+ Open-sourceParallel file system Years of experience Top 100 fastest supercomputers 60% Electronic design automation Financial modeling Seismic processing Media rendering and transcoding Geospatial analysis
  • 18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon FSx for Lustre Fully managed Lustre file system for compute-intensive workloads Native file system interface Fully managedSeamless access to your data repositories Massively scalable performance Cost-optimized for compute-intensive workloads Secure and compliant
  • 19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. More options for data transfer AWS Direct Connect Amazon Kinesis Data Firehose AWS Snowball AWS Snowmobile AWS Storage Gateway Amazon S3 Transfer Acceleration AWS DataSync AWS Transfer for SFTP AWS Snowball Edge Storage Optimized Amazon Kinesis Data Streams Amazon Kinesis Video Streams NEW! AWS Snowball Edge Compute Optimized NEW! NEW!
  • 21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. More options for data transfer AWS Direct Connect AWS Storage Gateway AWS DataSync AWS Transfer for SFTP NEW!NEW! NEW!
  • 22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS DataSync Simplifies, automates, and accelerates your online data transfer Transfers up to 10 Gbps per agent Pay as you go Simple data movement to Amazon S3 or Amazon EFS Secure and reliable transfers Combines the speed and reliability of network acceleration software with the cost-effectiveness of open source tools AWS integrated AWS Migrate active application data Transfer data for timely processing Replicate for data protection and recovery
  • 24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS Transfer for SFTP Fully managed service makes it easy to integrate SFTP-based file transfers into AWS Move your existing SFTP workflows to AWS in three steps Seamless migration of existing workflows Data available for archiving and processing in Amazon S3 Simple to use Cost effective Fully managed, highly available, and elastically scalable 1 2 3
  • 26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Storage Gateway Hybrid cloud service enabling on-premises apps to seamlessly use AWS storage STANDARD STORAGE PROTOCOLS Seamlessly connect to AWS storage without modifying applications FULLY MANAGED CACHE Frequently used data cached locally for low-latency access OPTIMIZED DATA TRANSFER Secure upload of changed data and downloads requested data AWS INTEGRATED Manage on-premise gateways in AWS console and use your data across the entire portfolio of AWS applications and services
  • 28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. File, volume, and tape storage types Store and access objects in Amazon Simple Storage Service (Amazon S3) from file-based applications with local caching Block storage on-premises backed by cloud storage with local caching, Amazon Elastic Block Store (Amazon EBS) snapshots, and clones Drop-in replacement for physical tape infrastructure backed by cloud storage with local caching File Gateway Volume Gateway Tape Gateway
  • 29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. File storage and transfer services IN-CLOUD FILE SYSTEMS DATA TRANSFER HYBRID STORAGE
  • 31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 32. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Related breakouts and chalk talks STG301-R1 | Deep Dive on Amazon Elastic File System (Amazon EFS) Thursday | 12:15PM | Venetian | Breakout STG312 | Got Files? We Got You Covered! Deploy Your File Workloads Quickly & Easily with AWS Thursday | 4:00PM | Venetian | Breakout STG322-R / STG322-R1 | Deep Dive on Amazon FSx for Windows File Server Thursday | 3:15PM | Venetian | Breakout Friday | 8:30AM | Venetian | Breakout STG357 | Architecting Digital Media Archive Migrations with AWS Thursday | 4:00PM | Aria | Chalk Talk STG205-R1 | Migrating Data to the Cloud: Exploring Your Options from AWS Friday | 8:30AM | Venetian | Breakout
  • 33. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Sessions you can watch on-demand after re:Invent STG202 | Optimizing Storage for Enterprise Workloads and Migrations STG213-L | AWS Storage Leadership Session: What's New in Amazon S3, Amazon EFS, Amazon EBS, and More STG301-R | Deep Dive on Amazon Elastic File System (Amazon EFS) STG305-R | Deep Dive: Build Hybrid Cloud Storage Architectures with Storage Gateway STG317 | NEW! Amazon FSx for Lustre: Introducing a New Fully Managed High-Performance File System STG324 | NEW! Introducing AWS DataSync—Simplify, Automate, and Accelerate Online Data Transfer STG326 | NEW! Introducing AWS Transfer for SFTP, a Fully Managed SFTP Service for Amazon S3 STG327 | NEW! Learn How Amazon EFS Infrequent Access Will Optimize File System Costs
  • 34. Thank you! © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Joe Disher jdisher@amazon.com Prashanth Bungale bungale@amazon.com Geert Jansen gerardu@amazon.com Paul Reed paulreed@amazon.com
  • 35. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.