Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
SlideShare a Scribd company logo

USENIX FAST10 Report by Suzaki

•
•
Kuniyasu Suzaki
Kuniyasu Suzaki

1. Several papers presented techniques for improving flash storage performance and lifetime by reducing write amplification, such as using disk-based write caches and dynamic consolidation of disks. 2. A paper proposed a mechanism called "Membrane" that allows file systems to restart without terminating running applications by saving application state to memory. 3. Other topics included deduplication, latent sector errors, provenance tracking in file systems, and a "Backlog" technique for adding versioning capabilities to existing file systems.

1 of 14
Download to read offline
USENIX FAST 2010 Report at ２１回仮想化実装技術勉強会(vimpl) 20１０/March/31 須崎有康 Kuniyasu Suzaki
基本情報 • 8th USENIX File System and Storage Technology – 2010/Feb/22-26, サンノゼ – Submit 89, Accept 21 – 参加者 400人ぐらい。企業が多い。FaceBookがスポンサー • Best Papers are • "quFiles: The Right File at the Right Time " • "Membrane: Operating System Support for Restartable File Systems" • Keynote Address – Technology for Developing Regions • Eric Brewer, University of California, Berkeley – Agile Enterprise Analytics • Oliver Ratzesberger, eBay, Inc.
Day1 • WednesdayBuild a Better File System and the World Will Beat a Path to Your Door. – (Best Paper) quFiles: The Right File at the Right Time Kaushik Veeraraghavan and Jason Flinn, University of Michigan; Edmund B. Nightingale, Microsoft Research, Redmond; Brian Noble, University of Michigan – Tracking Back References in a Write-Anywhere File System Peter Macko and Margo Seltzer, Harvard University; Keith A. Smith, NetApp, Inc. – End-to-end Data Integrity for File Systems: A ZFS Case Study Yupu Zhang, Abhishek Rajimwale, Andrea C. Arpaci-Dusseau, and Remzi H. Arpaci- Dusseau, University of Wisconsin—Madison • Looking for Trouble – Black-Box Problem Diagnosis in Parallel File Systems Michael P. Kasick, Carnegie Mellon University; Jiaqi Tan, DSO National Labs, Singapore; Rajeev Gandhi and Priya Narasimhan, Carnegie Mellon University – A Clean-Slate Look at Disk Scrubbing Alina Oprea and Ari Juels, RSA Laboratories – Understanding Latent Sector Errors and How to Protect Against Them Bianca Schroeder, Sotirios Damouras, and Phillipa Gill, University of Toronto • Work-in-Progress Reports (WiPs) • Poster Session & Happy Hour
Day 2 • Flash: Savior of the Universe? – DFS: A File System for Virtualized Flash Storage William K. Josephson and Lars A. Bongo, Princeton University; David Flynn, Fusion-io; Kai Li, Princeton University – Extending SSD Lifetimes with Disk-Based Write Caches Gokul Soundararajan, University of Toronto; Vijayan Prabhakaran, Mahesh Balakrishnan, and Ted Wobber, Microsoft Research Silicon Valley – Write Endurance in Flash Drives: Measurements and Analysis Simona Boboila and Peter Desnoyers, Northeastern University • I/O, I/O, to Parallel I/O We Go – Accelerating Parallel Analysis of Scientific Simulation Data via Zazen Tiankai Tu, Charles A. Rendleman, Patrick J. Miller, Federico Sacerdoti, and Ron O. Dror, D.E. Shaw Research; David E. Shaw, D.E. Shaw Research and Columbia University – Efficient Object Storage Journaling in a Distributed Parallel File System Sarp Oral, Feiyi Wang, David Dillow, Galen Shipman, and Ross Miller, National Center for Computational Sciences at Oak Ridge National Laboratory; Oleg Drokin, Lustre Center of Excellence at Oak Ridge National Laboratory and Sun Microsystems Inc. – Panache: A Parallel File System Cache for Global File Access Marc Eshel, Roger Haskin, Dean Hildebrand, Manoj Naik, Frank Schmuck, and Renu Tewari, IBM Almaden Research • Making Management More Manageable – BASIL: Automated IO Load Balancing Across Storage Devices Ajay Gulati, Chethan Kumar, and Irfan Ahmad, VMware, Inc.; Karan Kumar, Carnegie Mellon University – Discovery of Application Workloads from Network File Traces Neeraja J. Yadwadkar, Chiranjib Bhattacharyya, and K. Gopinath, Indian Institute of Science; Thirumale Niranjan and Sai Susarla, NetApp Advanced Technology Group – Provenance for the Cloud Kiran-Kumar Muniswamy-Reddy, Peter Macko, and Margo Seltzer, Harvard School of Engineering and Applied Sciences
Day 3 • Concentration: The Deduplication Game – I/O Deduplication: Utilizing Content Similarity to Improve I/O Performance Ricardo Koller and Raju Rangaswami, Florida International University – HydraFS: A High-Throughput File System for the HYDRAstor Content- Addressable Storage System Cristian Ungureanu, NEC Laboratories America; Benjamin Atkin, Google; Akshat Aranya, Salil Gokhale, and Stephen Rago, NEC Laboratories America; Grzegorz Całkowski, VMware; Cezary Dubnicki, 9LivesData, LLC; Aniruddha Bohra, Akamai – Bimodal Content Defined Chunking for Backup Streams Erik Kruus and Cristian Ungureanu, NEC Laboratories America; Cezary Dubnicki, 9LivesData, LLC • The Power Button – Evaluating Performance and Energy in File System Server Workloads Priya Sehgal, Vasily Tarasov, and Erez Zadok, Stony Brook University – SRCMap: Energy Proportional Storage Using Dynamic Consolidation Akshat Verma, IBM Research, India; Ricardo Koller, Luis Useche, and Raju Rangaswami, Florida International University – (Best Paper) Membrane: Operating System Support for Restartable File Systems Swaminathan Sundararaman, Sriram Subramanian, Abhishek Rajimwale, Andrea C. Arpaci-Dusseau, Remzi H. Arpaci-Dusseau, and Michael M. Swift, University of Wisconsin—Madison
Extending SSD Lifetimes with Disk-Based Write Caches Gokul Soundararajan, University of Toronto; Vijayan Prabhakaran, Mahesh Balakrishnan, and Ted Wobber, Microsoft Research Silicon Valley • SSDのキャッシュにハードディスクを使う Griffin – 書換えを少なくすることでLifetimeを延ばす • 普通ならＲＡＭ、ＮＶＲＡＭ、ＳＳＤ • Griffinはハードディスク • 安い、シーケンシャルなら早い
Extending SSD Lifetimes with Disk-Based Write Caches Griffin • 読み書きの特性解析 – WAW: Write After Write – RAW: Read After Write • シーケンシャルアクセスになるようにログ構造的にHDを使う 。
Write Endurance in Flash Drives: Measurements and Analysis Simona Boboila and Peter Desnoyers, Northeastern University • USBフラッシュをリバースエンジニアリングして ブロック配置アルゴリズムの解析
Write Endurance in Flash Drives: Measurements and Analysis • 同じブロックを何回も書換えて振舞い解析 • いずれの書換えも40msec以上遅くなったら Dead
Write Endurance in Flash Drives: Measurements and Analysis
SRCMap: Energy Proportional Storage Using Dynamic Consolidation Akshat Verma, IBM Research, India; Ricardo Koller, Luis Useche, and Raju Rangaswami, Florida International University • 動的にHDを分離・停止して電力消費を抑える – RAIDの発展形？バンド幅確保？
Tracking Back References in a Write-Anywhere File System • 既存のファイルシステムをログ構造ファイルシステ ムにし、クローンやスナップショットを取ることのでき るBacklogの提案。 – Union File Systemのように既存のファイルシステムに追 加することがきで、先進的なファイルシステムBrtfsと同等 加する とがき 先進的な Brtfsと 等 の機能をEXT3で実現可能にした。
Membrane: Operating System Support for Restartable File Systems • ファイルシステムの障害時に実行中のプロセ スを保持したままファイルシステムの再起動 を可能にするOSへの追加構造の提案。 – 類似の研究はNeutron[SOSP09]。こちらはカー ネルをリブートするが、アプリケーションの実行状 況をメモリに保存。
その他 • 潜在的なセクタエラー発表で何回か参照されていた論文 – An Analysis of Latent Sector Errors in Disk Drives http://www.cs.wisc.edu/adsl/Publications/latent-sigmetrics07.pdf • Deduplication チュートリアル – 辞書式暗号化との関係の説明が良かった

More Related Content

USENIX FAST10 Report by Suzaki

  • 1. USENIX FAST 2010 Report at ２１回仮想化実装技術勉強会(vimpl) 20１０/March/31 須崎有康 Kuniyasu Suzaki
  • 2. 基本情報 • 8th USENIX File System and Storage Technology – 2010/Feb/22-26, サンノゼ – Submit 89, Accept 21 – 参加者 400人ぐらい。企業が多い。FaceBookがスポンサー • Best Papers are • "quFiles: The Right File at the Right Time " • "Membrane: Operating System Support for Restartable File Systems" • Keynote Address – Technology for Developing Regions • Eric Brewer, University of California, Berkeley – Agile Enterprise Analytics • Oliver Ratzesberger, eBay, Inc.
  • 3. Day1 • WednesdayBuild a Better File System and the World Will Beat a Path to Your Door. – (Best Paper) quFiles: The Right File at the Right Time Kaushik Veeraraghavan and Jason Flinn, University of Michigan; Edmund B. Nightingale, Microsoft Research, Redmond; Brian Noble, University of Michigan – Tracking Back References in a Write-Anywhere File System Peter Macko and Margo Seltzer, Harvard University; Keith A. Smith, NetApp, Inc. – End-to-end Data Integrity for File Systems: A ZFS Case Study Yupu Zhang, Abhishek Rajimwale, Andrea C. Arpaci-Dusseau, and Remzi H. Arpaci- Dusseau, University of Wisconsin—Madison • Looking for Trouble – Black-Box Problem Diagnosis in Parallel File Systems Michael P. Kasick, Carnegie Mellon University; Jiaqi Tan, DSO National Labs, Singapore; Rajeev Gandhi and Priya Narasimhan, Carnegie Mellon University – A Clean-Slate Look at Disk Scrubbing Alina Oprea and Ari Juels, RSA Laboratories – Understanding Latent Sector Errors and How to Protect Against Them Bianca Schroeder, Sotirios Damouras, and Phillipa Gill, University of Toronto • Work-in-Progress Reports (WiPs) • Poster Session & Happy Hour
  • 4. Day 2 • Flash: Savior of the Universe? – DFS: A File System for Virtualized Flash Storage William K. Josephson and Lars A. Bongo, Princeton University; David Flynn, Fusion-io; Kai Li, Princeton University – Extending SSD Lifetimes with Disk-Based Write Caches Gokul Soundararajan, University of Toronto; Vijayan Prabhakaran, Mahesh Balakrishnan, and Ted Wobber, Microsoft Research Silicon Valley – Write Endurance in Flash Drives: Measurements and Analysis Simona Boboila and Peter Desnoyers, Northeastern University • I/O, I/O, to Parallel I/O We Go – Accelerating Parallel Analysis of Scientific Simulation Data via Zazen Tiankai Tu, Charles A. Rendleman, Patrick J. Miller, Federico Sacerdoti, and Ron O. Dror, D.E. Shaw Research; David E. Shaw, D.E. Shaw Research and Columbia University – Efficient Object Storage Journaling in a Distributed Parallel File System Sarp Oral, Feiyi Wang, David Dillow, Galen Shipman, and Ross Miller, National Center for Computational Sciences at Oak Ridge National Laboratory; Oleg Drokin, Lustre Center of Excellence at Oak Ridge National Laboratory and Sun Microsystems Inc. – Panache: A Parallel File System Cache for Global File Access Marc Eshel, Roger Haskin, Dean Hildebrand, Manoj Naik, Frank Schmuck, and Renu Tewari, IBM Almaden Research • Making Management More Manageable – BASIL: Automated IO Load Balancing Across Storage Devices Ajay Gulati, Chethan Kumar, and Irfan Ahmad, VMware, Inc.; Karan Kumar, Carnegie Mellon University – Discovery of Application Workloads from Network File Traces Neeraja J. Yadwadkar, Chiranjib Bhattacharyya, and K. Gopinath, Indian Institute of Science; Thirumale Niranjan and Sai Susarla, NetApp Advanced Technology Group – Provenance for the Cloud Kiran-Kumar Muniswamy-Reddy, Peter Macko, and Margo Seltzer, Harvard School of Engineering and Applied Sciences
  • 5. Day 3 • Concentration: The Deduplication Game – I/O Deduplication: Utilizing Content Similarity to Improve I/O Performance Ricardo Koller and Raju Rangaswami, Florida International University – HydraFS: A High-Throughput File System for the HYDRAstor Content- Addressable Storage System Cristian Ungureanu, NEC Laboratories America; Benjamin Atkin, Google; Akshat Aranya, Salil Gokhale, and Stephen Rago, NEC Laboratories America; Grzegorz Całkowski, VMware; Cezary Dubnicki, 9LivesData, LLC; Aniruddha Bohra, Akamai – Bimodal Content Defined Chunking for Backup Streams Erik Kruus and Cristian Ungureanu, NEC Laboratories America; Cezary Dubnicki, 9LivesData, LLC • The Power Button – Evaluating Performance and Energy in File System Server Workloads Priya Sehgal, Vasily Tarasov, and Erez Zadok, Stony Brook University – SRCMap: Energy Proportional Storage Using Dynamic Consolidation Akshat Verma, IBM Research, India; Ricardo Koller, Luis Useche, and Raju Rangaswami, Florida International University – (Best Paper) Membrane: Operating System Support for Restartable File Systems Swaminathan Sundararaman, Sriram Subramanian, Abhishek Rajimwale, Andrea C. Arpaci-Dusseau, Remzi H. Arpaci-Dusseau, and Michael M. Swift, University of Wisconsin—Madison
  • 6. Extending SSD Lifetimes with Disk-Based Write Caches Gokul Soundararajan, University of Toronto; Vijayan Prabhakaran, Mahesh Balakrishnan, and Ted Wobber, Microsoft Research Silicon Valley • SSDのキャッシュにハードディスクを使う Griffin – 書換えを少なくすることでLifetimeを延ばす • 普通ならＲＡＭ、ＮＶＲＡＭ、ＳＳＤ • Griffinはハードディスク • 安い、シーケンシャルなら早い
  • 7. Extending SSD Lifetimes with Disk-Based Write Caches Griffin • 読み書きの特性解析 – WAW: Write After Write – RAW: Read After Write • シーケンシャルアクセスになるようにログ構造的にHDを使う 。
  • 8. Write Endurance in Flash Drives: Measurements and Analysis Simona Boboila and Peter Desnoyers, Northeastern University • USBフラッシュをリバースエンジニアリングして ブロック配置アルゴリズムの解析
  • 9. Write Endurance in Flash Drives: Measurements and Analysis • 同じブロックを何回も書換えて振舞い解析 • いずれの書換えも40msec以上遅くなったら Dead
  • 10. Write Endurance in Flash Drives: Measurements and Analysis
  • 11. SRCMap: Energy Proportional Storage Using Dynamic Consolidation Akshat Verma, IBM Research, India; Ricardo Koller, Luis Useche, and Raju Rangaswami, Florida International University • 動的にHDを分離・停止して電力消費を抑える – RAIDの発展形？バンド幅確保？
  • 12. Tracking Back References in a Write-Anywhere File System • 既存のファイルシステムをログ構造ファイルシステ ムにし、クローンやスナップショットを取ることのでき るBacklogの提案。 – Union File Systemのように既存のファイルシステムに追 加することがきで、先進的なファイルシステムBrtfsと同等 加する とがき 先進的な Brtfsと 等 の機能をEXT3で実現可能にした。
  • 13. Membrane: Operating System Support for Restartable File Systems • ファイルシステムの障害時に実行中のプロセ スを保持したままファイルシステムの再起動 を可能にするOSへの追加構造の提案。 – 類似の研究はNeutron[SOSP09]。こちらはカー ネルをリブートするが、アプリケーションの実行状 況をメモリに保存。
  • 14. その他 • 潜在的なセクタエラー発表で何回か参照されていた論文 – An Analysis of Latent Sector Errors in Disk Drives http://www.cs.wisc.edu/adsl/Publications/latent-sigmetrics07.pdf • Deduplication チュートリアル – 辞書式暗号化との関係の説明が良かった