Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.5555/1991596.1991613guideproceedingsArticle/Chapter ViewAbstractPublication PagesConference Proceedingsacm-pubtype
Article

Disk-locality in datacenter computing considered irrelevant

Published: 09 May 2011 Publication History

Abstract

No abstract available.

References

[1]
40 and 100 Gigabit Ethernet. http://www.extremenetworks.com.
[2]
An Updated Forecast of Worldwide Information Growth Through 2011. http://bit.ly/U1n6k.
[3]
Applications and Organizations using Hadoop. http://wiki.apache.org/hadoop/PoweredBy.
[4]
DETER. http://deter.cs.berkeley.edu/.
[5]
Flash on Compute Servers. http://www.hpts.ws/session1/kleiman.pdf. HPTPS, 2009.
[6]
Hadoop. http://hadoop.apache.org.
[7]
Implications of Storage Class Memories (SCM) on Software Architectures. http://www.hpts.ws/session2/mohan.pdf. HPTPS, 2009.
[8]
S. R. Hetzler. The Storage Chasm: Implications for the future of HDD and Solid State Storage. http://www.idema.org/.
[9]
Technologies for Data-Intensive Computing. http://www.hpts.ws/agenda.html. HPTPS, 2009.
[10]
The Global Memory System (GMS) Project. http://www.cs.washington.edu/homes/levy/gms/.
[11]
The NOW Project. http://now.cs.berkeley.edu/.
[12]
Dileep Bhandarkar on Datacenter Energy Efficiency, 2011. http://bit.ly/e3LVu8.
[13]
A. Thusoo, Z. Shao, S. Anthony, D. Borthakur, N. Jain, J. S. Sarma, R. Murthy, H. Liu. Data warehousing and analytics infrastructure at facebook. In ACM SIGMOD, 2010.
[14]
G. Ananthanarayanan, S. Kandula, A. Greenberg, I. Stoica, E. Harris, and B. Saha. Reining in the Outliers in Map-Reduce Clusters using Mantri. In USENIX OSDI, 2010.
[15]
B. Hindman, A. Konwinski, M. Zaharia, A. Ghodsi, A. Joseph, R. Katz, S. Shenker, I. Stoica. Mesos: A Platform for Fine-Grained Resource Sharing in the Data Center. In USENIX NSDI, 2011.
[16]
D. Narayanan, E. Thereska, A. Donnelly, S. Elnikety, A. Rowstron. Migrating Enterprise Storage to SSDs: Analysis of Trade-offs. In ACM EuroSys, 2009.
[17]
J. Dean and S. Ghemawat. MapReduce: Simplified Data Processing on Large Clusters. In USENIX OSDI, 2004.
[18]
G. Ananthanarayanan, S. Agarwal, S. Kandula, A. Greenberg, I. Stoica, D. Harlan, E. Harris. Scarlett: Coping with Skewed Popularity Content in MapReduce Clusters. In ACM EuroSys, 2011.
[19]
G. Porter. Towards Decoupling Storage and Computation in Hadoop with SuperDataNodes. In ACM LADIS, 2009.
[20]
H. Garcia-Molina and K. Salem. Main Memory Database Systems: An Overview. In IEEE TKDE, 1992.
[21]
M. Isard, V. Prabhakaran, J. Currey, U. Wieder, K. Talwar, and A. Goldberg. Quincy: Fair Scheduling for Distributed Computing Clusters. In ACM SOSP, 2009.
[22]
J. Ousterhout et al. The Case for RAMClouds: Scalable High-Performance Storage Entirely in DRAM. In SIGOPS Operating Systems Review, 2009.
[23]
L. A. Barroso and U. Holzle. The Datacenter as a Computer. http://bit.ly/2IJd8j.
[24]
M. Al-Fares, A. Loukissas, and A. Vahdat. A Scalable, Commodity Data Center Network Architecture. In ACM SIGCOMM, 2008.
[25]
M. Isard, M. Budiu, Y. Yu, A. Birrell and D. Fetterly. Dryad: Distributed Data-parallel Programs from Sequential Building Blocks. In ACM Eurosys, 2007.
[26]
M. Zaharia, D. Borthakur, J. Sen Sarma, K. Elmeleegy, S. Shenker, I. Stoica. Delay Scheduling: A Simple Technique for Achieving Locality and Fairness in Cluster Scheduling. In ACM Eurosys, 2010.
[27]
M. Zaharia, M. Chowdhury, M. J. Franklin, S. Shenker, I. Stoica. Spark: Cluster Computing with Working Sets. In USENIX HotCloud, 2010.
[28]
Kirk McKusick and Sean Quinlan. GFS: Evolution on Fast-Forward. CACM, March 2010.
[29]
R. Power and J. Li. Piccolo: Building Fast, Distributed Programs with Partitioned Tables. In USENIX OSDI, 2010.

Cited By

View all
  • (2022)Understanding the performance of erasure codes in hadoop distributed file systemProceedings of the Workshop on Challenges and Opportunities of Efficient and Performant Storage Systems10.1145/3503646.3524296(24-32)Online publication date: 5-Apr-2022
  • (2021)TridentProceedings of the VLDB Endowment10.14778/3461535.346154514:9(1570-1582)Online publication date: 22-Oct-2021
  • (2021)Energy and SLA-driven MapReduce Job Scheduling Framework for Cloud-based Cyber-Physical SystemsACM Transactions on Internet Technology10.1145/340977221:2(1-24)Online publication date: 3-May-2021
  • Show More Cited By

Index Terms

  1. Disk-locality in datacenter computing considered irrelevant
      Index terms have been assigned to the content through auto-classification.

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image Guide Proceedings
      HotOS'13: Proceedings of the 13th USENIX conference on Hot topics in operating systems
      May 2011
      33 pages

      Sponsors

      • VMware
      • Google Inc.
      • Intel: Intel
      • Microsoft Research: Microsoft Research

      Publisher

      USENIX Association

      United States

      Publication History

      Published: 09 May 2011

      Qualifiers

      • Article

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)0
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 30 Aug 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2022)Understanding the performance of erasure codes in hadoop distributed file systemProceedings of the Workshop on Challenges and Opportunities of Efficient and Performant Storage Systems10.1145/3503646.3524296(24-32)Online publication date: 5-Apr-2022
      • (2021)TridentProceedings of the VLDB Endowment10.14778/3461535.346154514:9(1570-1582)Online publication date: 22-Oct-2021
      • (2021)Energy and SLA-driven MapReduce Job Scheduling Framework for Cloud-based Cyber-Physical SystemsACM Transactions on Internet Technology10.1145/340977221:2(1-24)Online publication date: 3-May-2021
      • (2020)Could cloud storage be disrupted in the next decade?Proceedings of the 12th USENIX Conference on Hot Topics in Storage and File Systems10.5555/3488733.3488758(25-25)Online publication date: 13-Jul-2020
      • (2020)MagnetProceedings of the VLDB Endowment10.14778/3415478.341555813:12(3382-3395)Online publication date: 14-Sep-2020
      • (2020)Programming Strategies for Irregular Algorithms on the Emu ChickACM Transactions on Parallel Computing10.1145/34180777:4(1-25)Online publication date: 21-Oct-2020
      • (2019)The case for unifying data loading in machine learning clustersProceedings of the 11th USENIX Conference on Hot Topics in Cloud Computing10.5555/3357034.3357049(12-12)Online publication date: 8-Jul-2019
      • (2019)Shuffling, fast and slowProceedings of the 16th USENIX Conference on Networked Systems Design and Implementation10.5555/3323234.3323251(193-206)Online publication date: 26-Feb-2019
      • (2019)Information Retrieval Meets Scalable Text AnalyticsProceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3331184.3331395(1313-1316)Online publication date: 18-Jul-2019
      • (2019)Spread-n-shareProceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis10.1145/3295500.3356152(1-15)Online publication date: 17-Nov-2019
      • Show More Cited By

      View Options

      View options

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media