Article

Free access

Cluster I/O with River: making the fast case common

Authors:

Remzi H. Arpaci-Dusseau,

Eric Anderson,

Noah Treuhaft,

David E. Culler,

Joseph M. Hellerstein,

David Patterson,

Kathy YelickAuthors Info & Claims

IOPADS '99: Proceedings of the sixth workshop on I/O in parallel and distributed systems

Pages 10 - 22

https://doi.org/10.1145/301816.301823

Published: 01 May 1999 Publication History

PDF eReader

References

[1]

Supercomputers: Plug and Play. The Economist, November 1998.

Google Scholar

[2]

A.C. Arpaci-Dusseau, R. H. Arpaci-Dusseau, D. E. Culler, L M. Hellerstein, and D. A. Patterson. High-Performance Sorting on Networks of Workstations. In SIGMOD '97, May 1997.

Digital Library

Google Scholar

[3]

A.C. Arpaci-Dusseau, R. H. Arpaci-Dusseau, D. E. Culler, J. M. Hellerstein, and D. A. Patterson. Searching for the Sorting Record: Experiences in Tuning NOW-Sort. In SPDT '98, Aug. 1998.

Digital Library

Google Scholar

[4]

H.E. Bal, M. E Kaashoek, and A. S. Tanenbaum. Orca: A Language for Parallel Programming of Distributed Systems. IEEE Transactions on Software Engineering, 18(3):190-205, Mar. 1992.

Digital Library

Google Scholar

[5]

T. Barclay, R. Barnes, J. Gray, and P. Sundaresan. Loading Databases Using Dataflow Parallelism. SIGMOD Record (ACM Special Interest Group on Management of Data), 23(4):72-83, December 1994.

Digital Library

Google Scholar

[6]

B. Bershad, D. Black, D. DeWitt, G. Gibson, K. Li, L. Peterson, and M. Stair. Operating system support for high-performance parallel I/O systems. Technical Report CCSF-40, Scalable I/O Initiative, Caltech Concurrent Supercomputing Facilities, Cattech, I994.

Google Scholar

[7]

R. D. Blumofe, C. E Joerg, B. C. Kuszmaul, C. E. Leiserson, K. H. Randall, and Y. Zhou. Cilk: An Efficient Multithreaded Runtime System. In Proceedings of the 5th Symposium on Principles and Practice of Parallel Programming, July 1995.

Digital Library

Google Scholar

[8]

R. D. Blumofe and E A. Lisiecld. Adaptive and Reliable Parallel Computing on Networks of Workstations. In USENIX, editor, 1997Annual Technical Conference, January 6-10, 199Z Anaheim, CA, pages 133--147, Berkeley, CA, USA, Jan. 1997. USENIX.

Digital Library

Google Scholar

[9]

N. Boden, D. Cohen, R. E, F~lderman, A. KuIawik, and C. Seitz. Myrlnet: A Gigabit-per-sccond local Area Network. IEEE Micro, February 1995.

Digital Library

Google Scholar

[10]

L-E Cabrera and D. D. E. Long. Swift: Using distributed disk striping to provide high FO data rates. Computing Systems, 4(4):405-436, Fall 1991.

Google Scholar

[11]

N. L Cardero. Implementation of tuple space. PhD thesis, Department of Computer Science, Yale University, December 1987.

Google Scholar

[12]

S. Chakrabarti, E. Deprit, E.-L Ira, L Jones, A. Krishnamurthy, C.-P. Wen, and K. Yetick. Multipol: A Distributed Data Structure Library. Technical Report CSD-95-879, University of California, Berkeley, July 1995.

Digital Library

Google Scholar

[13]

A. Choudhary, R. Bordawekar, M. Harry, R. Krishnaiyer, R. Ponnusamy, I'. Singh, and R. Thakur. PASSION: parallel and scalable software for input-output. Technical Report SCC8-636, ECE Dept., NPAC and CASE Center, Syracuse University, September 1994.

Google Scholar

[14]

E. E Codd. A Relational Model of Data for Large Shared Data Banks. Communications of the ACM, 13(6):377-387, June 1970. Also published in/as: 'Readings in Database Systems, 3rd Edition', M. Stonebraker and J. Hellerstein, Morgan-Kaufmann, 1998, pp. 5-15.

Digital Library

Google Scholar

[15]

G. Copeland, W. Alexander, E. Boughter, and T. Keller. Data Placement in Bubba. SIGMOD Record (ACM Special Interest Group on Management of Data), 17(3):99-I08, Sept. I988.

Digital Library

Google Scholar

[16]

E E Corbett and D. G. Feitelson. The Vesta parallel file system. ACM Transactions on Computer Systems, I4(3):225-264, August 1996.

Digital Library

Google Scholar

[17]

T. R Council. TPC-D Individual Results, 1998. http://www.tpc.org/results/tpc.d.results.page.html.

Google Scholar

[18]

D. E. CuBer, A. Dusseau, S. C. Goldstein, A. Krishnamurthy, S. Lumetta, T. von Eicken, and IC Yelick. Parallel Programming in Split-C. In Proceedings of Supercomputing '93, pages 262- 273, I993.

Digital Library

Google Scholar

[19]

D. DeWitt and J. Gray. Parallel database systems: The future of high-performance database systems. Communications of the ACM, 35(6):85-98,June 1992.

Digital Library

Google Scholar

[20]

D. J. DeWitt, S. Ghandeharizadeh, and D. Schneider. A Performance Analysis of the Gamma Database Machine. SIGMOD Record (ACM Special Interest Group on Management of Data), 17(3):350-360, Sept. 1988.

Digital Library

Google Scholar

[21]

G. Geist and V. Sundemm. The Evolution of the PVM Concurrent Computing System. In COMPCON, February 1993.

Crossref

Google Scholar

[22]

D. Gelemter, N. Carriero, S. Chandran, and S. Chang. Parallel programmiagin Linda. In D. Degroot, editor, 1985 International Conference on Parallel Processing, pages 255-263, ! 985.

Google Scholar

[23]

S. C. Goldstein, K. E. Schauser, and D. E. Culler. Lazy Threads: Implementing a Fast Parallel Call. Journal of Parallel and Distributed Computing, 37(1):5-20, Aug. 1996.

Digital Library

Google Scholar

[24]

G. Graefe. Encapsulation of Parallelism in the Volcano Query Processing System. SIGMOD Record (ACM Special Interest Group on Management of Data), 19(2): 102-111, June 1990.

Digital Library

Google Scholar

[25]

J. Gray. What Happens When Processors Are Infinitely Fast And Storage Is Free? Invited Talk: 1997 IOPADS, November 1997.

Google Scholar

[26]

H.-I. Hsiao and D. DeWitt. Chained Declustering: A new availability strategy for multiprocessor database machines. In Proceedings of 6th International Data Engineering Conference, pages 456--465, I990.

Digital Library

Google Scholar

[27]

L Huber, C. I_. Etford, D. A. Reed, A. A. Chien, and D. S. Blumenthal. PPFS: A high performance portable parallel file system. In Proceedings of the 9th ACM International Conference on Supercomputing, pages 385-394, Barcelona, July 1995. ACM Press.

Digital Library

Google Scholar

[28]

M. Kitsuregawa, H. Tanaka, and 1". Moto-Oka. GRACE: Relational algebra machine based on hash and sort # its design coneepts. Journal of the Information Processing Society of Japan, 6(3):148-155,1983.

Google Scholar

[29]

S. Kleiman, J. Voll, j. Eykholt, A. Shivalingiah, D. Williams, M. Smith, S. Barton, and G. Skinner. Symmetric Multiprocessing in Solaris 2.0. In Proceedings of COMPCON Spring '92, 1992.

Digital Library

Google Scholar

[30]

D. Kotz. Disk-directed I/O for MIMD multiprocessors. In Proceedings of the 1994 Symposium on Operating Systems Design and Implementation, pages 61-74. USENIX Association, November 1994. Updated as Dartmouth TR PCS.-TR94-226 on November 8, 1994.

Digital Library

Google Scholar

[31]

S. Kubica, T. Robey, and C. Moorman. Data parallel programming with the Khoros Data Services Library. Lecture Notes in Computer Science, 1388:963-973,1998.

Crossref

Google Scholar

[32]

B. Lindsey. SMP lntra-Ouery Parallelism in DB2 UDB. Database Seminar at U.C. Berkeley, February 1998.

Google Scholar

[33]

S. J. LoVerso, M. Isman, A. Nanopoulos, W. Nesheim, E. D. Milne, and R. Wheeler. sfs: A parallel file system for the CM-5. In Proceedingsof the 1993 Summer USENIX Technical Conference, pages 291-305,1993.

Google Scholar

[34]

A. Mainwaring and D. Culler. Active Message Applications Programming Interface and Communication Subsystem Organization. Technical Report CSD-96-9 t 8, University of California at Berkeley, October 1996.

Digital Library

Google Scholar

[35]

J. N. Matthews, D. Roselti, A. M. Costello, R. Y. Wang, and T. E. Anderson. Improving the performance of log-structured file systems with adaptive methods. In Proceedings of the 16th Symposium on Operating Systems Principles (SOSP-97), volume 31,5 of Operating Systems Review, pages 238-251, Saint-Malo, France, OctoberS-8 1997. ACM SIGOPS, ACM Press.

Digital Library

Google Scholar

[36]

R. V. Meter. Observing the Effects of Multi-Zone Disks. In Proceedings of the 1997 USF#IX Conference, Jan. 1997.

Digital Library

Google Scholar

[37]

N. Nieuwejaar and D. Kotz. The Galley parallel file system. In tVoceedings of the IOtA ACM International Conference on Supercomputing, pages 374-381, Philadelphia, PA, May 1996. ACM Press.

Digital Library

Google Scholar

[38]

B. Nitzberg. Performance of the iPSC#60 Concurrent File System. Technical Report RHD-92-020, NAS Systems Division, NASA Ames, December 1992.

Google Scholar

[39]

S. #ki_n_, M. Lauria, and A. C#ien. High Performance Messaging on Workstations: Illinois Fast Messages (FM) for Myrinet. In Proceedings of the 1995 ACM/IEEE Supercomputing Conference, December 3--8, 1995, San Diego Convention Center, San Diego, CA, USA. ACM Press and IEEE Computer Society Press, 1995.

Digital Library

Google Scholar

[40]

G. Papadopolous# Untitled. Talk at W'mter NOW Retreat, July 1997.

Google Scholar

[41]

D. M. Ritchie. A Stream Input-Output System. BLTJ, 63(8, Part 2):1897-1910, October 1984.

Google Scholar

[42]

J.H. Saltzer, D. P. Reed, and D. D. Clark. End-to-End Arguments in System Design. ACM Transactions on Computer Systems, pages 277-288, November 1984.

Digital Library

Google Scholar

[43]

D. Scales and M. Laln. Transparent Fault Tolerance for Parallel Applications on Networks of Workstaions. In Proceedings ofthe 1996 USENIX Conference, Jan. 1996.

Digital Library

Google Scholar

[44]

M. Seltzer and C. Small. SeIf-Monitoring and Self-Adapting Systems. In Proceedings of the 1997 Workshop on Hot Topics on Operating Systems, Chatham, MA, May 1997.

Digital Library

Google Scholar

[45]

L. D. Shapiro. Join processing in database systems with large main memories. ACM Transactions on Database Systems, 11(3):239-264, Sept. 1986.

Digital Library

Google Scholar

[46]

M. Stonebraker, J. Chen, N. Nathan, C. Paxson, and J. Wu. Tioga:providing data management support for scientific visualization applications. In International Conference On Very Large Data Bases (VLDB '93), pages 25-38, San Francisco, Ca., USA, Aug. 1993. Morgan Kaufmann Publishers, Inc.

Digital Library

Google Scholar

[47]

The MPI Forum. MPI: A Message Passing Interface. In Proceedings of Supercomputing '93, pages 878--883, November 1993.

Digital Library

Google Scholar

[48]

T. yon Eicken, A. Basu, V. Buch, and W. Vogels. U-Net: A User-Level Network Interface for ParaIle} and Distributed Computing. In Proceedings of the 14th A CM Symposium on Operating Systems Principles, pages 40-53, December 1995.

Digital Library

Google Scholar

[49]

T. yon Eicken, D. E. Culler, S. C. Goldstein, and ICE. Schauser. Active Messages: a Mechanism for Integrated Communication and Computation. In Proceedings of the 19th Annual International Symposium on Computer Architecture, pages 256-266, Gold Coast, Australia, May 19-21, 1992. ACM SIGARCH and IEEE Computer Society TCCA. Computer Architecture News, 20(2), May 1992.

Digital Library

Google Scholar

[50]

R. W'mter and K. Auerbach. The Big Trine: 1998 Winter VI.DB Survey. Database Programming and Design, 1998.

Google Scholar

[51]

R. Wolniewicz and G. Graefe. Algebraic Optimization of Computations over Scientific Databases. In VLDB '93, pages 13-24, 1993.

Digital Library

Google Scholar

Cited By

View all

Gheorghe GDespa V(2022)Progressive Conceptions of the Future in Cyber-Mix Mechatronics Industry and Claytronics Engineering (I)Scientific Bulletin of Valahia University - Materials and Mechanics10.2478/bsmm-2022-000918:18(53-57)Online publication date: 30-Apr-2022
https://doi.org/10.2478/bsmm-2022-0009
Wojtowicz DYin SMorvan FHameurlain A(2021)Cost-Effective Dynamic Optimisation for Multi-Cloud Queries2021 IEEE 14th International Conference on Cloud Computing (CLOUD)10.1109/CLOUD53861.2021.00052(387-397)Online publication date: Oct-2021
https://doi.org/10.1109/CLOUD53861.2021.00052
Yadav DMalik PDabas KSingh P(2019)FeedpalProceedings of the ACM on Human-Computer Interaction10.1145/33592723:CSCW(1-30)Online publication date: 7-Nov-2019
https://dl.acm.org/doi/10.1145/3359272
Show More Cited By

Index Terms

Cluster I/O with River: making the fast case common

Recommendations

River acid mine drainage: sediment and water mapping through hyperspectral Hymap data

The Odiel River Huelva, southwest Spain carries acidic water originating from mine waste contamination, including massive sulphide ore deposits. As the river approaches the coastal estuary, tidal factors influence both sediment and water dynamics. As ...
Evaluation of Water Environmental Quality of Liao River Fuxin Section Based on Fuzzy Cluster Analysis
ISDEA '10: Proceedings of the 2010 International Conference on Intelligent System Design and Engineering Application - Volume 01

The fuzzy cluster analytical method is introduced here. By using this method the environmental monitoring sections of surface water of the three Liao River branches in Fuxin territory - the Liu River, the Raoyang River and the Yangximu River, were ...
Interactions between Polluted River and Groundwater -- A Case Study of the Weihe River, China
ICBEB '12: Proceedings of the 2012 International Conference on Biomedical Engineering and Biotechnology

Interactions between the surface water and groundwater is important to evaluate the structure of river eco-system, river restoration and riparian management. Such interactions in the Weihe River of Haihe River basin are analyzed using hydro chemical ...

Comments

Information & Contributors

Information

Published In

IOPADS '99: Proceedings of the sixth workshop on I/O in parallel and distributed systems

May 1999

98 pages

ISBN:1581131232

DOI:10.1145/301816

Chairmen:
Thomas H. Cormen
Dartmouth College, Hanover, NH
,
Rajeev Thakur
Argonne National Lab, Argonne, IL
,
Daniel A. Reed
Univ. of Illinois at Urbana-Champaign, Urbana

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 May 1999

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

IOPADS99

Sponsor:

IOPADS99: 6th Workshop on I/O in Parallel and Distributed Systems

May 5, 1999

Georgia, Atlanta, USA

Acceptance Rates

IOPADS '99 Paper Acceptance Rate 9 of 30 submissions, 30%;

Overall Acceptance Rate 19 of 56 submissions, 34%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

135
Total Citations
View Citations
921
Total Downloads

Downloads (Last 12 months)44
Downloads (Last 6 weeks)3

Reflects downloads up to 26 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Gheorghe GDespa V(2022)Progressive Conceptions of the Future in Cyber-Mix Mechatronics Industry and Claytronics Engineering (I)Scientific Bulletin of Valahia University - Materials and Mechanics10.2478/bsmm-2022-000918:18(53-57)Online publication date: 30-Apr-2022
https://doi.org/10.2478/bsmm-2022-0009
Wojtowicz DYin SMorvan FHameurlain A(2021)Cost-Effective Dynamic Optimisation for Multi-Cloud Queries2021 IEEE 14th International Conference on Cloud Computing (CLOUD)10.1109/CLOUD53861.2021.00052(387-397)Online publication date: Oct-2021
https://doi.org/10.1109/CLOUD53861.2021.00052
Yadav DMalik PDabas KSingh P(2019)FeedpalProceedings of the ACM on Human-Computer Interaction10.1145/33592723:CSCW(1-30)Online publication date: 7-Nov-2019
https://dl.acm.org/doi/10.1145/3359272
Axtell BMunteanu C(2019)Back to Real PicturesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/33512323:3(1-24)Online publication date: 9-Sep-2019
https://dl.acm.org/doi/10.1145/3351232
Anderson BShi MTan VWang Y(2019)Mobile Gait Analysis Using Foot-Mounted UWB SensorsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/33512313:3(1-22)Online publication date: 9-Sep-2019
https://dl.acm.org/doi/10.1145/3351231
Conradie WFrittella SPalmigiano ATzimoulis AWijnberg N(2019)Probabilistic Epistemic Updates on AlgebrasACM Transactions on Computational Logic10.1145/334172520:4(1-75)Online publication date: 21-Aug-2019
https://dl.acm.org/doi/10.1145/3341725
Huang XKwiatkowska MOlejnik M(2019)Reasoning about Cognitive Trust in Stochastic Multiagent SystemsACM Transactions on Computational Logic10.1145/332912320:4(1-64)Online publication date: 16-Jul-2019
https://dl.acm.org/doi/10.1145/3329123
Horne RTiu AAman BCiobanu G(2019)De Morgan Dual Nominal Quantifiers Modelling Private Names in Non-Commutative LogicACM Transactions on Computational Logic10.1145/332582120:4(1-44)Online publication date: 16-Jul-2019
https://dl.acm.org/doi/10.1145/3325821
Cheng YHao ZCai R(2019)Auto-scaling for real-time stream analytics on HPC cloudService Oriented Computing and Applications10.1007/s11761-019-00262-013:2(169-183)Online publication date: 1-Jun-2019
https://dl.acm.org/doi/10.1007/s11761-019-00262-0
Hirzel MSoulé RGedik BSchneider S(2019)Stream Query OptimizationEncyclopedia of Big Data Technologies10.1007/978-3-319-77525-8_261(1607-1615)Online publication date: 20-Feb-2019
https://doi.org/10.1007/978-3-319-77525-8_261
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

River acid mine drainage: sediment and water mapping through hyperspectral Hymap data

Evaluation of Water Environmental Quality of Liao River Fuxin Section Based on Fuzzy Cluster Analysis

Interactions between Polluted River and Groundwater -- A Case Study of the Weihe River, China