research-article

Runtime support for multicore Haskell

Authors:

Simon Peyton Jones,

Satnam SinghAuthors Info & Claims

ACM SIGPLAN Notices, Volume 44, Issue 9

Pages 65 - 78

https://doi.org/10.1145/1631687.1596563

Published: 31 August 2009 Publication History

Abstract

Purely functional programs should run well on parallel hardware because of the absence of side effects, but it has proved hard to realise this potential in practice. Plenty of papers describe promising ideas, but vastly fewer describe real implementations with good wall-clock performance. We describe just such an implementation, and quantitatively explore some of the complex design tradeoffs that make such implementations hard to build. Our measurements are necessarily detailed and specific, but they are reproducible, and we believe that they offer some general insights.

Supplementary Material

JPG File (runtimesupportformulticorehaskellonvimeo.jpg)

Download
10.70 KB

MP4 File (runtimesupportformulticorehaskellonvimeo.mp4)

Download
89.16 MB

References

[1]

J. R. Armstrong, R. Virding, C. Wikstrom, and M. Williams. Concurrent programming in ERLANG (2nd ed.). Prentice Hall International (UK) Ltd., Hertfordshire, UK, 1996.

Digital Library

[2]

Nimar S. Arora, Robert D. Blumofe, and C. Greg Plaxton. Thread scheduling for multiprogrammed multiprocessors. In In Proceedings of the Tenth Annual ACM Symposium on Parallel Algorithms and Architectures (SPAA), Puerto Vallarta, pages 119--129, 1998.

Digital Library

[3]

J. Berthold, S. Marlow, A. Al Zain, and K. Hammond. Comparing and optimising parallel Haskell implementations on multicore. In IFL'08: International Symposium on Implementation and Application of Functional Languages (Draft Proceedings), Hatfield, UK, 2008.

[4]

Stephen M. Blackburn and Antony L. Hosking. Barriers: friend or foe? In ISMM '04: Proceedings of the 4th international symposium on Memory management, pages 143--151, New York, NY, USA, 2004. ACM. ISBN 1-58113-945-4.

Digital Library

[5]

G. E. Blelloch, S. Chatterjee, J. C. Hardwick, J. Sipelstein, and M Zagha. Implementation of a portable nested data-parallel language. JDPC, 21(1):4--14, 1994.

Digital Library

[6]

R. D. Blumofe, C. F. Joerg, B. C. Kuszmaul, and C. E. Lieserson. Cilk: an efficient multithreaded runtime system. SIGNPLAN Not., 30(8):207--216, 2001.

Digital Library

[7]

M. T. Chakravarty, G. Keller, R. Leshinskiy, and W. Pfannenstiel. Nepal - Nested Data Parallelism in Haskell. LNCS, 2150, Aug 2001.

[8]

David Chase and Yossi Lev. Dynamic circular work-stealing deque. In SPAA '05: Proceedings of the seventeenth annual ACM symposium on Parallelism in algorithms and architectures, pages 21--28, New York, NY, USA, 2005. ACM. ISBN 1-58113-986-1.

Digital Library

[9]

Damien Doligez and Xavier Leroy. A concurrent, generational garbage collector for a multithreaded implementation of ml. In POPL '93: Proceedings of the 20th ACM SIGPLAN-SIGACT symposium on Principles of programming languages, pages 113--123, New York, NY, USA, 1993. ACM. ISBN 0-89791-560-7.

Digital Library

[10]

Christine Flood, Dave Detlefs, Nir Shavit, and Catherine Zhang. Parallel garbage collection for shared memory multiprocessors. In Usenix Java Virtual Machine Research and Technology Symposium (JVM '01), Monterey, CA, 2001. URL citeseer.ist.psu.edu/flood01parallel.html.

Digital Library

[11]

Matthew Fluet, Mike Rainey, and John Reppy. A scheduling framework for general-purpose parallel languages. SIGPLAN Not., 43 (9):241--252, 2008a. ISSN 0362-1340.

Digital Library

[12]

Matthew Fluet, Mike Rainey, John Reppy, and Adam Shaw. Implicitly-threaded Parallelism in Manticore. International Conference on Functional Programming, pages 119--130, 2008b.

Digital Library

[13]

J. L. Gaudiot, T. DeBoni, J. Feo,W. Bohm,W. Najjar, and P. Miller. The Sisal model of functional programming and its implementation. In As '97, pages 112--123, Los Altimos, CA, March 1997. IEEE Computer Society Press.

Digital Library

[14]

Tim Harris and Satnam Singh. Feedback directed implicit parallelism. In ICFP '07: Proceedings of the 12th ACM SIGPLAN international conference on Functional programming, pages 251--264, New York, NY, USA, 2007. ACM. ISBN 978-1-59593-815-2.

Digital Library

[15]

Tim Harris, Simon Marlow, and Simon Peyton Jones. Haskell on a shared-memory multiprocessor. In Haskell '05: Proceedings of the 2005 ACM SIGPLAN workshop on Haskell, pages 49--61. ACM Press, September 2005. ISBN 1-59593-071-X. URL http://www.haskell.org/~simonmar/papers/multiproc.pdf.

Digital Library

[16]

S. Jagannathan and J. Philbin. A customizable substrate for concurrent languages. In ACM Conference on Programming Languages Design and Implementation (PLDI'92), pages 55--81. ACM Press, June 1992.

Digital Library

[17]

P. Li, Simon Marlow, Simon Peyton Jones, and A. Tolmach. Lightweight concurrency primitives for GHC. In Haskell '07: Proceedings of the 2007 ACM SIGPLAN workshop on Haskell, pages 107--118. ACM Press, September 2007a.

Digital Library

[18]

Peng Li, Simon Marlow, Simon Peyton Jones, and Andrew Tolmach. Lightweight concurrency primitives for GHC. Haskell '07: Proceedings of the ACM SIGPLAN workshop on Haskell workshop, June 2007b. URL http://www.haskell.org/~simonmar/papers/conc-substrate.pdf.

Digital Library

[19]

H-W. Loidl, P.W. Trinder, K. Hammond, S.B. Junaidu, R.G. Morgan, and S.L. Peyton Jones. Engineering Parallel Symbolic Programs in GPH. Concurrency -- Practice and Experience, 11:701--752, 1999. URL http://www.cee.hw.ac.uk/\~{}dsg/gph/papers/ps/cpe.ps.gz.

[20]

H.-W. Loidl, F. Rubio, N. Scaife, K. Hammond, S. Horiguchi, U. Klusik, R. Loogen, G. J. Michaelson, R. Pe na, S. Priebe, A J. Rebon, and P. W. Trinder. Comparing parallel functional languages: Programming and performance. Higher Order Symbol. Comput., 16(3):203--251, 2003. ISSN 1388-3690.

Digital Library

[21]

Rita Loogen, Yolanda Ortega-Mallen, and Ricardo Pena. Parallel Functional Programming in Eden. Journal of Functional Programming, 15(3):431--475, 2005.

Digital Library

[22]

Simon Marlow, Simon Peyton Jones, and Wolfgang Thaller. Extending the haskell foreign function interface with concurrency. In Proceedings of the ACM SIGPLAN workshop on Haskell, pages 57--68, Snowbird, Utah, USA, September 2004. URL http://www.haskell.org/~simonmar/papers/conc-ffi.pdf.

Digital Library

[23]

Simon Marlow, Tim Harris, Roshan P. James, and Simon Peyton Jones. Parallel generational-copying garbage collection with a block-structured heap. In ISMM '08: Proceedings of the 7th international symposium on Memory management. ACM, June 2008. URL http://www.haskell.org/~simonmar/papers/parallel-gc.pdf.

Digital Library

[24]

R. S. Nikhl. ID language reference manual. Laboratory for Computer Science, MIT, Jul 1991.

[25]

R. S. Nikhl and Arvind. Implicit Parallel Programming in pH. Morgan Kaufmann Publishers, San Francisco, CA, 2001.

Digital Library

[26]

WD Partain. The nofib benchmark suite of Haskell programs. In Functional Programming, Glasgow 1992, Workshops in Computing, pages 195--202. Springer Verlag, 1992.

Digital Library

[27]

S. Peyton Jones, A. Gordon, and S. Finne. Concurrent Haskell. In Proc. of POPL'96, pages 295--308. ACM Press, 1996.

Digital Library

[28]

Simon Peyton Jones, Roman Leshchinskiy, Gabriele Keller, and Manuel M. T. Chakravarty. Harnessing the multicores: Nested data parallelism in Haskell. In FSTTCS 2009: IARCS Annual Conference on Foundations of Software Technology and Theoretical Computer Science, 2009.

[29]

Daniel Spoonhower, Guy E. Blelloch, Robert Harper, and Phillip B. Gibbons. Space profiling for parallel functional programs. In ICFP '08: Proceedings of the 12th ACM SIGPLAN international conference on Functional programming, pages 253--264, New York, NY, USA, 2008. ACM.

Digital Library

[30]

P. W. Trinder, H.-W. Loidl, and R. F. Pointon. Parallel and distributed Haskells. J. Funct. Program., 12(5):469--510, 2002. ISSN 0956-7968.

Digital Library

[31]

PW Trinder, K Hammond, JS Mattson, AS Partridge, and SL Peyton Jones. GUM: a portable parallel implementation of haskell. In ACM Conference on Programming Languages Design and Implementation (PLDI'96). ACM Press, Philadelphia, May 1996.

Digital Library

[32]

PW Trinder, K Hammond, H-W Loidl, and SL Peyton Jones. Algorithm + strategy = parallelism. Journal of Functional Programming, 8:23--60, January 1998.

Digital Library

Cited By

Süß TNagel LVef MBrinkmann AFeld DSoddemann T(2021)Pure Functions in C: A Small Keyword for Automatic ParallelizationInternational Journal of Parallel Programming10.1007/s10766-020-00660-449:1(1-24)Online publication date: 1-Feb-2021
https://dl.acm.org/doi/10.1007/s10766-020-00660-4
Kim YCheon JHur TByun SWoo G(2020)SSAM: A Haskell Parallel Programming STM Based Simple Actor ModelJournal of Physics: Conference Series10.1088/1742-6596/1566/1/0120401566(012040)Online publication date: 4-Jul-2020
https://doi.org/10.1088/1742-6596/1566/1/012040
Belikov ELoidl HMichaelson G(2019)Colocation of Potential Parallelism in a Distributed Adaptive Run-Time System for Parallel HaskellZivilgesellschaft und Wohlfahrtsstaat im Wandel10.1007/978-3-030-18506-0_1(1-19)Online publication date: 24-Apr-2019
https://doi.org/10.1007/978-3-030-18506-0_1
Show More Cited By

Index Terms

Runtime support for multicore Haskell
1. Software and its engineering
  1. Software notations and tools
    1. Compilers
      1. Runtime environments
    2. General programming languages
      1. Language types
        Functional languages

Recommendations

Runtime support for multicore Haskell
ICFP '09: Proceedings of the 14th ACM SIGPLAN international conference on Functional programming

Purely functional programs should run well on parallel hardware because of the absence of side effects, but it has proved hard to realise this potential in practice. Plenty of papers describe promising ideas, but vastly fewer describe real ...
Hybrid PGAS runtime support for multicore nodes
PGAS '10: Proceedings of the Fourth Conference on Partitioned Global Address Space Programming Model

With multicore processors as the standard building block for high performance systems, parallel runtime systems need to provide excellent performance on shared memory, distributed memory, and hybrids. Conventional wisdom suggests that threads should be ...
Comparing and Optimising Parallel Haskell Implementations for Multicore Machines
ICPPW '09: Proceedings of the 2009 International Conference on Parallel Processing Workshops

In this paper, we investigate the differences and tradeoffs imposed by two parallel Haskell dialects running on multicore machines. GpH and Eden are both constructed using the highly-optimising sequential GHC compiler, and share thread scheduling, and ...

Comments

Information & Contributors

Information

Published In

cover image ACM SIGPLAN Notices

ACM SIGPLAN Notices Volume 44, Issue 9

ICFP '09

September 2009

343 pages

ISSN:0362-1340

EISSN:1558-1160

DOI:10.1145/1631687

Issue’s Table of Contents

ICFP '09: Proceedings of the 14th ACM SIGPLAN international conference on Functional programming
August 2009
364 pages
ISBN:9781605583327
DOI:10.1145/1596550
General Chair:
Graham Hutton
University of Nottingham
,
Program Chair:
Andrew Tolmach
Portland State University

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 31 August 2009

Published in SIGPLAN Volume 44, Issue 9

Check for updates

Author Tag

Haskell parallel runtime

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

95
Total Citations
View Citations
872
Total Downloads

Downloads (Last 12 months)14
Downloads (Last 6 weeks)3

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Süß TNagel LVef MBrinkmann AFeld DSoddemann T(2021)Pure Functions in C: A Small Keyword for Automatic ParallelizationInternational Journal of Parallel Programming10.1007/s10766-020-00660-449:1(1-24)Online publication date: 1-Feb-2021
https://dl.acm.org/doi/10.1007/s10766-020-00660-4
Kim YCheon JHur TByun SWoo G(2020)SSAM: A Haskell Parallel Programming STM Based Simple Actor ModelJournal of Physics: Conference Series10.1088/1742-6596/1566/1/0120401566(012040)Online publication date: 4-Jul-2020
https://doi.org/10.1088/1742-6596/1566/1/012040
Belikov ELoidl HMichaelson G(2019)Colocation of Potential Parallelism in a Distributed Adaptive Run-Time System for Parallel HaskellZivilgesellschaft und Wohlfahrtsstaat im Wandel10.1007/978-3-030-18506-0_1(1-19)Online publication date: 24-Apr-2019
https://doi.org/10.1007/978-3-030-18506-0_1
Han DHe T(2018)A high-performance multicore IO manager based on libuv (experience report)ACM SIGPLAN Notices10.1145/3299711.324275953:7(172-178)Online publication date: 17-Sep-2018
https://dl.acm.org/doi/10.1145/3299711.3242759
Han DHe TWu N(2018)A high-performance multicore IO manager based on libuv (experience report)Proceedings of the 11th ACM SIGPLAN International Symposium on Haskell10.1145/3242744.3242759(172-178)Online publication date: 17-Sep-2018
https://dl.acm.org/doi/10.1145/3242744.3242759
Turilli MSantcroos MJha S(2018)A Comprehensive Perspective on Pilot-Job SystemsACM Computing Surveys10.1145/317785151:2(1-32)Online publication date: 17-Apr-2018
https://dl.acm.org/doi/10.1145/3177851
Liu XKim YCheon JByun SWoo G(2018)Analysis of the parallel programming models in Haskell for many-core systems2018 IEEE International Conference on Applied System Invention (ICASI)10.1109/ICASI.2018.8394394(838-841)Online publication date: Apr-2018
https://doi.org/10.1109/ICASI.2018.8394394
Suss TNagel LVef MBrinkmann AFeld DSoddemann T(2017)Pure Functions in C: A Small Keyword for Automatic Parallelization2017 IEEE International Conference on Cluster Computing (CLUSTER)10.1109/CLUSTER.2017.32(552-556)Online publication date: Sep-2017
https://doi.org/10.1109/CLUSTER.2017.32
Newton RFogg PVaramesh A(2015)Adaptive lock-free maps: purely-functional to scalableACM SIGPLAN Notices10.1145/2858949.278473450:9(218-229)Online publication date: 29-Aug-2015
https://dl.acm.org/doi/10.1145/2858949.2784734
Newton RFogg PVaramesh AFisher KReppy J(2015)Adaptive lock-free maps: purely-functional to scalableProceedings of the 20th ACM SIGPLAN International Conference on Functional Programming10.1145/2784731.2784734(218-229)Online publication date: 29-Aug-2015
https://dl.acm.org/doi/10.1145/2784731.2784734
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents