Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Multithreaded Stochastic PDES for Reactions and Diffusions in Neurons

Published: 07 November 2016 Publication History
  • Get Citation Alerts
  • Abstract

    Cells exhibit stochastic behavior when the number of molecules is small. Hence a stochastic reaction-diffusion simulator capable of working at scale can provide a more accurate view of molecular dynamics within the cell. This article describes a parallel discrete event simulator, Neuron Time Warp-Multi Thread (NTW-MT), developed for the simulation of reaction diffusion models of neurons. To the best of our knowledge, this is the first parallel discrete event simulator oriented toward stochastic simulation of chemical reactions in a neuron. The simulator was developed as part of the NEURON project. NTW-MT is optimistic and thread based, which attempts to capitalize on multicore architectures used in high performance machines. It makes use of a multilevel queue for the pending event set and a single rollback message in place of individual antimessages to disperse contention and decrease the overhead of processing rollbacks. Global Virtual Time is computed asynchronously both within and among processes to get rid of the overhead for synchronizing threads. Memory usage is managed in order to avoid locking and unlocking when allocating and deallocating memory and to maximize cache locality. We verified our simulator on a calcium buffer model. We examined its performance on a calcium wave model, comparing it to the performance of a process based optimistic simulator and a threaded simulator which uses a single priority queue for each thread. Our multithreaded simulator is shown to achieve superior performance to these simulators. Finally, we demonstrated the scalability of our simulator on a larger Calcium-Induced Calcium Release (CICR) model and a more detailed CICR model.

    Supplementary Material

    a7-lin-apndx.pdf (lin.zip)
    Supplemental movie, appendix, image and software files for, Multithreaded Stochastic PDES for Reactions and Diffusions in Neurons

    References

    [1]
    Sadaf R. Alam, Richard F. Barrett, Jeffery A. Kuehn, Philip C. Roth, and Jeffrey S. Vetter. 2006. Characterization of scientific workloads on systems with multi-core processors. In Proceedings of the 2006 IEEE International Symposium on Workload Characterization. IEEE, 225--236.
    [2]
    Steven S. Andrews, Nathan J. Addy, Roger Brent, and Adam P. Arkin. 2010. Detailed simulations of cell biology with Smoldyn 2.1. PLoS Computational Biology 6, 3 (2010), e1000705.
    [3]
    Giorgio A. Ascoli, Duncan E. Donohue, and Maryam Halavi. 2007. NeuroMorpho.Org: A central resource for neuronal morphologies. The Journal of Neuroscience 27, 35 (2007), 9247--9251.
    [4]
    Hervé Avril and Carl Tropper. 1995. Clustered time warp and logic simulation. In Proceedings of the 9th Workshop on Parallel and Distributed Simulation (PADS’95). IEEE, 112--119.
    [5]
    Rajive Bagrodia, Richard Meyer, Mineo Takai, Yu-an Chen, Xiang Zeng, Jay Martin, and Ha Yoon Song. 1998. Parsec: A parallel simulation environment for complex systems. Computer 31, 10 (1998), 77--85.
    [6]
    Thomas M. Bartol Jr., Bruce R. Land, Edwin E. Salpeter, and Miriam M. Salpeter. 1991. Monte Carlo simulation of miniature endplate current generation in the vertebrate neuromuscular junction. Biophysical Journal 59, 6 (1991), 1290.
    [7]
    Michael J. Berridge. 1998. Neuronal calcium signaling. Neuron 21, 1 (1998), 13--26.
    [8]
    Kim T. Blackwell. 2013. Approaches and tools for modeling signaling pathways and calcium dynamics in neurons. Journal of Neuroscience Methods 220, 2 (2013), 131--140.
    [9]
    Michael J. Byrne, M. Neal Waxham, and Yoshihisa Kubota. 2010. Cellular dynamic simulator: An event driven molecular simulation environment for cellular physiology. Neuroinformatics 8, 2 (2010), 63--82.
    [10]
    Nicholas T. Carnevale and Michael L. Hines. 2006. The NEURON Book. Cambridge University Press, New York, NY.
    [11]
    Nicholas T. Carnevale and Michael L. Hines. 2009--2013. NEURON, for empirically-based simulations of neurons and networks of neurons. (2009--2013). http://www.neuron.yale.edu.
    [12]
    Christopher D. Carothers, David Bauer, and Shawn Pearce. 2002. ROSS: A high-performance, low-memory, modular time warp system. Journal of Parallel and Distributed Computing 62, 11 (2002), 1648--1669.
    [13]
    Li-li Chen, Ya-shuai Lu, Yi-ping Yao, Shao-liang Peng, and Ling-da Wu. 2011. A well-balanced time warp system on multi-core environments. In Proceedings of the 2011 IEEE Workshop on Principles of Advanced and Distributed Simulation. IEEE Computer Society, 1--9.
    [14]
    Heping Cheng, W. J. Lederer, and Mark B. Cannell. 1993. Calcium sparks: Elementary events underlying excitation-contraction coupling in heart muscle. Science 262, 5134 (1993), 740--744.
    [15]
    Samir Das, Richard Fujimoto, Kiran Panesar, Don Allison, and Maria Hybinette. 1994. GTW: A time warp system for shared memory multiprocessors. In Simulation Conference Proceedings, 1994. Winter. IEEE, 1332--1339.
    [16]
    Gary W. De Young and Joel Keizer. 1992. A single-pool inositol 1,4,5-trisphosphate-receptor-based model for agonist-stimulated oscillations in Ca2+ concentration. Proceedings of the National Academy of Sciences 89, 20 (1992), 9895--9899.
    [17]
    Lorenzo Dematté and Tommaso Mazza. 2008. On parallel stochastic simulation of diffusive systems. In Computational Methods in Systems Biology, Monika Heiner and Adelinde M. Uhrmacher (Eds.), Lecture Notes in Computer Science, Vol. 5307. Springer, Berlin, 191--210.
    [18]
    Tom Dickman, Sounak Gupta, and Philip A. Wilsey. 2013. Event pool structures for PDES on many-core Beowulf clusters. In Proceedings of the 2013 ACM SIGSIM Conference on Principles of Advanced Discrete Simulation (SIGSIM-PADS’13). ACM, New York, NY, 103--114.
    [19]
    Johan Elf and Mns Ehrenberg. 2004. Spontaneous separation of bi-stable biochemical systems into spatial domains of opposite phases. Systems Biology 1, 2 (2004), 230--236.
    [20]
    J. Kevin Foskett, Carl White, King-Ho Cheung, and Don-On Daniel Mak. 2007. Inositol trisphosphate receptor Ca2+ release channels. Physiological Reviews 87, 2 (2007), 593--658.
    [21]
    Richard M. Fujimoto. 1999. Parallel and Distribution Simulation Systems (1st ed.). John Wiley 8 Sons, Inc., New York, NY.
    [22]
    Richard M. Fujimoto and Maria Hybinette. 1997. Computing global virtual time in shared-memory multiprocessors. ACM Transactions on Modeling and Computer Simulation (TOMACS) 7, 4 (1997), 425--446.
    [23]
    Daniel T. Gillespie. 1977. Exact stochastic simulation of coupled chemical reactions. The Journal of Physical Chemistry 81, 25 (1977), 2340--2361.
    [24]
    Johan Hattne, David Fange, and Johan Elf. 2005. Stochastic reaction-diffusion simulation with MesoRD. Bioinformatics 21, 12 (2005), 2923--2924.
    [25]
    Iain Hepburn, Weiliang Chen, Stefan Wils, and Erik De Schutter. 2012. STEPS: Efficient simulation of stochastic reaction--diffusion models in realistic morphologies. BMC Systems Biology 6, 1 (2012), 36.
    [26]
    Jan Himmelspach and Adelinde M. Uhrmacher. 2007. Plug’n simulate. In Proceedings of the 40th Annual Simulation Symposium (ANSS’07). IEEE Computer Society, 137--143.
    [27]
    Norio Ishizuka, Maxwell W. Cowan, and David G. Amaral. 1995. A quantitative analysis of the dendritic organization of pyramidal cells in the rat hippocampus. Journal of Comparative Neurology 362, 1 (1995), 17--45.
    [28]
    Deepak Jagtap, Nael Abu-Ghazaleh, and Dmitry Ponomarev. 2012. Optimization of parallel discrete event simulator for multi-core systems. In Proceedings of the 26th IEEE International Parallel 8 Distributed Processing Symposium (IPDPS). IEEE, 520--531.
    [29]
    David Randolph Jefferson, Brian Beckman, Frederick P. Wieland, L. Blume, and M. Diloreto. 1987. Time warp operating system. In Proceedings of the 11th ACM Symposium on Operating Systems Principles (SOSP’87). ACM, New York, NY, 77--93.
    [30]
    David Randolph Jefferson. 1985. Virtual time. ACM Transactions on Programming Languages and Systems (TOPLAS) 7, 3 (1985), 404--425.
    [31]
    Matthias Jeschke, Roland Ewald, and Adelinde M. Uhrmacher. 2011. Exploring the performance of spatial stochastic simulation algorithms. Journal of Computational Physics 230, 7 (2011), 2562--2574.
    [32]
    Matthias Jeschke, Alfred Park, Roland Ewald, Richard M. Fujimoto, and Adelinde M. Uhrmacher. 2008. Parallel and distributed spatial simulation of chemical reactions. In Proceedings of the 22nd Workshop on Principles of Advanced and Distributed Simulation (PADS’08). IEEE Computer Society, 51--59.
    [33]
    Yue-Xian Li and John Rinzel. 1994. Equations for InsP 3 receptor-mediated [Ca2+]i oscillations derived from a detailed kinetic model: A Hodgkin-Huxley like formalism. Journal of Theoretical Biology 166, 4 (1994), 461--473.
    [34]
    William W. Lytton. 2002. From Computer to Brain. Springer-Verlag, New York.
    [35]
    Friedemann Mattern. 1993. Efficient algorithms for distributed snapshots and global virtual time approximation. Journal of Parallel and Distributed Computing 18, 4 (1993), 423--434.
    [36]
    Robert A. McDougal, Michael L. Hines, and William W. Lytton. 2013. Reaction-diffusion in the NEURON simulator. Frontiers in Neuroinformatics 7, 28 (2013).
    [37]
    Sina Meraji and Carl Tropper. 2012. Optimizing techniques for parallel digital logic simulation. IEEE Transactions on Parallel and Distributed Systems 23, 6 (2012), 1135--1146.
    [38]
    Ryan James Miller. 2010. Optimistic Parallel Discrete Event Simulation on a Beowulf Cluster of Multi-Core Machines. Ph.D. dissertation. University of Cincinnati.
    [39]
    Samuel A. Neymotin, Robert A. McDougal, Mohamed A. Sherif, Christopher P. Fall, Michael L. Hines, and William W. Lytton. 2015. Neuronal calcium wave propagation varies with changes in endoplasmic reticulum parameters: A computer model. Neural Computation 27, 4 (March 2015), 898--924.
    [40]
    Ian Parker and Isabel Ivorra. 1990. Localized all-or-none calcium liberation by inositol trisphosphate. Science 250, 4983 (1990), 977--979.
    [41]
    Mohammand Nazrul Ishlam Patoary, Carl Tropper, Zhongwei Lin, Robert McDougal, and William W. Lytton. 2014. Neuron time warp. In Proceedings of the 2014 Winter Simulation Conference (WSC’14). IEEE, 3447--3458.
    [42]
    Alessandro Pellegrini and Francesco Quaglia. 2014. Wait-free global virtual time computation in shared memory timewarp systems. In IEEE 26th International Symposium on Computer Architecture and High Performance Computing (SBAC-PAD). IEEE, 9--16.
    [43]
    Kalyan S. Perumalla. 2005. μsik—A micro-kernel for parallel/distributed simulation systems. In Proceedings of the Workshop on Principles of Advanced and Distributed Simulation (PADS’05). IEEE, 59--68.
    [44]
    Hywel Llewelyn Roderick, Michael J. Berridge, and Martin D. Bootman. 2003. Calcium-induced calcium release. Current Biology 13, 11 (2003), R425.
    [45]
    William N. Ross. 2012. Understanding calcium waves and sparks in central neurons. Nature Reviews Neuroscience 13, 3 (March 2012), 157--168.
    [46]
    Behrokh Samadi. 1985. Distributed Simulation, Algorithms and Performance Analysis (Load Balancing, Distributed Processing). Ph.D. dissertation. University of California, Los Angeles. AAI8513157.
    [47]
    Rinaldo B. Schinazi. 1997. Predator-prey and host-parasite spatial stochastic models. The Annals of Applied Probability 7, 1 (1997), 1--9.
    [48]
    David Sterratt, Bruce Graham, Andrew Gillies, and David Willshaw. 2011. Principles of Computational Modelling in Neuroscience. Cambridge University Press, New York.
    [49]
    Roberto Vitali, Alessandro Pellegrini, and Francesco Quaglia. 2012. Towards symmetric multi-threaded optimistic simulation kernels. In Proceedings of the 2012 ACM/IEEE/SCS 26th Workshop on Principles of Advanced and Distributed Simulation (PADS). IEEE, 211--220.
    [50]
    Bing Wang, Bonan Hou, Fei Xing, and Yiping Yao. 2011. Abstract next subvolume method: A logical process-based approach for spatial stochastic simulation of chemical reactions. Computational Biology and Chemistry 35, 3 (2011), 193--198.
    [51]
    Bing Wang, Yiping Yao, Yuliang Zhao, Bonan Hou, and Shaoliang Peng. 2009. Experimental analysis of optimistic synchronization algorithms for parallel simulation of reaction-diffusion systems. In Proceedings of the 2009 International Conference on High Performance Computational Systems Biology. 91--100.
    [52]
    Qing Xu and Carl Tropper. 2005. XTW, a parallel and distributed logic simulator. In Proceedings of the 19th Workshop on Principles of Advanced and Distributed Simulation. IEEE Computer Society, 181--188.
    [53]
    Yingping Yao and Yingxing Zhang. 2008. Solution for analytic simulation based on parallel processing. Journal of System Simulation 20, 24 (2008), 6617--6621.

    Cited By

    View all
    • (2023)Towards Order-Preserving and Zero-Copy Communication on Shared Memory for Large Scale SimulationChinese Journal of Electronics10.23919/cje.2021.00.39332:5(1066-1076)Online publication date: Sep-2023
    • (2023)Simulation of processes and structures in the synapse in the context of tetrahedral mesh qualityComputers & Mathematics with Applications10.1016/j.camwa.2023.06.005145(58-64)Online publication date: Sep-2023
    • (2022)Efficient Simulation of 3D Reaction-Diffusion in Models of Neurons and NetworksFrontiers in Neuroinformatics10.3389/fninf.2022.84710816Online publication date: 17-May-2022
    • Show More Cited By

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Transactions on Modeling and Computer Simulation
    ACM Transactions on Modeling and Computer Simulation  Volume 27, Issue 2
    Special Issue on PADS 2015
    April 2017
    203 pages
    ISSN:1049-3301
    EISSN:1558-1195
    DOI:10.1145/3015562
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 07 November 2016
    Accepted: 01 August 2016
    Revised: 01 May 2016
    Received: 01 September 2015
    Published in TOMACS Volume 27, Issue 2

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. PDES
    2. Stochastic neuronal simulation
    3. multiple thread

    Qualifiers

    • Research-article
    • Research
    • Refereed

    Funding Sources

    • Research Fund for the Doctoral Program of High Education of China
    • China Scholarship Council
    • National Natural Science Foundation of China
    • Research Project of State Key Laboratory of High Performance Computing of National University of Defense Technology
    • National Institutes of Health

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)21
    • Downloads (Last 6 weeks)0

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)Towards Order-Preserving and Zero-Copy Communication on Shared Memory for Large Scale SimulationChinese Journal of Electronics10.23919/cje.2021.00.39332:5(1066-1076)Online publication date: Sep-2023
    • (2023)Simulation of processes and structures in the synapse in the context of tetrahedral mesh qualityComputers & Mathematics with Applications10.1016/j.camwa.2023.06.005145(58-64)Online publication date: Sep-2023
    • (2022)Efficient Simulation of 3D Reaction-Diffusion in Models of Neurons and NetworksFrontiers in Neuroinformatics10.3389/fninf.2022.84710816Online publication date: 17-May-2022
    • (2019)Exposing Inter-process Information for Efficient PDES of Spatial Stochastic Systems on MulticoresACM Transactions on Modeling and Computer Simulation10.1145/330150029:2(1-25)Online publication date: 2-Apr-2019
    • (2019)DISHM: A Zero-Copy Intra-Node Communication Approach in Large Scale Simulation2019 IEEE 19th International Conference on Communication Technology (ICCT)10.1109/ICCT46805.2019.8947207(578-582)Online publication date: Oct-2019
    • (2018)Using NEURON for Reaction-Diffusion Modeling of Extracellular DynamicsFrontiers in Neuroinformatics10.3389/fninf.2018.0004112Online publication date: 10-Jul-2018
    • (2017)A work-stealing based dynamic load balancing algorithm for conservative parallel discrete event simulationProceedings of the 2017 Winter Simulation Conference10.5555/3242181.3242242(1-12)Online publication date: 3-Dec-2017
    • (2017)Guest Editorial for the TOMACS Special Issue on the Principles of Advanced Discrete Simulation (PADS)ACM Transactions on Modeling and Computer Simulation10.1145/308454327:2(1-3)Online publication date: 6-Jul-2017
    • (2017)A work-stealing based dynamic load balancing algorithm for conservative parallel discrete event simulation2017 Winter Simulation Conference (WSC)10.1109/WSC.2017.8247833(798-809)Online publication date: Dec-2017

    View Options

    Get Access

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media