research-article

Public Access

Debugging distributed systems

Authors:

Ivan Beschastnikh,

Patty Wang,

Yuriy Brun,

Michael D. ErnstAuthors Info & Claims

Communications of the ACM, Volume 59, Issue 8

Pages 32 - 37

https://doi.org/10.1145/2909480

Published: 22 July 2016 Publication History

All formats PDF

Abstract

ShiViz is a new distributed system debugging visualization tool.

References

[1]

Bernstein, P., Hadzilacos, V., Goodman, N. Distributed recovery. Concurrency Control and Recovery in Database Systems, Chapter 7. Addison-Wesley, 1986; http://research.microsoft.com/en-us/people/philbe/chapter7.pdf.

Google Scholar

[2]

Corbett, J. C. et al. Spanner: Google's globally distributed database. In Proceedings of the 10^th Usenix Symposium on Operating Systems Design and Implementation, 2012; https://www.usenix.org/conference/osdi12/technical-sessions/presentation/corbett.

Digital Library

Google Scholar

[3]

Garduno, E., Kavulya, S. P., Tan, J., Gandhi, R., Narasimhan, P. Theia: Visual signatures for problem diagnosis in large Hadoop clusters. In Proceedings of the 26^th International Conference on Large Installation System Administration, 2012, 33--42; https://users.ece.cmu.edu/~spertet/papers/hadoopvis-lisa12-cameraready-v3.pdf.

Digital Library

Google Scholar

[4]

Geels, D., Altekar, G., Maniatis, P., Roscoe, T., Stoica, I. Friday: Global comprehension for distributed replay. In Proceedings of the 4^th Usenix Conference on Networked Systems Design and Implementation, (2007); https://www.usenix.org/legacy/event/nsdi07/tech/full_papers/geels/geels.pdf.

Digital Library

Google Scholar

[5]

Hawblitzel, C., Howell, J., Kapritsos, M., Lorch, J. R., Parno, B., Roberts, M. L., Setty, S., Zill, B. IronFleet: Proving practical distributed systems correct. In Proceedings of the 25^th Symposium on Operating Systems Principles; 2015; http://sigops.org/sosp/sosp15/current/2015-Monterey/250-hawblitzel-online.pdf.

Digital Library

Google Scholar

[6]

Isaacs, K.E. et al. Combing the communication hairball: Visualizing parallel execution traces using logical time. IEEE Transactions on Visualization and Computer Graphics 20, 12 (Dec 2014), 2349--2358.

Google Scholar

[7]

Killian, C., Anderson, J. W., Jhala, R., Vahdat, A. Life, death, and the critical transition: Finding liveness bugs in systems code. In Proceedings of the 4^th Usenix Conference on Networked Systems Design and Implementation, (2007); https://www.usenix.org/legacy/event/nsdi07/tech/killian/killian.pdf.

Digital Library

Google Scholar

[8]

Liu, X., Guo, Z., Wang, X., Chen, F., Lian, X., Tang, J., Wu, M., Kaashoek, M. F., Zhang, Z. D3S: Debugging deployed distributed systems. In Proceedings of the 5^th Usenix Symposium on Networked Systems Design and Implementation, 2008; 423--437; http://static.usenix.org/event/nsdi08/tech/full_papers/liu_xuezheng/liu_xuezheng.pdf.

Digital Library

Google Scholar

[9]

Mace, J., Roelke, R., Fonseca, R. Pivot tracing: Dynamic causal monitoring for distributed systems. In Proceedings of the 25^th Symposium on Operating Systems Principles, (2015); 378--393; http://sigops.org/sosp/sosp15/current/2015-Monterey/122-mace-online.pdf.

Digital Library

Google Scholar

[10]

Mattern, F. Virtual time and global states of distributed systems. In Proceedings of the International Workshop on Parallel and Distributed Algorithms, 1989; http://homes.cs.washington.edu/~arvind/cs425/doc/mattern89virtual.pdf

Google Scholar

[11]

Newcombe, C., Rath, T., Zhang, F., Munteanu, B., Brooker, M., Deardeuff, M. How Amazon Web Services uses formal methods. Commun. ACM 58, 4 (2015), 66--73; http://cacm.acm.org/magazines/2015/4/184701-how-amazon-web-services-uses-formal-methods/fulltext.

Digital Library

Google Scholar

[12]

Project Voldemort; http://www.project-voldemort.com/voldemort/.

Google Scholar

[13]

Sambasivan, R.R., Fonseca, R., Shafer, I., Ganger, G. So, you want to trace your distributed system? Key design insights from years of practical experience. Parallel Data Laboratory, Carnegie Mellon University, 2014; http://www.pdl.cmu.edu/PDL-FTP/SelfStar/CMU-PDL-14-102.pdf.

Google Scholar

[14]

Scott, C. et al. Minimize faulty executions of distributed systems. In Proceedings of the 13^th Usenix Symposium on Networked Design and Implementation (Santa Clara, CA, Mar. 16--18, 2016) 291--309.

Digital Library

Google Scholar

[15]

Sigelman, B. H., Barroso, L. A., Burrows, M., Stephenson, P., Plakal, M., Beaver, D., Jaspan, S., Shanbhag, C. Dapper, a large-scale distributed systems tracing infrastructure. Research at Google, 2010; http://research.google.com/pubs/pub36356.html.

Google Scholar

[16]

Wilcox, J. R., Woos, D., Panchekha, P., Tatlock, Z., Wang, X., Ernst, M. D., Anderson, T. Verdi: A framework for implementing and formally verifying distributed systems. In Proceedings of the 36^th SIGPLAN Conference on Programming Language Design and Implementation, 2015, 357--368; https://homes.cs.washington.edu/~ztatlock/pubs/verdi-wilcox-pldi15.pdf.

Digital Library

Google Scholar

[17]

Xu, W., Huang, L., Fox, A., Patterson, D., Jordan, M. Experience mining Google's production console logs. In Proceedings of the Workshop on Managing Systems via Log Analysis and Machine Learning Techniques, 2010; http://iiis.tsinghua.edu.cn/~weixu/files/slaml10.pdf.

Digital Library

Google Scholar

[18]

Yang, J., et al. MoDist: Transparent model checking of unmodified distributed systems. In Proceedings of the 6^th Usenix Symposium on Networked Systems Design and Implementation, 2009, 213--228; https://www.usenix.org/legacy/event/nsdi09/tech/full_papers/yang/yang_html/.

Digital Library

Google Scholar

Cited By

View all

Ashok SHarsh VGodfrey BMittal RParthasarathy SShwartz LSekar VYu MSeneviratne AVeitch D(2024)TraceWeaver: Distributed Request Tracing for Microservices Without Application ModificationProceedings of the ACM SIGCOMM 2024 Conference10.1145/3651890.3672254(828-842)Online publication date: 4-Aug-2024
https://dl.acm.org/doi/10.1145/3651890.3672254
Huang HZhang XChen PHe ZChen ZYu GChen HSun C(2024)TraStrainer: Adaptive Sampling for Distributed Traces with System Runtime StateProceedings of the ACM on Software Engineering10.1145/36437481:FSE(473-493)Online publication date: 12-Jul-2024
https://dl.acm.org/doi/10.1145/3643748
Lagwankar IKulkarni S(2024)Replay ClocksProceedings of the 25th International Conference on Distributed Computing and Networking10.1145/3631461.3631547(114-123)Online publication date: 4-Jan-2024
https://dl.acm.org/doi/10.1145/3631461.3631547
Show More Cited By

Index Terms

Debugging distributed systems
1. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis
        Software testing and debugging

Recommendations

Live Debugging of Distributed Systems
CC '09: Proceedings of the 18th International Conference on Compiler Construction: Held as Part of the Joint European Conferences on Theory and Practice of Software, ETAPS 2009

Debugging distributed systems is challenging. Although incremental debugging during development finds some bugs, developers are rarely able to fully test their systems under realistic operating conditions prior to deployment. While deploying a system ...
Replay debugging: leveraging record and replay for program debugging
ISCA '14: Proceeding of the 41st annual international symposium on Computer architecuture

Hardware-assisted Record and Deterministic Replay (RnR) of programs has been proposed as a primitive for debugging hard-to-repeat software bugs. However, simply providing support for repeatedly stumbling on the same bug does not help diagnose it. For ...
A Framework for Distributed Debugging

The authors provide a general picture of current research in distributed debugging. Rather than an exhaustive survey of the area, they present a view of the issues and solutions based on a proposed framework for distributed debugging systems. They ...

Comments

Information & Contributors

Information

Published In

Communications of the ACM Volume 59, Issue 8

August 2016

94 pages

ISSN:0001-0782

EISSN:1557-7317

DOI:10.1145/2975594

Editor:
Moshe Y. Vardi
Association for Computing Machinery, New York, NY

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 July 2016

Published in CACM Volume 59, Issue 8

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article
Popular
Refereed

Funding Sources

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

56
Total Citations
View Citations
18,337
Total Downloads

Downloads (Last 12 months)546
Downloads (Last 6 weeks)58

Reflects downloads up to 20 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Ashok SHarsh VGodfrey BMittal RParthasarathy SShwartz LSekar VYu MSeneviratne AVeitch D(2024)TraceWeaver: Distributed Request Tracing for Microservices Without Application ModificationProceedings of the ACM SIGCOMM 2024 Conference10.1145/3651890.3672254(828-842)Online publication date: 4-Aug-2024
https://dl.acm.org/doi/10.1145/3651890.3672254
Huang HZhang XChen PHe ZChen ZYu GChen HSun C(2024)TraStrainer: Adaptive Sampling for Distributed Traces with System Runtime StateProceedings of the ACM on Software Engineering10.1145/36437481:FSE(473-493)Online publication date: 12-Jul-2024
https://dl.acm.org/doi/10.1145/3643748
Lagwankar IKulkarni S(2024)Replay ClocksProceedings of the 25th International Conference on Distributed Computing and Networking10.1145/3631461.3631547(114-123)Online publication date: 4-Jan-2024
https://dl.acm.org/doi/10.1145/3631461.3631547
Yao ZYe HPei CCheng GWang GLiu ZChen HCui HLi ZLi JXie GPei D(2024)SparseRCA: Unsupervised Root Cause Analysis in Sparse Microservice Testing Traces2024 IEEE 35th International Symposium on Software Reliability Engineering (ISSRE)10.1109/ISSRE62328.2024.00045(391-402)Online publication date: 28-Oct-2024
https://doi.org/10.1109/ISSRE62328.2024.00045
Khudyakov DYakhyaeva G(2024)Unsupervised Anomaly Detection on Distributed Log Tracing through Deep Learning2024 IEEE 25th International Conference of Young Professionals in Electron Devices and Materials (EDM)10.1109/EDM61683.2024.10615125(1830-1833)Online publication date: 28-Jun-2024
https://doi.org/10.1109/EDM61683.2024.10615125
Dobrowolski WLibura MNikodem MUnold O(2024)Unsupervised Log Sequence SegmentationIEEE Access10.1109/ACCESS.2024.340942512(79003-79013)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3409425
Khudyakov D(2023)Development of Anomaly Detection System Based on Distributed Log TracingVestnik NSU. Series: Information Technologies10.25205/1818-7900-2023-21-1-62-7221:1(62-72)Online publication date: 28-Aug-2023
https://doi.org/10.25205/1818-7900-2023-21-1-62-72
Wang TZhi CZhou XWu JYin JDeng SJust RFraser G(2023)Data Constraint Mining for Automatic Reconciliation Scripts GenerationProceedings of the 32nd ACM SIGSOFT International Symposium on Software Testing and Analysis10.1145/3597926.3598122(1119-1130)Online publication date: 12-Jul-2023
https://dl.acm.org/doi/10.1145/3597926.3598122
Brun YLin TSomerville JMyers EEbner N(2023)Blindspots in Python and Java APIs Result in Vulnerable CodeACM Transactions on Software Engineering and Methodology10.1145/357185032:3(1-31)Online publication date: 26-Apr-2023
https://dl.acm.org/doi/10.1145/3571850
Tsutsumi SHigashinc MTakahashi KKawamura T(2023)Development of a Visualization for Developers of a Distributed System Including Idle Computers2023 IEEE International Conference on High Performance Computing & Communications, Data Science & Systems, Smart City & Dependability in Sensor, Cloud & Big Data Systems & Application (HPCC/DSS/SmartCity/DependSys)10.1109/HPCC-DSS-SmartCity-DependSys60770.2023.00132(912-919)Online publication date: 17-Dec-2023
https://doi.org/10.1109/HPCC-DSS-SmartCity-DependSys60770.2023.00132
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Digital Edition

View this article in digital edition.

Digital Edition

Magazine Site

View this article on the magazine site (external)

Magazine Site

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

References

Cited By

Index Terms

Recommendations

Live Debugging of Distributed Systems

Replay debugging: leveraging record and replay for program debugging

A Framework for Distributed Debugging

Comments

Information

Published In

Publisher

Publication History

Permissions

Check for updates

Qualifiers

Funding Sources

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

PDF

eReader

Digital Edition

Magazine Site

Login options

Full Access

Share

Share this Publication link

Share on social media

Affiliations