Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3484266.3487389acmconferencesArticle/Chapter ViewAbstractPublication PagescommConference Proceedingsconference-collections
research-article
Open access

Don't Let RPCs Constrain Your API

Published: 04 November 2021 Publication History

Abstract

As data becomes increasingly distributed, traditional RPC and data serialization limits performance, result in rigidity, and hamper expressivity. We believe that technology trends including high-density persistent memory, high-speed networks, and programmable switches make this the right time to revisit prior research on distributed shared memory, global addressing, and content-based networking. Our vision combines the code mobility of RPC with first-class data references in a global address space by co-designing the OS and the network around pervasive data identity. We have initial results showing the promise of the proposed co-design.

References

[1]
SiFive TileLink Specification 1.7.1. https://www.sifive.com/documentation, 2018.
[2]
B. Ahlgren, C. Dannewitz, C. Imbrenda, D. Kutscher, and B. Ohlman. A survey of information-centric networking. IEEE Communications Magazine, 50(7):26--36, 2012.
[3]
D. Bittman, P. Alvaro, D. D. E. Long, and E. L. Miller. A tale of two abstractions: The case for object space. In Proceedings of HotStorage '19, July 2019.
[4]
D. Bittman, P. Alvaro, P. Mehra, D. D. E. Long, and E. L. Miller. Twizzler: a data-centric OS for non-volatile memory. In 2020 USENIX Annual Technical Conference (USENIX ATC 20), pages 65--80. USENIX Association, July 2020.
[5]
P. Bosshart, D. Daly, G. Gibb, M. Izzard, N. McKeown, J. Rexford, C. Schlesinger, D. Talayco, A. Vahdat, G. Varghese, and D. Walker. P4: Programming protocol-independent packet processors. SIGCOMM Comput. Commun. Rev., 44(3):87--95, July 2014.
[6]
A. Carzaniga and A. L. Wolf. Forwarding in a content-based network. In Proceedings of the 2003 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications, SIGCOMM '03, page 163-174, New York, NY, USA, 2003. Association for Computing Machinery.
[7]
J. S. Chase, H. M. Levy, M. J. Feeley, and E. D. Lazowska. Sharing and protection in a single-address-space operating system. ACM Transactions on Computer Systems, 12(4):271--307, Nov. 1994.
[8]
A. Dakkak, C. Li, S. G. De Gonzalo, J. Xiong, and W.-m. Hwu. Trims: Transparent and isolated model sharing for low latency deep learning inference in function-as-a-service. IEEE CLOUD'19.
[9]
D. E. Eisenbud, C. Yi, C. Contavalli, C. Smith, R. Kononov, E. Mann-Hielscher, A. Cilingiroglu, B. Cheyney, W. Shang, and J. D. Hosein. Maglev: A fast and reliable software network load balancer. In 13th USENIX Symposium on Networked Systems Design and Implementation (NSDI), Mar. 2016.
[10]
G. Heiser, K. Elphinstone, S. Russell, and J. Vochteloo. Mungi: a distributed single address-space operating system. Technical Report 9314, School of Computer Science and Engineering, University of New South Wales, Nov. 1993.
[11]
J. L. Hennessy and D. A. Patterson. Computer Architecture: A Quantitative Approach. Morgan Kaufmann, Amsterdam, 5 edition, 2012.
[12]
IBM MQ. https://www-03.ibm.com/software/products/en/ibm-mq, 2019.
[13]
Intel NVMe with 3D XPoint Technology chart. https://www.tomshardware.com/reviews/intel-micron-3d-xpoint-updates,4286.html#p1, 2015.
[14]
Intel Skylake. https://www.7-cpu.com/cpu/Skylake.html, 2019.
[15]
Intel Xeon Processor E7-8893 v3. https://ark.intel.com/content/www/us/en/ark/products/84688/intel-xeon-processor-e7-8893-v3-45m-cache-3-20-ghz.html, 2019.
[16]
T. Jepsen, L. P. de Sousa, M. Moshref, F. Pedone, and R. Soulé. Infinite Resources for Optimistic Concurrency Control. In NetCompute, Aug. 2018.
[17]
T. Jepsen, M. Moshref, A. Carzaniga, N. Foster, and R. Soulé. Forwarding and routing with packet subscriptions. In Proceedings of the 16th International Conference on Emerging Networking EXperiments and Technologies (CoNEXT), 2020.
[18]
X. Jin, X. Li, H. Zhang, N. Foster, J. Lee, R. Soulé, C. Kim, and I. Stoica. NetChain: Scale-Free Sub-RTT Coordination. In 15th USENIX Symposium on Networked Systems Design and Implementation (NSDI), pages 35--49, Apr. 2018.
[19]
P. Kairouz, H. B. McMahan, B. Avent, A. Bellet, M. Bennis, A. N. Bhagoji, K. Bonawitz, Z. Charles, G. Cormode, R. Cummings, R. G. L. D'Oliveira, S. E. Rouayheb, D. Evans, J. Gardner, Z. Garrett, A. Gascón, B. Ghazi, P. B. Gibbons, M. Gruteser, Z. Harchaoui, C. He, L. He, Z. Huo, B. Hutchinson, J. Hsu, M. Jaggi, T. Javidi, G. Joshi, M. Khodak, J. Konečný, A. Korolova, F. Koushanfar, S. Koyejo, T. Lepoint, Y. Liu, P. Mittal, M. Mohri, R. Nock, A. Özgür, R. Pagh, M. Raykova, H. Qi, D. Ramage, R. Raskar, D. Song, W. Song, S. U. Stich, Z. Sun, A. T. Suresh, F. Tramèr, P. Vepakomma, J. Wang, L. Xiong, Z. Xu, Q. Yang, F. X. Yu, H. Yu, and S. Zhao. Advances and open problems in federated learning. CoRR, abs/1912.04977, 2019.
[20]
J. Kreps, N. Narkhede, and J. Rao. Kafka: A distributed messaging system for log processing. In Proceedings of The 6th International Workshop on Networking Meets Databases (NetDB'11), June 2011.
[21]
J. Kuskin, D. Ofelt, M. Heinrich, J. Heinlein, R. Simoni, K. Gharachorloo, J. Chapin, D. Nakahira, J. Baxter, M. Horowitz, and et al. The stanford flash multiprocessor. In Proceedings of the 21st Annual International Symposium on Computer Architecture, ISCA '94, pages 302--313, 1994.
[22]
B. Lantz, B. Heller, and N. McKeown. A network in a laptop: Rapid prototyping for software-defined networks. In Proceedings of the 9th ACM SIGCOMM Workshop on Hot Topics in Networks, New York, NY, USA, 2010. Association for Computing Machinery.
[23]
J. Ousterhout, A. Gopalan, A. Gupta, A. Kejriwal, C. Lee, B. Montazeri, D. Ongaro, S. J. Park, H. Qin, M. Rosenblum, S. Rumble, R. Stutsman, and S. Yang. The ramcloud storage system. ACM Trans. Comput. Syst., 33(3):7:1--7:55, Aug. 2015.
[24]
D. L. Parnas. On the criteria to be used in decomposing systems into modules. Communications of the ACM, 15(12):1053--1058, 1972.
[25]
Sgiuv3000, uv30. https://www.risc.jku.at/projects/mach2/4555.pdf, 2016.
[26]
Sgiuv3000 sets new throughput records. https://www.hpcwire.com/2016/03/25/sgi-posts-new-spec-cpu2006-results/, 2016.
[27]
M. Shapiro, N. Preguiça, C. Baquero, and M. Zawirski. A comprehensive study of convergent and commutative replicated data types. 2011.
[28]
N. Shirokov and R. Dasineni. Open-sourcing Katran, a scalable network load balancer --- Facebook Engineering. https://code.fb.com/open-source/open-sourcing-katran-a-scalable-network-load-balancer/, May 2018.
[29]
M. Shoeybi. Training Multi-billion parameter models in Megatron. https://hotchips.org/archives/hc32/, 2020.
[30]
A. Singh, P. Vepakomma, O. Gupta, and R. Raskar. Detailed comparison of communication efficiency of split learning and federated learning. arXiv preprint arXiv:1909.09145, 2019.
[31]
Tibco rendezvous. https://www.tibco.com/products/tibco-rendezvous, 2019.
[32]
J. Waldo, G. Wyant, A. Wollrath, and S. Kendall. A Note on Distributed Computing. Sun Microsystems Laboratories, 1994.
[33]
S. Wang, B. Hindman, and I. Stoica. In Reference to RPC: It's Time to Add Distributed Memory. HotOS '21.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
HotNets '21: Proceedings of the 20th ACM Workshop on Hot Topics in Networks
November 2021
246 pages
ISBN:9781450390873
DOI:10.1145/3484266
This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 November 2021

Check for updates

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

Conference

HotNets '21
Sponsor:
HotNets '21: The 20th ACM Workshop on Hot Topics in Networks
November 10 - 12, 2021
Virtual Event, United Kingdom

Acceptance Rates

Overall Acceptance Rate 110 of 460 submissions, 24%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)157
  • Downloads (Last 6 weeks)29
Reflects downloads up to 12 Nov 2024

Other Metrics

Citations

Cited By

View all

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media