Hybrid SLM and LLM for Edge-Cloud Collaborative Inference
Abstract
References
Recommendations
Hybrid Cloud: An Inter Cloud Communication Mechanism
CCIOT '18: Proceedings of the 2018 International Conference on Cloud Computing and Internet of ThingsCloud computing has been in existence since the early 2000s and the growth in this domain of Computer Science has been by leaps and bounds. Cloud computing service providers offer 3 different services - Software, Platform and Infrastructure. Hybrid ...
Hybrid Cloud Scheduling Method for Cloud Bursting
AbstractIn the paper, we consider the hybrid cloud model used for cloud bursting, when the computational capacity of the private cloud provider is insufficient to deal with the peak number of customers’ applications, the private cloud will rely on the ...
Enhancing On-Device LLM Inference with Historical Cloud-Based LLM Interactions
KDD '24: Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data MiningMany billion-scale large language models (LLMs) have been released for resource-constraint mobile devices to provide local LLM inference service when cloud-based powerful LLMs are not available. However, the capabilities of current on-device LLMs still ...
Comments
Information & Contributors
Information
Published In
Sponsors
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Check for updates
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 676Total Downloads
- Downloads (Last 12 months)676
- Downloads (Last 6 weeks)398
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in