Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article
Open access

Smoothed Online Optimization with Unreliable Predictions

Published: 02 March 2023 Publication History

Abstract

We examine the problem of smoothed online optimization, where a decision maker must sequentially choose points in a normed vector space to minimize the sum of per-round, non-convex hitting costs and the costs of switching decisions between rounds. The decision maker has access to a black-box oracle, such as a machine learning model, that provides untrusted and potentially inaccurate predictions of the optimal decision in each round. The goal of the decision maker is to exploit the predictions if they are accurate, while guaranteeing performance that is not much worse than the hindsight optimal sequence of decisions, even when predictions are inaccurate. We impose the standard assumption that hitting costs are globally α-polyhedral. We propose a novel algorithm, Adaptive Online Switching (AOS), and prove that, for a large set of feasible δ > 0, it is (1+δ)-competitive if predictions are perfect, while also maintaining a uniformly bounded competitive ratio of 2~O (1/(α δ)) even when predictions are adversarial. Further, we prove that this trade-off is necessary and nearly optimal in the sense that any deterministic algorithm which is (1+δ)-competitive if predictions are perfect must be at least 2~Ω (1/(α δ)) -competitive when predictions are inaccurate. In fact, we observe a unique threshold-type behavior in this trade-off: if δ is not in the set of feasible options, then no algorithm is simultaneously (1 + δ)-competitive if predictions are perfect and ζ-competitive when predictions are inaccurate for any ζ < ∞. Furthermore, we discuss that memory is crucial in AOS by proving that any algorithm that does not use memory cannot benefit from predictions. We complement our theoretical results by a numerical study on a microgrid application.

References

[1]
Moloud Abdar, Farhad Pourpanah, Sadiq Hussain, Dana Rezazadegan, Li Liu, Mohammad Ghavamzadeh, Paul Fieguth, Xiaochun Cao, Abbas Khosravi, U Rajendra Acharya, et al. 2021. A review of uncertainty quantification in deep learning: Techniques, applications and challenges. Information Fusion, Vol. 76 (2021), 243--297.
[2]
Susanne Albers and Jens Quedenfeld. 2018. Optimal Algorithms for Right -Sizing Data Centers. In Proceedings of the 30th on Symposium on Parallelism in Algorithms and Architectures (SPAA '18). Association for Computing Machinery, New York, NY, USA, 363--372. https://doi.org/10.1145/3210377.3210385
[3]
Susanne Albers and Jens Quedenfeld. 2021. Algorithms for Right -Sizing Heterogeneous Data Centers. In Proceedings of the 33rd ACM Symposium on Parallelism in Algorithms and Architectures (SPAA '21). Association for Computing Machinery, New York, NY, USA, 48--58. https://doi.org/10.1145/3409964.3461789
[4]
Jason Altschuler and Kunal Talwar. 2018. Online Learning over a Finite Action Set with Limited Switching. In Proceedings of the 31st Conference On Learning Theory. PMLR, 1569--1573.
[5]
Keerti Anand, Rong Ge, Amit Kumar, and Debmalya Panigrahi. 2021. A regression approach to learning-augmented online algorithms. Advances in Neural Information Processing Systems, Vol. 34 (2021), 30504--30517.
[6]
Keerti Anand, Rong Ge, and Debmalya Panigrahi. 2020. Customizing ML Predictions for Online Algorithms. In Proceedings of the 37th International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 119), Hal Daumé III and Aarti Singh (Eds.). PMLR, 303--313. https://proceedings.mlr.press/v119/anand20a.html
[7]
Lachlan Andrew, Siddharth Barman, Katrina Ligett, Minghong Lin, Adam Meyerson, Alan Roytman, and Adam Wierman. 2013. A tale of two metrics: Simultaneous bounds on competitiveness and regret. In Conference on Learning Theory. PMLR, 741--763.
[8]
Antonios Antoniadis, Christian Coester, Marek Elias, Adam Polak, and Bertrand Simon. 2020a. Online metric algorithms with untrusted predictions. In International Conference on Machine Learning. PMLR, 345--355.
[9]
Antonios Antoniadis, Themis Gouleakis, Pieter Kleer, and Pavel Kolev. 2020b. Secretary and Online Matching Problems with Machine Learned Advice. In Advances in Neural Information Processing Systems, H Larochelle, M Ranzato, R Hadsell, M F Balcan, and H Lin (Eds.), Vol. 33. Curran Associates, Inc., 7933--7944. https://proceedings.neurips.cc/paper/2020/file/5a378f8490c8d6af8647a753812f6e31-Paper.pdf
[10]
Antonios Antoniadis and Kevin Schewior. 2017. A tight lower bound for online convex optimization with switching costs. In International Workshop on Approximation and Online Algorithms. Springer, 164--175.
[11]
C. J. Argue, Anupam Gupta, Ziye Tang, and Guru Guruganesh. 2021. Chasing Convex Bodies with Linear Competitive Ratio. J. ACM, Vol. 68, 5 (2021), 1--10. https://doi.org/10.1145/3450349
[12]
Yossi Azar, Stefano Leonardi, and Noam Touitou. 2021. Flow Time Scheduling with Uncertain Processing Time. In Proceedings of the 53rd Annual ACM SIGACT Symposium on Theory of Computing (STOC 2021). Association for Computing Machinery, New York, NY, USA, 1070--1080. https://doi.org/10.1145/3406325.3451023
[13]
Etienne Bamas, Andreas Maggiori, Lars Rohwedder, and Ola Svensson. 2020b. Learning Augmented Energy Minimization via Speed Scaling. In Advances in Neural Information Processing Systems, H Larochelle, M Ranzato, R Hadsell, M F Balcan, and H Lin (Eds.), Vol. 33. Curran Associates, Inc., 15350--15359. https://proceedings.neurips.cc/paper/2020/file/af94ed0d6f5acc95f97170e3685f16c0-Paper.pdf
[14]
Etienne Bamas, Andreas Maggiori, and Ola Svensson. 2020a. The Primal-Dual method for Learning Augmented Algorithms. In Advances in Neural Information Processing Systems, H Larochelle, M Ranzato, R Hadsell, M F Balcan, and H Lin (Eds.), Vol. 33. Curran Associates, Inc., 20083--20094. https://proceedings.neurips.cc/paper/2020/file/e834cb114d33f729dbc9c7fb0c6bb607-Paper.pdf
[15]
Nikhil Bansal, Avrim Blum, Shuchi Chawla, and Adam Meyerson. 2003. Online oblivious routing. In Proceedings of the fifteenth annual ACM symposium on Parallel algorithms and architectures. 44--49.
[16]
Nikhil Bansal, Anupam Gupta, Ravishankar Krishnaswamy, Kirk Pruhs, Kevin Schewior, and Cliff Stein. 2015. A 2-competitive algorithm for online convex optimization with switching costs. In Approximation, Randomization, and Combinatorial Optimization. Algorithms and Techniques (APPROX/RANDOM 2015). Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik.
[17]
Avrim Blum and Carl Burch. 2000. On-line learning and the metrical task system problem. Machine Learning, Vol. 39, 1 (2000), 35--58.
[18]
Allan Borodin, Nathan Linial, and Michael E. Saks. 1992. An Optimal On-Line Algorithm for Metrical Task System. J. ACM, Vol. 39, 4 (Oct. 1992), 745--763. https://doi.org/10.1145/146585.146588
[19]
Niangjun Chen, Anish Agarwal, Adam Wierman, Siddharth Barman, and Lachlan LH Andrew. 2015. Online convex optimization using predictions. In Proceedings of the 2015 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems. 191--204.
[20]
Niangjun Chen, Joshua Comden, Zhenhua Liu, Anshul Gandhi, and Adam Wierman. 2016. Using predictions in online optimization: Looking forward with an eye on the past. ACM SIGMETRICS Performance Evaluation Review, Vol. 44, 1 (2016), 193--206.
[21]
Niangjun Chen, Gautam Goel, and Adam Wierman. 2018. Smoothed online convex optimization in high dimensions via online balanced descent. In Conference On Learning Theory. PMLR, 1574--1594.
[22]
Nicolas Christianson, Tinashe Handina, and Adam Wierman. 2022, forthcoming. Chasing Convex Bodies and Functions with Black-Box Advice. In Conference on Learning Theory.
[23]
Joshua Comden, Sijie Yao, Niangjun Chen, Haipeng Xing, and Zhenhua Liu. 2019. Online optimization in cloud resource provisioning: Predictions, regrets, and algorithms. Proceedings of the ACM on Measurement and Analysis of Computing Systems, Vol. 3, 1 (2019), 1--30.
[24]
Thomas M Cover. 1991. Universal Portfolios. Mathematical Finance, Vol. 1, 1 (1991), 1--29.
[25]
Paul Dü tting, Silvio Lattanzi, Renato Paes Leme, and Sergei Vassilvitskii. 2021. Secretaries with Advice. In Proceedings of the 22nd ACM Conference on Economics and Computation. Association for Computing Machinery, New York, NY, USA, 409--429. https://doi.org/10.1145/3465456.3467623
[26]
Richard Evans and Jim Gao. 2016. DeepMind AI Reduces Google Data Centre Cooling Bill by 40%. https://deepmind.com/blog/article/deepmind-ai-reduces-google-data-centre-cooling-bill-40
[27]
Amos Fiat, Yuval Rabani, and Yiftach Ravid. 1994. Competitive k-server algorithms. J. Comput. System Sci., Vol. 48, 3 (1994), 410--428.
[28]
Gautam Goel, Niangjun Chen, and Adam Wierman. 2017. Thinking fast and slow: Optimization decomposition across timescales. In 2017 IEEE 56th Annual Conference on Decision and Control (CDC). IEEE, 1291--1298.
[29]
Gautam Goel, Yiheng Lin, Haoyuan Sun, and Adam Wierman. 2019. Beyond online balanced descent: An optimal algorithm for smoothed online optimization. Advances in Neural Information Processing Systems, Vol. 32 (2019), 1875--1885.
[30]
Gautam Goel and Adam Wierman. 2019. An online algorithm for smoothed regression and lqr control. In The 22nd International Conference on Artificial Intelligence and Statistics. PMLR, 2504--2513.
[31]
Sreenivas Gollapudi and Debmalya Panigrahi. 2019. Online algorithms for rent-or-buy with expert advice. In Proceedings of the 36th International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 97), Kamalika Chaudhuri and Ruslan Salakhutdinov (Eds.). PMLR, 2319--2327. https://proceedings.mlr.press/v97/gollapudi19a.html
[32]
Chen-Yu Hsu, Piotr Indyk, Dina Katabi, and Ali Vakilian. 2019. Learning-Based Frequency Estimation Algorithms. In International Conference on Learning Representations.
[33]
Zhihao Jiang, Pinyan Lu, Zhihao Gavin Tang, and Yuhao Zhang. 2021. Online Selection Problems against Constrained Adversary. In Proceedings of the 38th International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 139), Marina Meila and Tong Zhang (Eds.). PMLR, 5002--5012. https://proceedings.mlr.press/v139/jiang21h.html
[34]
Vinay Joseph and Gustavo de Veciana. 2012. Jointly optimizing multi-user rate adaptation for video transport over wireless systems: Mean-fairness-variability tradeoffs. In 2012 Proceedings IEEE INFOCOM. IEEE, 567--575.
[35]
Seung-Jun Kim and Geogios B Giannakis. 2014. Real-time electricity pricing for demand response using online convex optimization. In ISGT 2014. IEEE, 1--5.
[36]
Jack King, Andy Clifton, and Bri-Mathias Hodge. 2014. Validation of power output for the WIND Toolkit. Technical Report NREL/TP-5D00--61714. National Renewable Energy Lab.(NREL), Golden, CO (United States).
[37]
Elias Koutsoupias and Christos H Papadimitriou. 1995. On the k-server conjecture. Journal of the ACM (JACM), Vol. 42, 5 (1995), 971--983.
[38]
Nikil Kumar, Philip Besuner, Steven Lefton, Dwight Agan, and Douglas Hilleman. 2012. Power plant cycling costs. Technical Report. National Renewable Energy Lab.(NREL), Golden, CO (United States).
[39]
Ravi Kumar, Manish Purohit, Aaron Schild, Zoya Svitkina, and Erik Vee. 2018. Semi-online bipartite matching. arXiv preprint arXiv:1812.00134 (2018).
[40]
Silvio Lattanzi, Thomas Lavastida, Benjamin Moseley, and Sergei Vassilvitskii. 2020. Online Scheduling via Learned Weights. In Proceedings of the 2020 ACM-SIAM Symposium on Discrete Algorithms (SODA). 1859--1877. https://doi.org/10.1137/1.9781611975994.114
[41]
Thomas Lavastida, Benjamin Moseley, R Ravi, and Chenyang Xu. 2021a. Learnable and Instance-Robust Predictions for Online Matching, Flows and Load Balancing. In 29th Annual European Symposium on Algorithms (ESA 2021) (Leibniz International Proceedings in Informatics (LIPIcs), Vol. 204), Petra Mutzel, Rasmus Pagh, and Grzegorz Herman (Eds.). Schloss Dagstuhl -- Leibniz-Zentrum fü r Informatik, Dagstuhl, Germany, 59:1--59:17. https://doi.org/10.4230/LIPIcs.ESA.2021.59
[42]
Thomas Lavastida, Benjamin Moseley, R Ravi, and Chenyang Xu. 2021b. Learnable and Instance-Robust Predictions for Online Matching, Flows and Load Balancing. In 29th Annual European Symposium on Algorithms (ESA 2021). Schloss Dagstuhl-Leibniz-Zentrum für Informatik.
[43]
Russell Lee, Jessica Maghakian, Mohammad Hajiesmaili, Jian Li, Ramesh Sitaraman, and Zhenhua Liu. 2021. Online Peak-Aware Energy Scheduling with Untrusted Advice. (2021).
[44]
Yingying Li and Na Li. 2020. Leveraging Predictions in Smoothed Online Convex Optimization via Gradient-based Algorithms. arXiv preprint arXiv:2011.12539 (2020).
[45]
Yingying Li, Guannan Qu, and Na Li. 2018. Using predictions in online optimization with switching costs: A fast algorithm and a fundamental limit. In 2018 Annual American Control Conference (ACC). IEEE, 3008--3013.
[46]
Minghong Lin, Zhenhua Liu, Adam Wierman, and Lachlan LH Andrew. 2012a. Online algorithms for geographical load balancing. In 2012 International Green Computing Conference (IGCC). IEEE, 1--10.
[47]
Minghong Lin, Adam Wierman, Lachlan LH Andrew, and Eno Thereska. 2012b. Dynamic right-sizing for power-proportional data centers. IEEE/ACM Transactions on Networking, Vol. 21, 5 (2012), 1378--1391.
[48]
Yiheng Lin. 2019. Personal correspondence.
[49]
Yiheng Lin, Gautam Goel, and Adam Wierman. 2020. Online optimization with predictions and non-convex losses. Proceedings of the ACM on Measurement and Analysis of Computing Systems, Vol. 4, 1 (2020), 1--32.
[50]
Tan Lu, Minghua Chen, and Lachlan LH Andrew. 2012. Simple and effective dynamic provisioning for power-proportional data centers. IEEE Transactions on Parallel and Distributed Systems, Vol. 24, 6 (2012), 1161--1171.
[51]
Thodoris Lykouris and Sergei Vassilvtiskii. 2018. Competitive caching with machine learned advice. In International Conference on Machine Learning. PMLR, 3296--3305.
[52]
Jessica Maghakian, Russell Lee, Mohammad Hajiesmaili, Jian Li, Zhenhua Liu, and Ramesh Sitaraman. 2021. Leveraging Different Types of Predictors for Online Optimization. In 2021 55th Annual Conference on Information Sciences and Systems (CISS). IEEE, 1--1.
[53]
Mohammad Mahdian, Hamid Nazerzadeh, and Amin Saberi. 2012. Online optimization with uncertain information. ACM Transactions on Algorithms (TALG), Vol. 8, 1 (2012), 1--29.
[54]
Michael Mitzenmacher. 2018. A model for learned bloom filters and related structures. arXiv preprint arXiv:1802.00884 (2018).
[55]
Michael Mitzenmacher. 2020. Scheduling with predictions and the price of misprediction. In 11th Innovations in Theoretical Computer Science Conference (ITCS 2020).
[56]
C.K. Pang and H.C. Chen. 1976. Optimal short-term thermal unit commitment. IEEE Transactions on Power Apparatus and Systems, Vol. 95, 4 (1976), 1336--1346. https://doi.org/10.1109/T-PAS.1976.32228
[57]
Manish Purohit, Zoya Svitkina, and Ravi Kumar. 2018. Improving online algorithms via ML predictions. In Advances in Neural Information Processing Systems, S Bengio, H Wallach, H Larochelle, K Grauman, N Cesa-Bianchi, and R Garnett (Eds.), Vol. 31. Curran Associates, Inc. https://proceedings.neurips.cc/paper/2018/file/73a427badebe0e32caa2e1fc7530b7f3-Paper.pdf
[58]
Daan Rutten and Debankur Mukherjee. 2022. Capacity scaling augmented with unreliable machine learning predictions. SIGMETRICS Perform. Eval. Rev., Vol. 49, 2 (2022), 24--26. https://doi.org/10.1145/3512798.3512808
[59]
Mark Sellke. 2020. Chasing Convex Bodies Optimally. In Proceedings of the Thirty -First Annual ACM -SIAM Symposium on Discrete Algorithms (SODA '20). Society for Industrial and Applied Mathematics, USA, 1509--1518.
[60]
Ming Shi, Xiaojun Lin, and Sonia Fahmy. 2021. Competitive Online Convex Optimization With Switching Costs and Ramp Constraints. IEEE/ACM Transactions on Networking, Vol. 29, 2 (April 2021), 876--889. https://doi.org/10.1109/TNET.2021.3053910
[61]
Manmeet Singh, Maninder Singh, and Sanmeet Kaur. 2019. TI-2016 DNS dataset. https://doi.org/10.21227/9ync-vv09
[62]
Bo Sun, Russell Lee, Mohammad Hajiesmaili, Adam Wierman, and Danny HK Tsang. 2021. Pareto-Optimal Learning-Augmented Algorithms for Online Conversion Problems. arXiv preprint arXiv:2109.01556 (2021).
[63]
Hao Wang, Jianwei Huang, Xiaojun Lin, and Hamed Mohsenian-Rad. 2014. Exploring smart grid and data center interactions for electric power load balancing. ACM SIGMETRICS Performance Evaluation Review, Vol. 41, 3 (2014), 89--94.
[64]
Shufan Wang, Jian Li, and Shiqiang Wang. 2020. Online Algorithms for Multi-shop Ski Rental with Machine Learned Advice. In Advances in Neural Information Processing Systems, H Larochelle, M Ranzato, R Hadsell, M F Balcan, and H Lin (Eds.), Vol. 33. Curran Associates, Inc., 8150--8160. https://proceedings.neurips.cc/paper/2020/file/5cc4bb753030a3d804351b2dfec0d8b5-Paper.pdf
[65]
Alexander Wei and Fred Zhang. 2020. Optimal Robustness-Consistency Trade-Offs for Learning-Augmented Online Algorithms. In Proceedings of the 34th International Conference on Neural Information Processing Systems (NIPS'20). Curran Associates Inc., Red Hook, NY, USA.
[66]
Francesco Zanini, David Atienza, Luca Benini, and Giovanni De Micheli. 2009. Multicore thermal management with model predictive control. In 2009 European Conference on Circuit Theory and Design. IEEE, 711--714.
[67]
Francesco Zanini, David Atienza, Giovanni De Micheli, and Stephen P Boyd. 2010. Online convex optimization-based algorithm for thermal management of MPSoCs. In Proceedings of the 20th symposium on Great lakes symposium on VLSI. 203--208.
[68]
Lijun Zhang, Wei Jiang, Shiyin Lu, and Tianbao Yang. 2021. Revisiting Smoothed Online Learning. arXiv preprint arXiv:2102.06933 (2021).

Cited By

View all
  • (2024)Best of both worlds guarantees for smoothed online quadratic optimizationProceedings of the 41st International Conference on Machine Learning10.5555/3692070.3692225(3850-3888)Online publication date: 21-Jul-2024
  • (2024)Learning-augmented Online Minimization of Age of Information and Transmission CostsIEEE INFOCOM 2024 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS)10.1109/INFOCOMWKSHPS61880.2024.10620883(01-08)Online publication date: 20-May-2024

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Measurement and Analysis of Computing Systems
Proceedings of the ACM on Measurement and Analysis of Computing Systems  Volume 7, Issue 1
POMACS
March 2023
749 pages
EISSN:2476-1249
DOI:10.1145/3586099
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 March 2023
Published in POMACS Volume 7, Issue 1

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. competitive analysis
  2. non-convex optimization
  3. online algorithms

Qualifiers

  • Research-article

Funding Sources

  • NSF

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)310
  • Downloads (Last 6 weeks)41
Reflects downloads up to 16 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Best of both worlds guarantees for smoothed online quadratic optimizationProceedings of the 41st International Conference on Machine Learning10.5555/3692070.3692225(3850-3888)Online publication date: 21-Jul-2024
  • (2024)Learning-augmented Online Minimization of Age of Information and Transmission CostsIEEE INFOCOM 2024 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS)10.1109/INFOCOMWKSHPS61880.2024.10620883(01-08)Online publication date: 20-May-2024

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Full Access

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media