Robust resource demand estimation using hierarchical Bayesian model in a distributed service system
Authors: 
Sumanta Mukherjee, Krishnasuri Narayanam, Nupur Aggarwal, Digbalay Bose, Amith SingheeAuthors Info & Claims
Sumanta Mukherjee, Krishnasuri Narayanam, Nupur Aggarwal, Digbalay Bose, Amith SingheeAuthors Info & ClaimsPages 350 - 358
Abstract
Robust resource demand prediction is crucial for efficient allocation of resources to service requests in a distributed service delivery system. There are two problems in resource demand prediction: firstly to estimate the volume of service requests that come in at different time points and at different geo-locations, secondly to estimate the resource demand given the estimated volume of service requests. While a lot of literature exists to address the first problem, in this work, we have proposed a data-driven statistical method for robust resource demand prediction to address the second problem. The method automates the identification of various system operational characteristics and contributing factors that influence the system behavior to generate an adaptive low variance resource demand prediction model. Factors can be either continuous or categorical in nature. The method assumes that each service request resolution involves multiple tasks. Each task is composed of multiple activities. Each task belongs to a task type, based on the type of the resource it requires to resolve that task. Our method supports configurable tasks per service request, and configurable activities per task. The demand prediction model produces an aggregated resource demand required to resolve all the activities under a task by activity sequence modeling; and aggregated resource demand by resource type, required to resolve all the activities under a service request by task sequence modeling.
References
[1]
Mallikarjun Angalakudati, Jorge Calzada, Vivek Farias, Jonathan Gonynor, Matthieu Monsch, Anna Papush, Georgia Perakis, Nicolas Raad, Jeremy Schein, Cheryl Warren, Sean Whipple, and John Williams. 2014. Improving emergency storm planning using machine learning. In 2014 IEEE PES Conference and Exposition. 1–6. https://doi.org/10.1109/TDC.2014.6863406
[2]
A.Singhee and Haijing Wang. 2017. Probabilistic forecasts of service outage counts from severe weather in a distribution grid. In 2017 IEEE Power and Energy Society General Meeting. 1–5. https://doi.org/10.1109/PESGM.2017.8274101
[3]
P. C. Chen, T. Dokic, N. Stokes, D. W. Goldberg, and M. Kezunovic. 2015. Predicting weather-associated impacts in outage management utilizing the GIS framework. In 2015 IEEE PES Innovative Smart Grid Technologies Latin America (ISGT LATAM). 417–422. https://doi.org/10.1109/ISGT-LA.2015.7381191
[4]
P. C. Chen and M. Kezunovic. 2016. Fuzzy Logic Approach to Predictive Risk Analysis in Distribution Outage Management. IEEE Transactions on Smart Grid 7, 6 (Nov 2016), 2827–2836. https://doi.org/10.1109/TSG.2016.2576282
[5]
Tianqi Chen and Carlos Guestrin. 2016. Xgboost: A scalable tree boosting system. In Proceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining. 785–794.
[6]
M.H. DeGroot and M.J. Schervish. 2002. Probability and Statistics. Addison-Wesley. https://books.google.co.in/books?id=iH4ZAQAAIAAJ
[7]
D.W.Wanik, E.N.Anagnostou, B.M.Hartman, M.E.B.Frediani, and M.Astitha. 2015. Storm outage modeling for an electric distribution network in Northeastern USA. In Natural Hazards, Vol. 79. 1359–1384. https://doi.org/article/10.1007/s11069-015-1908-2
[8]
Pablo A. Estévez, M. Tesmer, Claudio A. Perez, and Jacek M. Zurada. 2009. Normalized Mutual Information Feature Selection.IEEE Trans. Neural Networks 20, 2 (2009), 189–201. http://dblp.uni-trier.de/db/journals/tnn/tnn20.html#EstevezTPZ09
[9]
A. Gelman, J.B. Carlin, H.S. Stern, D.B. Dunson, A. Vehtari, and D.B. Rubin. 2013. Bayesian Data Analysis, Third Edition. Taylor & Francis. https://books.google.co.in/books?id=ZXL6AQAAQBAJ
[10]
H.Li, L.A.Trenish, and J.R.M. Hosking. 2010. A statistical model for risk management of electric outage forecasts. In IBM Journal of Research and Development, Vol. 54. 8.1–8.11. https://doi.org/10.1147/JRD.2010.2044836
[11]
Roger A. Horn and Charles R. Johnson. 2012. Matrix Analysis (2nded.). Cambridge University Press, New York, NY, USA.
[12]
Padmavathy Kankanala, Sanjoy Das, and Anil Pahwa. 2014. ADABOOST(+): An Ensemble Learning Approach for Estimating Weather-Related Outages in Distribution Systems. 29 (01 2014), 359–367.
[13]
J.G. Kemeny, D.S. Griffeath, J.L. Snell, and A.W. Knapp. 2012. Denumerable Markov Chains: with a chapter of Markov Random Fields by David Griffeath. Springer New York. https://books.google.co.in/books?id=DmXmBwAAQBAJ
[14]
Young M. Lee, Soumyadip Ghosh, and Markus Ettl. 2009. Simulating distribution of emergency relief supplies for disaster response operations. Proceedings of the 2009 Winter Simulation Conference (WSC) (2009), 2797–2808.
[15]
Zhiguo Li, A. Singhee, Haijing Wang, A. Raman, S. Siegel, Fook-Luen Heng, R. Mueller, and G. Labut. 2015. Spatio-temporal forecasting of weather-driven damage in a distribution system. In 2015 IEEE Power and Energy Society General Meeting. 1–5. https://doi.org/10.1109/PESGM.2015.7285788
[16]
L.Trenish, A.Praino, and J.Cipriani. 2011. On-going Utilization and Evaluation of a Coupled Weather and Outage Prediction Service for Electric Distribution Operations. 2nd Conference on Weather, Climate, and the New Energy Economy (Jan 2011).
[17]
D. Lubkeman and D. E. Julian. 2004. Large scale storm outage management. In IEEE Power Engineering Society General Meeting, 2004.16–22 Vol.1. https://doi.org/10.1109/PES.2004.1372741
[18]
Brian C. Ross. 2014. Mutual information between discrete and continuous data sets. PLoS ONE 9, 2 (Feb. 2014), e87357. https://doi.org/10.1371/journal.pone.0087357
[19]
Mahsa Salehi, Laura Irina Rusu, Timothy Lynar, and Anna Phan. 2016. Dynamic and Robust Wildfire Risk Prediction System: An Unsupervised Approach. In Proceedings of the 22Nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (San Francisco, California, USA) (KDD ’16). ACM, New York, NY, USA, 245–254. https://doi.org/10.1145/2939672.2939685
[20]
A. Singhee, Z. Li, A. Koc, H. Wang, J. P. Cipriani, Y. Kim, A. P. Kumar, L. A. Treinish, R. Mueller, G. Labut, R. A. Foltman, and G. M. Gauthier. 2016. OPRO: Precise emergency preparedness for electric utilities. IBM Journal of Research and Development 60, 1 (Jan 2016), 6:1–6:15. https://doi.org/10.1147/JRD.2015.2494999
[21]
J. S. Wu, T. E. Lee, C. T. Tsai, T. H. Chang, and S. H. Tsai. 2004. A fuzzy rule-based system for crew management of distribution systems in large-scale multiple outages. In 2004 International Conference on Power System Technology, 2004. PowerCon 2004., Vol. 2. 1084–1089 Vol.2. https://doi.org/10.1109/ICPST.2004.1460162
Recommendations
Resource reconstruction algorithms for on-demand allocation in virtual computing resource pool
Resource reconstruction algorithms are studied in this paper to solve the problem of resource on-demand allocation and improve the efficiency of resource utilization in virtual computing resource pool. Based on the idea of resource virtualization and ...
Evaluating approaches to resource demand estimation
Resource demands are a key parameter of stochastic performance models that needs to be determined when performing a quantitative performance analysis of a system. However, the direct measurement of resource demands is not feasible in most realistic ...
Leveraging Service Composition Relationship to Improve CPU Demand Estimation in SOA Environments
SCC '08: Proceedings of the 2008 IEEE International Conference on Services Computing - Volume 1Service Oriented Architecture (SOA) helps dynamically construct composite services out of a set of low-level atomic services to satisfy customer requirements. For the purpose of capacity planning and resource provisioning, it is important to understand ...
Comments
Information & Contributors
Information
Published In
January 2021
453 pages
ISBN:9781450388177
DOI:10.1145/3430984
Copyright © 2021 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 02 January 2021
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
CODS COMAD 2021
Acceptance Rates
Overall Acceptance Rate 197 of 680 submissions, 29%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 61Total Downloads
- Downloads (Last 12 months)5
- Downloads (Last 6 weeks)0
Reflects downloads up to 02 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format