Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3639592.3639599acmotherconferencesArticle/Chapter ViewAbstractPublication PagesaicccConference Proceedingsconference-collections
research-article
Open access

CLEB: A Continual Learning Energy Bidding Framework For An Energy Market Bidding Application

Published: 13 April 2024 Publication History

Abstract

Energy trading in the day-ahead and continuous energy market enables the maximization of profits for market participants, such as utility companies/suppliers and residential/industrial consumers. However, in practice, the AI-based decision-making process for accepting or rejecting bids/offers from customers/suppliers, commonly referred to as bidding decisions, often experiences performance degradation due to the fluctuation of renewable energy resources and the intermittent demand behavior of customers. This phenomenon is widely recognized as a data distribution shift in machine learning. One conventional approach involves training the model from scratch over an extended historical period, incurring significant computational and storage costs. To address this challenge more effectively, we propose a Continual Learning-based Energy Bidding framework (CLEB). This framework employs a relay-based continual learning method, utilizing a combination of a small portion of historical data and the most recent data with different distributions to enhance the accuracy of bidding decisions. The framework consists of predictive neural networks, specifically a Multi-Layer Perceptron (MLP), as well as data buffers for storing newly acquired data from a non-stationary data stream within an application. Subsequently, the evolving probability distribution of the data stream identified by the framework is utilized to retrain the model. Our evaluation in a public European energy trading dataset shows that the framework significantly improves accuracy performance of prediction model under the data distribution shift occurrences, allowing the model adaptively itself to deal with non-stationary data distributions in dynamic environments.

References

[1]
Zhang, X., Zhu, S., He, J., Yang, B. and Guan, X., 2019. Credit rating based real-time energy trading in microgrids. Applied energy, 236, pp.985-996.
[2]
Misra, S., Bera, S., Ojha, T., Mouftah, H.T. and Anpalagan, A., 2016. ENTRUST: Energy trading under uncertainty in smart grid systems. Computer Networks, 110, pp.232-242.
[3]
Wang, Y., Ma, Y., Song, F., Ma, Y., Qi, C., Huang, F., Xing, J. and Zhang, F., 2020. Economic and efficient multi-objective operation optimization of integrated energy system considering electro-thermal demand response. Energy, 205, p.118022.
[4]
Noor, S., Yang, W., Guo, M., van Dam, K.H. and Wang, X., 2018. Energy demand side management within micro-grid networks enhanced by blockchain. Applied energy, 228, pp.1385-1398.
[5]
Yang, J.J., Yang, M., Wang, M.X., Du, P.J. and Yu, Y.X., 2020. A deep reinforcement learning method for managing wind farm uncertainties through energy storage system control and external reserve purchasing. International Journal of Electrical Power & Energy Systems, 119, p.105928.
[6]
Wang, L., Zhang, X., Su, H. and Zhu, J., 2023. A comprehensive survey of continual learning: Theory, method and application. arXiv preprint arXiv:2302.00487.
[7]
He, Y., Henze, J. and Sick, B., 2020, July. Forecasting power grid states for regional energy markets with deep neural networks. In 2020 International Joint Conference on Neural Networks (IJCNN) (pp. 1-8). IEEE.
[8]
Bifet, A. and Gavalda, R., 2007, April. Learning from time-changing data with adaptive windowing. In Proceedings of the 2007 SIAM international conference on data mining (pp. 443-448). Society for Industrial and Applied Mathematics.
[9]
Chen, P.H., Wei, W., Hsieh, C.J. and Dai, B., 2021, July. Overcoming catastrophic forgetting by bayesian generative regularization. In International Conference on Machine Learning (pp. 1760-1770). PMLR.
[10]
Li, J., Zhang, C., Xu, Z., Wang, J., Zhao, J. and Zhang, Y.J.A., 2018. Distributed transactive energy trading framework in distribution networks. IEEE Transactions on Power Systems, 33(6), pp.7215-7227.
[11]
Renani, Y.K., Ehsan, M. and Shahidehpour, M., 2017. Optimal transactive market operations with distribution system operators. IEEE Transactions on Smart Grid, 9(6), pp.6692-6701.
[12]
Ye, Y., Qiu, D., Li, J. and Strbac, G., 2019. Multi-period and multi-spatial equilibrium analysis in imperfect electricity markets: A novel multi-agent deep reinforcement learning approach. IEEE access, 7, pp.130515-130529.
[13]
Lu, X., Xiao, X., Xiao, L., Dai, C., Peng, M. and Poor, H.V., 2019. Reinforcement learning-based microgrid energy trading with a reduced power plant schedule. IEEE Internet of Things Journal, 6(6), pp.10728-10737.
[14]
Du, Y., Li, F., Zandi, H. and Xue, Y., 2021. Approximating Nash equilibrium in day-ahead electricity market bidding with multi-agent deep reinforcement learning. Journal of modern power systems and clean energy, 9(3), pp.534-544.
[15]
Zenke, F., Poole, B. and Ganguli, S., 2017, July. Continual learning through synaptic intelligence. In International conference on machine learning (pp. 3987-3995). PMLR.
[16]
He, Y., Henze, J. and Sick, B., 2020. Continuous learning of deep neural networks to improve forecasts for regional energy markets. IFAC-PapersOnLine, 53(2), pp.12175-12182.
[17]
Page, E.S., 1954. Continuous inspection schemes. Biometrika, 41(1/2), pp.100-115.
[18]
Gama, J., Medas, P., Castillo, G. and Rodrigues, P., 2004. Learning with drift detection. In Advances in Artificial Intelligence–SBIA 2004: 17th Brazilian Symposium on Artificial Intelligence, Sao Luis, Maranhao, Brazil, September 29-Ocotber 1, 2004. Proceedings 17 (pp. 286-295). Springer Berlin Heidelberg.
[19]
Wang, P., Jin, N., Woo, W.L., Woodward, J.R. and Davies, D., 2022. Noise tolerant drift detection method for data stream mining. Information Sciences, 609, pp.1318-1333.
[20]
Shah, D. and Chatterjee, S., 2020. A comprehensive review on day‐ahead electricity market and important features of world's major electric power exchanges. International Transactions on Electrical Energy Systems, 30(7), p.e12360.
[21]
OMIE (Iberian Peninsula's Electricity Market Operator). Retrieved October 20, 2023 from https://www.omie.es/en
[22]
ENTSOE (European Network of Transmission System Operators for Electricity) dataset. Retrieved October 20, 2023 from https://transparency.entsoe.eu/dashboard
[23]
ESIOS (Spanish System Operator) dataset. Retrieved October 20, 2023 from https://www.esios.ree.es/en

Index Terms

  1. CLEB: A Continual Learning Energy Bidding Framework For An Energy Market Bidding Application

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    AICCC '23: Proceedings of the 2023 6th Artificial Intelligence and Cloud Computing Conference
    December 2023
    280 pages
    ISBN:9798400716225
    DOI:10.1145/3639592
    This work is licensed under a Creative Commons Attribution International 4.0 License.

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 13 April 2024

    Check for updates

    Author Tags

    1. Continual Learning
    2. Deep Neural Networks
    3. Energy Bidding

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Funding Sources

    • Institute of Information & communications Technology Planning & Evaluation
    • Grand Information Technology Research Center
    • ITRC(Information Technology Research Center)
    • Institute of Information & communications Technology Planning & Evaluation (IITP)

    Conference

    AICCC 2023

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 147
      Total Downloads
    • Downloads (Last 12 months)147
    • Downloads (Last 6 weeks)17
    Reflects downloads up to 24 Dec 2024

    Other Metrics

    Citations

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media