Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3663529.3663811acmconferencesArticle/Chapter ViewAbstractPublication PagesfseConference Proceedingsconference-collections
research-article

GAISSALabel: A Tool for Energy Labeling of ML Models

Published: 10 July 2024 Publication History

Abstract

The increasing environmental impact of Information Technologies, particularly in Machine Learning (ML), highlights the need for sustainable practices in software engineering. The escalating complexity and energy consumption of ML models need tools for assessing and improving their energy efficiency. This paper introduces GAISSALabel, a web-based tool designed to evaluate and label the energy efficiency of ML models. GAISSALabel is a technology transfer development from a former research on energy efficiency classification of ML, consisting of a holistic tool for assessing both the training and inference phases of ML models, considering various metrics such as power draw, model size efficiency, CO2e emissions and more. GAISSALabel offers a labeling system for energy efficiency, akin to labels on consumer appliances, making it accessible to ML stakeholders of varying backgrounds. The tool's adaptability allows for customization in the proposed labeling system, ensuring its relevance in the rapidly evolving ML field. GAISSALabel represents a significant step forward in sustainable software engineering, offering a solution for balancing high-performance ML models with environmental impacts. The tool's effectiveness and market relevance will be further assessed through planned evaluations using the Technology Acceptance Model.

References

[1]
Lasse F Wolff Anthony, Benjamin Kanding, and Raghavendra Selvan. 2020. Carbontracker: Tracking and predicting the carbon footprint of training deep learning models. arXiv preprint arXiv:2007.03051.
[2]
Nesrine Bannour, Sahar Ghannay, Aurélie Névéol, and Anne-Laure Ligozat. 2021. Evaluating the carbon footprint of NLP methods: a survey and analysis of existing tools. In Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing. 11–21.
[3]
Will Buchanan. 2021. Charting the path towards sustainable AI with Azure Machine Learning resource metrics. https://techcommunity.microsoft.com/t5/green-tech-blog/charting-the-path-towards-sustainable-ai-with-azure-machine/ba-p/2866923 Accessed: 29-01-2024
[4]
Victor R Basili1 Gianluigi Caldiera and H Dieter Rombach. 1994. The goal question metric approach. Encyclopedia of software engineering, 528–532.
[5]
Coral Calero, Ma Ángeles Moraga, and Mario Piattini. 2021. Software Sustainability. Springer.
[6]
Joel Castaño Fernández. 2023. A greenability evaluation sheet for AI-based systems. Universitat Politècnica de Catalunya.
[7]
Joel Castaño, Silverio Martínez-Fernández, Xavier Franch, and Justus Bogner. 2023. Exploring the Carbon Footprint of Hugging Face’s ML Models: A Repository Mining Study. In 2023 ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM). 1–12. https://doi.org/10.1109/ESEM56168.2023.10304801
[8]
Luís Cruz. 2022. Tools to Measure Software Energy Consumption from Your Computer. https://luiscruz.github.io/2021/07/20/measuring-energy.html Accessed: 29-01-2024
[9]
Fred D Davis. 1989. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS quarterly, 319–340.
[10]
Santiago del Rey, Silverio Martínez-Fernández, Luís Cruz, and Xavier Franch. 2023. Do DL models and training environments have an impact on energy consumption? In 2023 49th Euromicro Conference on Software Engineering and Advanced Applications (SEAA). 150–158.
[11]
Rébecca Deneckère and Gregoria Rubio. 2020. EcoSoft: Proposition of an eco-label for software sustainability. In Advanced Information Systems Engineering Workshops: CAiSE 2020 International Workshops, Grenoble, France, June 8–12, 2020, Proceedings 32. 121–132.
[12]
Payal Dhar. 2020. The carbon impact of artificial intelligence. Nat. Mach. Intell., 2, 8 (2020), 423–425.
[13]
Pau Duran Manzano, Silverio Martínez-Fernández, and Cristina Gómez Seoane. 2024. GAISSA-UPC/ML-GAISSALabel: First release. https://doi.org/10.5281/zenodo.10532066
[14]
Delger Erdenesanaa. 2023. A.I. Could Soon Need as Much Electricity as an Entire Country. https://www.nytimes.com/2023/10/10/climate/ai-could-soon-need-as-much-electricity-as-an-entire-country.html Accessed: 29-01-2024
[15]
Raphael Fischer, Matthias Jakobs, Sascha Mücke, and Katharina Morik. 2023. A Unified Framework for Assessing Energy Efficiency of Machine Learning. In Machine Learning and Principles and Practice of Knowledge Discovery in Databases: International Workshops of ECML PKDD 2022, Grenoble, France, September 19–23, 2022, Proceedings, Part I. 39–54.
[16]
Eva García-Martín, Crefeda Faviola Rodrigues, Graham Riley, and Håkan Grahn. 2019. Estimation of Energy Consumption in Machine Learning. J. Parallel and Distrib. Comput., 134 (2019), Dec., 75–88. issn:07437315 https://doi.org/10.1016/j.jpdc.2019.07.007
[17]
Information technology — Artificial intelligence — Environmental sustainability aspects of AI systems ISO/IEC 20226. 2024.
[18]
Alexandra Sasha Luccioni, Yacine Jernite, and Emma Strubell. 2023. Power Hungry Processing: Watts Driving the Cost of AI Deployment? arXiv preprint arXiv:2311.16863.
[19]
Commission Delegated Regulation (EU) 2019/2014 of 11 March 2019 supplementing Regulation (EU) 2017/1369 of the European Parliament and of the Council with regard to energy labelling of household washing machines and household washer-dryers. 2019. https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX%3A32019R2014 Accessed: 29-01-2024
[20]
Fairlearn. 2023. https://fairlearn.org/ Accessed: 29-01-2024
[21]
GAISSALabel: A Tool For ML Energy Labeling. 2024. https://youtu.be/GK4DBUwxWDQ Accessed: 29-01-2024
[22]
GAISSALabel: A Tool For ML Energy Labeling. 2024. http://gaissalabel.essi.upc.edu/ Accessed: 29-01-2024
[23]
GAISSALabel API’s documentation. 2024. http://gaissalabel.essi.upc.edu:81/doc/ Accessed: 29-01-2024
[24]
GitHub GAISSA-UPC/ML-GAISSALabel. 2024. https://github.com/GAISSA-UPC/ML-GAISSALabel Accessed: 29-01-2024
[25]
GitHub Green-Software-Foundation/if: Impact Framework. 2023. https://github.com/Green-Software-Foundation/if Accessed: 29-01-2024
[26]
GitHub visenger/awesome-mlops: A curated list of references for MLOps. 2024. https://github.com/visenger/awesome-mlops Accessed: 29-01-2024
[27]
Green Algorithms. 2023. https://www.green-algorithms.org/ Accessed: 29-01-2024
[28]
MLOps Toys | A Curated List of Machine Learning Projects. 2024. https://mlops.toys/ Accessed: 29-01-2024
[29]
Standards / SCI Green Software Foundation Green Software Foundation. 2023. https://greensoftwarefoundation.atlassian.net/wiki/spaces/ 612dd45e45cd76006a84071a/pages/15958033/Standards+SCI Accessed: 29-01-2024
[30]
The ML.ENERGY Initiative. 2022. https://ml.energy Accessed: 29-01-2024
[31]
The What-If Tool: Code-Free Probing of Machine Learning Models. 2018. https://blog.research.google/2018/09/the-what-if-tool-code-free-probing-of.html Accessed: 29-01-2024
[32]
Welcome to Impact Framework | Impact Framework. 2024. https://if.greensoftware.foundation/ Accessed: 29-01-2024
[33]
Victor Schmidt, Benoit Courty, and Amine Saboni. 2023. CodeCarbon. https://github.com/mlco2/codecarbon Accessed: 29-01-2024
[34]
Roy Schwartz, Jesse Dodge, Noah A Smith, and Oren Etzioni. 2020. Green AI. Commun. ACM, 63, 12 (2020), 54–63.
[35]
Shriram Shanbhag, Sridhar Chimalakonda, Vibhu Saujanya Sharma, and Vikrant Kaulgud. 2023. DENT: A Tool for Tagging Stack Overflow Posts with Deep Learning Energy Patterns. In Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering. 2157–2161.
[36]
Niklas Sundberg. 2023. Tackling AI’s Climate Change Problem. https://sloanreview.mit.edu/article/tackling-ais-climate-change-problem/ Accessed: 29-01-2024
[37]
Carole-Jean Wu, Ramya Raghavendra, Udit Gupta, Bilge Acun, Newsha Ardalani, Kiwan Maeng, Gloria Chang, Fiona Aga, Jinshi Huang, and Charles Bai. 2022. Sustainable AI: Environmental implications, challenges and opportunities. Proceedings of Machine Learning and Systems, 4 (2022), 795–813.

Index Terms

  1. GAISSALabel: A Tool for Energy Labeling of ML Models

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      FSE 2024: Companion Proceedings of the 32nd ACM International Conference on the Foundations of Software Engineering
      July 2024
      715 pages
      ISBN:9798400706585
      DOI:10.1145/3663529
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 10 July 2024

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Green AI
      2. Green Software
      3. Software Engineering
      4. Sustainability

      Qualifiers

      • Research-article

      Conference

      FSE '24
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 112 of 543 submissions, 21%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • 0
        Total Citations
      • 36
        Total Downloads
      • Downloads (Last 12 months)36
      • Downloads (Last 6 weeks)12
      Reflects downloads up to 22 Sep 2024

      Other Metrics

      Citations

      View Options

      Get Access

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media