research-article

Describing the APIs comprehensively: : Obtaining the holistic representations from multiple modalities data for different tasks

Authors:

Huaxiao LiuAuthors Info & Claims

Volume 158, Issue C

https://doi.org/10.1016/j.infsof.2023.107188

Published: 01 June 2023 Publication History

Abstract

Context:

API (Application Programming Interface) is an important object in software development, and describing them properly is the basis for solving related problems, such as API recommendation. Recently, multimodal data fusing approaches become a hot research topic in different fields, and they can be used to get comprehensive representations of things by describing them from different angles. This provides us with a new useful way for API representation.

Objective:

In this work, we aim at describing APIs comprehensively by fusing information from multimodal data for supporting different API-related tasks.

Method:

To achieve this goal, we propose a novel approach BDBM (Bimodal Deep Boltzmann Machine) to obtain holistic representations of APIs by fusing the information in text and code modalities, which are the API descriptions and the codes of the products. Then, the BDBM is applied to two typical API tasks (API recommendation and similar API mining) to analyze its performance.

Results and Conclusion:

The results show that the API recommendation based on BDBM outperforms the ones based on unimodal API information, our method’s precisions can reach 0.67, 0.65, 0.61 at top-3, top-5 and top-10, while MAP and MRR are 0.66 and 0.67. Meanwhile, the close representations give similar APIs with similar functionalities as well as similar usage in codes. Thus, we believe that multimodal data fusion is suitable for describing APIs, and the holistic representations given by BDBM can be used in different API-related tasks.

References

[1]

Smith Linda B., Gasser Michael, The development of embodied cognition: Six lessons from babies, Artif. Life 11 (2005) 13–29.

Digital Library

[2]

Sufang Zhang, Jun-Hai Zhai, Bo-Jun Xie, Yan Zhan, Xin Wang, Multimodal Representation Learning: Advances, Trends and Challenges, in: 2019 International Conference on Machine Learning and Cybernetics, ICMLC, 2019, pp. 1–6.

[3]

Xinwei Sun, Yilun Xu, Peng Cao, Yuqing Kong, Lingjing Hu, Shan Zhang, Yizhou Wang, TCGM: An Information-Theoretic Framework for Semi-Supervised Multi-Modality Learning, in: arXiv, 2020, arXiv:2007.06793.

[4]

Changqing Zhang, Zongbo Han, Yajie Cui, H. Fu, Joey Tianyi Zhou, Qinghua Hu, CPM-Nets: Cross Partial Multi-View Networks, in: NeurIPS, 2019.

[5]

Cho Jaemin, Lu Jiasen, Schwenk Dustin, Hajishirzi Hannaneh, Kembhavi Aniruddha, X-LXMERT: Paint, caption and answer questions with multi-modal transformers, 2020, arXiv, abs/2009.11278.

[6]

Jiasen Lu, Dhruv Batra, Devi Parikh, Stefan Lee, ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks, in: Neural Information Processing Systems, 2019.

[7]

Wang Peiqi, Wells William M., Berkowitz Seth J., Horng Steven, Golland Polina, Using multiple instance learning to build multimodal representations, 2022, arXiv,abs/2212.05561.

[8]

Shih-Cheng Huang, Liyue Shen, Matthew P. Lungren, Serena Yeung, GLoRIA: A Multimodal Global-Local Representation Learning Framework for Label-efficient Medical Image Recognition, in: 2021 IEEE/CVF International Conference on Computer Vision, ICCV, 2021, pp. 3922–3931.

[9]

Soravit Changpinyo, Jordi Pont-Tuset, Vittorio Ferrari, Radu Soricut, Telling the What while Pointing to the Where: Multimodal Queries for Image Retrieval, in: 2021 IEEE/CVF International Conference on Computer Vision, ICCV, 2021, pp. 12116–12126.

[10]

Dabrowski Jacek, Letier Emmanuel, Perini Anna, Susi Angelo, Analysing app reviews for software engineering: a systematic literature review, Empir. Softw. Eng. 27 (2022).

[11]

Gregorio Marianna Di, Nucci Dario Di, Palomba Fabio, Vitiello Giuliana, The making of accessible android applications: an empirical study on the state of the practice, Empir. Softw. Eng. 27 (2020).

[12]

Cruz L., Abreu Rui, Lo D., To the attention of mobile software developers: guess what, test your app!, Empir. Softw. Eng. (2019) 1–31.

[13]

Shi Zhong Yang, Rui Li, Jiongyi Chen, Wenrui Diao, Shanqing Guo, Demystifying Android Non-SDK APls: Measurement and Understanding, in: 2022 IEEE/ACM 44th International Conference on Software Engineering, ICSE, 2022, pp. 647–658.

[14]

Qiao Huang, Xin Xia, Zhenchang Xing, D. Lo, Xinyu Wang, API Method Recommendation without Worrying about the Task-API Knowledge Gap, in: 2018 33rd IEEE/ACM International Conference on Automated Software Engineering, ASE, 2018, pp. 293–304.

[15]

Zijie Chen, Tao Zhang, Xiao Peng, A Novel API Recommendation Approach By Using Graph Attention Network, in: 2021 IEEE 21st International Conference on Software Quality, Reliability and Security, QRS, 2021, pp. 726–737.

[16]

Vitalis Salis, Thodoris Sotiropoulos, Panos Louridas, Diomidis D. Spinellis, Dimitris Mitropoulos, PyCG: Practical Call Graph Generation in Python, in: 2021 IEEE/ACM 43rd International Conference on Software Engineering, ICSE, 2021, pp. 1646–1657.

[17]

Devlin Jacob, Chang Ming-Wei, Lee Kenton, Toutanova Kristina, BERT: Pre-training of deep bidirectional transformers for language understanding, 2019, arXiv, abs/1810.04805.

[18]

Yu Dian, Sun Kai, Cardie Claire, Yu Dong, Dialogue-based relation extraction, 2020, arXiv, abs/2004.08056.

[19]

Xiaodong Gu, Hongyu Zhang, D. Zhang, Sunghun Kim, Deep API learning, in: Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering, 2016.

[20]

Ferdian Thung, Shaowei Wang, D. Lo, Julia L. Lawall, Automatic recommendation of API methods from feature requests, in: 2013 28th IEEE/ACM International Conference on Automated Software Engineering, ASE, 2013, pp. 290–300.

[21]

Collin McMillan, M. Grechanik, Denys Poshyvanyk, Qing Xie, Chen Fu, Portfolio: finding relevant functions and their usage, in: 2011 33rd International Conference on Software Engineering, ICSE, 2011, pp. 111–120.

[22]

Chen Chi, Peng Xin, Xing Zhenchang, Sun Jun, Wang Xin, Zhao Yifan, Zhao Wenyun, Holistic combination of structural and textual code information for context based API recommendation, 2020, arXiv, arXiv:2010.07514.

[23]

Mohammad Masudur Rahman, Chanchal Kumar Roy, D. Lo, RACK: Automatic API Recommendation Using Crowdsourced Knowledge, in: 2016 IEEE 23rd International Conference on Software Analysis, Evolution, and Reengineering Vol. 1, SANER, 2016, pp. 349–359.

[24]

Moshi Wei, Nima Shiri Harzevili, Yuchao Huang, Junjie Wang, Song Wang, CLEAR: Contrastive Learning for API Recommendation, in: 2022 IEEE/ACM 44th International Conference on Software Engineering, ICSE, 2022, pp. 376–387.

[25]

Tingting Liang, Liang Chen, Haochao Ying, Jian Wu, Co-Clustering WSDL Documents to Bootstrap Service Discovery, in: 2014 IEEE 7th International Conference on Service-Oriented Computing and Applications, 2014, pp. 215–222.

[26]

Wu Jian, Chen Liang, Zheng Zibin, Lyu Michael R., Wu Zhaohui, Clustering web services to facilitate service discovery, Knowl. Inf. Syst. 38 (2013) 207–229.

[27]

Liang Cai, Haoye Wang, Qiao Huang, Xin Xia, Zhenchang Xing, D. Lo, BIKER: a tool for Bi-information source based API method recommendation, in: Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, 2019.

[28]

Tam The Nguyen, Hung Viet Pham, Phong Minh Vu, Tung Thanh Nguyen, Recommending API Usages for Mobile Apps with Hidden Markov Model, in: 2015 30th IEEE/ACM International Conference on Automated Software Engineering, ASE, 2015, pp. 795–800.

[29]

Pan Weifeng, Chai Chunlai, Structure-aware mashup service clustering for cloud-based internet of things using genetic algorithm based clustering algorithm, Future Gener. Comput. Syst. 87 (2018) 267–277.

[30]

Anh Tuan Nguyen, Michael C Hilton, Mihai Codoban, Hoan Anh Nguyen, Lily Mast, Eli Rademacher, Tien Nhut Nguyen, Danny Dig, API code recommendation using statistical learning from fine-grained changes, in: Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering, 2016.

[31]

Xuan Li, Zerui Wang, Qianxiang Wang, Shoumeng Yan, Tao Xie, Hong Mei, Relationship-aware code search for JavaScript frameworks, in: Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering, 2016.

[32]

Trong Duc Nguyen, Anh Tuan Nguyen, Hung Dang Phan, Tien Nhut Nguyen, Exploring API Embedding for API Usages and Applications, in: 2017 IEEE/ACM 39th International Conference on Software Engineering, ICSE, 2017, pp. 438–449.

[33]

Liu Lei, Li Xun, Liu Yuzhou, Liu Huaxiao, Application programming interface recommendation according to the knowledge indexed by app feature mined from app stores, J. Softw.: Evol.Process 33 (2021).

[34]

Yu Huang, Chenzhuang Du, Zihui Xue, Xuanyao Chen, Hang Zhao, Longbo Huang, What Makes Multimodal Learning Better than Single (Provably), in: NeurIPS, 2021.

[35]

Yoav Freund, David Haussler, Unsupervised Learning of Distributions of Binary Vectors Using 2-LayerNetworks, in: NIPS, 1991.

[36]

Yang Xiaofeng, Wu Zhao, Zhang Qiuming, Bluetooth indoor localization with Gaussian–Bernoulli restricted Boltzmann machine plus liquid state machine, IEEE Trans. Instrum. Meas. 71 (2022) 1–8.

[37]

Guo Daya, Ren Shuo, Lu Shuai, Feng Zhangyin, Tang Duyu, Liu Shujie, Zhou Long, Duan Nan, Yin Jian, Jiang Daxin, Zhou M., GraphCodeBERT: Pre-training code representations with data flow, 2021, arXiv, arXiv:2009.08366.

[38]

Aditya Grover, Jure Leskovec, node2vec: Scalable Feature Learning for Networks, in: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2016.

[39]

Jeffrey Pennington, Richard Socher, Christopher D. Manning, GloVe: Global Vectors for Word Representation, in: Conference on Empirical Methods in Natural Language Processing, 2014.

[40]

Chunyang Ling, Yanzhen Zou, Bing Xie, Graph Neural Network Based Collaborative Filtering for API Usage Recommendation, in: 2021 IEEE International Conference on Software Analysis, Evolution and Reengineering, SANER, 2021, pp. 36–47.

[41]

Kyunghyun Cho, Tapani Raiko, Alexander Ilin, Gaussian-Bernoulli deep Boltzmann machine, in: The 2013 International Joint Conference on Neural Networks, IJCNN, 2013, pp. 1–7.

[42]

Lyakhova Yana S., Polyakov E A, Rubtsov Alexey N., Effectively trainable semi-quantum restricted Boltzmann machine, 2020, arXiv, abs/2001.08997.

[43]

Song Yang, Kingma Diederik P., How to train your energy-based models, 2021, arXiv, abs/2101.03288.

[44]

Fleiss Joseph L., Measuring nominal scale agreement among many raters, Psychol. Bull. 76 (1971) 378–382.

[45]

Bryan Perozzi, Rami Al-Rfou, Steven Skiena, DeepWalk: online learning of social representations, in: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2014.

[46]

Antoine Bordes, Nicolas Usunier, Alberto García-Durán, Jason Weston, Oksana Yakhnenko, Translating Embeddings for Modeling Multi-relational Data, in: NIPS, 2013.

[47]

Tomas Mikolov, Kai Chen, Gregory S. Corrado, Jeffrey Dean, Efficient Estimation of Word Representations in Vector Space, in: International Conference on Learning Representations, 2013.

[48]

Armand Joulin, Edouard Grave, Piotr Bojanowski, Tomas Mikolov, Bag of Tricks for Efficient Text Classification, in: Conference of the European Chapter of the Association for Computational Linguistics, 2016.

[49]

Xin Ye, Hui Shen, Xiao Ma, Razvan C. Bunescu, Chang Liu, From Word Embeddings to Document Similarities for Improved Information Retrieval in Software Engineering, in: 2016 IEEE/ACM 38th International Conference on Software Engineering, ICSE, 2016, pp. 404–415.

Recommendations

Java APIs, Extensions and Libraries: With JavaFX, JDBC, jmod, jlink, Networking, and the Process API
Beginning Java 8 APIs, Extensions and Libraries: Swing, JavaFX, JavaScript, JDBC and Network Programming APIs
JAIN protocol APIs

JAIN envisions the creation of a number of Java APIs that abstract the details of networks and protocol implementations, and allow for the development of portable applications. The JAIN Protocol Experts Group (PEG) will focus on developing Java APIs for ...

Comments

Information & Contributors

Information

Published In

cover image Information and Software Technology

Information and Software Technology Volume 158, Issue C

Jun 2023

296 pages

ISSN:0950-5849

Issue’s Table of Contents

Elsevier B.V.

Publisher

Butterworth-Heinemann

United States

Publication History

Published: 01 June 2023

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

0
Total Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents