Active Selection Transfer Learning Algorithm
Pages 10093 - 10116
Abstract
Transfer learning has the ability to utilize the knowledge of the source domain with enough available and labeled data to help build a learning model for the target domain with scarce or unlabeled data, so it has gradually attracted the attention of researchers. This paper proposes an active transfer learning algorithm ACTrAda-TLSVM, the algorithm is based on support vector machine for the cross-domain data classification scenario where the source domain contains a small number of labeled samples and samples of the target domain are scarce enough to train a reliable classifier. It combines the advantages of active learning and enhanced learning to achieve the purpose of improving performance. The main components of ACTrAda-TLSVM are as follows: (1) utilizing maximum mean discrepancy to calculate the vector information of source domain sample weight and active learning to label the samples in the source domain with a large amount of information and similar to the target domain for purpose of obtaining high-quality label training samples; (2) on this basis, the knowledge in the source domain and data in the target domain are used to build the transfer learning classifier TLSVM, and (3) finally get TLSVM and TrAdaBoost together to construct ACTrAda-TLSVM classifier. Compared with the best benchmark algorithm, the experimental results show that the proposed algorithm improves by 1.74% and 1.21% on text datasets ISCX2012 and 20-Newsgroups, respectively; by 2.26% and 4.14% on image datasets COIL20 and Yale respectively. In addition, although the algorithm efficiency is considerable, there is still space for further improvement.
References
[1]
Jordan MI and Mitchell TM Machine learning: trends, perspectives, and prospects Science 2015 349 6245 255-260
[2]
Sethuraman R, Sellappan S, et al. An optimized AdaBoost Multi-class support vector machine for driver behavior monitoring in the advanced driver assistance systems Expert Syst Appl 2023 212 118618
[3]
Li J, Li G, Hai C, and Guo M Transformer fault diagnosis based on multi-class AdaBoost algorithm IEEE Access 2022 10 1522-1532
[4]
Javed AR, Jalil Z, Moqurrab SA, Abbas S, and Liu X Ensemble Adaboost classifier for accurate and fast detection of botnet attacks in connected vehicles Trans Emerg Telecommun Technol 2022 33 10 e4088
[5]
Li J, Wu W, and Xue D Transfer Naive Bayes algorithm with group probabilities Appl Intell 2020 50 1 61-73
[6]
Reyes O, Morell C, and Ventura S Effective active learning strategy for multi-label learning Neurocomputing 2018 273 jan.17 494-508
[7]
Pan SJ and Yang Q A survey on transfer learning IEEE Trans Knowl Data Eng 2010 22 10 1345-1359
[8]
Day O and Khoshgoftaar TM A survey on heterogeneous transfer learning J Big Data 2017 4 1 29
[9]
Weiss K, Khoshgoftaar TM, and Wang DD A survey of transfer learning J Big Data 2016 3 1 9
[10]
Long M, Wang J, Ding G, et al. Adaptation regularization: a general framework for transfer learning IEEE Trans Knowl Data Eng 2014 26 5 1076-1089
[11]
Mozafari AS and Jamzad M A SVM-based model-transferring method for heterogeneous domain adaptation Pattern Recogn 2016 56 6 142-158
[12]
Gao J, Fan W, Jiang J, et al (2008) Knowledge transfer via multiple model local structure mapping. In: ACM SIGKDD international conference on knowledge discovery and data mining, Las Vegas, Nevada, USA, August. DBLP, pp 283–291
[13]
Quanz B, Huan J (2009) Large margin transductive transfer learning. In: Proceedings of the 18th ACM conference on information and knowledge management, New York, USA. ACM, pp 1327–1336
[14]
Li X, Mao W, and Jiang W Extreme learning machine based transfer learning for data classification Neurocomputing 2016 2016 174 203-210
[15]
Li J, Wu W, and Xue D Research on transfer learning algorithm based on support vector machine J Intell Fuzzy Syst 2020 38 10 1-16
[16]
Shao L, Zhu F, and Li X Transfer learning for visual categorization: a survey IEEE Trans Neural Netw Learn Syst 2017 26 5 1019-1034
[17]
Siyu S, Stephen MA, Ruqiang Y, et al. Highly-accurate machine fault diagnosis using deep transfer learning IEEE Trans Ind Inform 2018 15 1-1
[18]
Wang J and Ke L Feature subspace transfer for collaborative filtering Neurocomputing 2014 136 20 1-6
[19]
Zhang X, Zhuang Y, Hu H, et al. 3-D laser-based multiclass and multiview object detection in cluttered indoor scenes IEEE Trans Neural Netw Learn Syst 2015 28 1 177-190
[20]
Wiatowski T and Bolcskei H A mathematical theory of deep convolutional neural networks for feature extraction IEEE Trans Inf Theory 2018 64 3 1845-1866
[21]
Liu F, Xu X, Qiu S, et al. Simple to complex transfer learning for action recognition IEEE Trans Image Process 2016 25 2 949-960
[22]
Sejdinovic D, Sriperumbudur B, Gretton A, et al. Equivalence of distance-based and RKHS-based statistics in hypothesis testing Ann Stat 2013 41 5 2263-2291
[23]
Li J, Wu W, Xue D, and Gao P Multi-source deep transfer neural network algorithm Sensors 2019 19 3992
[24]
Han T, Liu C, Yang W, et al. Deep transfer network with joint distribution adaptation: a new intelligent fault diagnosis framework for industry application ISA Trans 2018 97 261-289
[25]
Dai W, Yang Q, Xue GR, et al. Boosting for transfer learning. In: International conference on machine learning (ACM07)
[26]
Huang SJ, Gao N, Chen S (2017) Multi-instance multi-label active learning. In: Twenty-sixth international joint conference on artificial intelligence
[27]
Zhuang FZ, Luo P, He Q, and Shi ZZ Survey on transfer learning research J Softw 2015 26 1 26-39
[28]
Distant domain transfer learning. AAAI 2017, pp 2604–2610
[29]
Zheng X, Lin L, Liu B, et al. A multi-task transfer learning method with dictionary learning Knowl Based Syst 2019 191 105233
[30]
Lu Z, Zhong E, Zhao L, et al (2013) Selective transfer learning for cross domain recommendation. In: SIAM international conference on data mining 2013. IEEE
[31]
Fu CJ and Yang YP A batch-mode active learning SVM method based on semi-supervised clustering Intell Data Anal 2015 19 2 345-358
[32]
Liang G, Wenbo G, and Yupu Y Active learning support vector machines with low-rank transformation Intell Data Anal 2018 22 4 701-715
[33]
Ili V and Tadi J Active learning using a self-correcting neural network (ALSCN) Appl Intell 2021 52 1-13
[34]
Shahraki A, Abbasi M, Taherkordi A, et al. Active learning for network traffic classification: a technical study IEEE Trans Cogn Commun Netw 2022 8 1 422-439
[35]
Chang CC and Lin CJ LIBSVM: a library for support vector machines ACM Trans Intell Syst Technol 2011 2 3 1-27
[36]
Su T, Zhang S, and Liu T Active learning based on SVM and representativity in a coal mining environment Earth Sci Inform 2022 15 1115-1135
[37]
Dong S Multi class SVM algorithm with active learning for network traffic classification Expert Syst Appl 2021 176 24 114885
[38]
Li J, Wu W, and Xue D An intrusion detection method based on active transfer learning Intell Data Anal 2020 24 2 363-383
Recommendations
Transfer active learning
CIKM '11: Proceedings of the 20th ACM international conference on Information and knowledge managementActive learning traditionally assumes that labeled and unlabeled samples are subject to the same distributions and the goal of an active learner is to label the most informative unlabeled samples. In reality, situations may exist that we may not have ...
Research on transfer learning algorithm based on support vector machine
Fuzzy Systems for Medical Image AnalysisTransfer learning is a new machine learning algorithm. It solves problems in different but related target domains by utilizing the knowledge in existing data. Based on the classical SVM algorithm and transfer learning, a selective transfer learning ...
An active learning-based SVM multi-class classification model
Traditional multi-class classification models are based on labeled data and are not applicable to unlabeled data. To overcome this limitation, this paper presents a multi-class classification model that is based on active learning and support vector ...
Comments
Information & Contributors
Information
Published In
© The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2023. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
Publisher
Kluwer Academic Publishers
United States
Publication History
Published: 29 April 2023
Accepted: 08 March 2023
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 13 Jan 2025