Abstract
This paper aims at addressing a challenging research in both fields of the wavelet neural network theory and the pattern recognition. A novel architecture of the wavelet network based on the multiresolution analysis (MRWN) and a novel learning algorithm founded on the Fast Wavelet Transform (FWTLA) are proposed. FWTLA has numerous positive sides compared to the already existing algorithms. By exploiting this algorithm to learn the MRWN, we suggest a pattern recognition system (FWNPR). We show firstly its classification efficiency on many known benchmarks and then in many applications in the field of the pattern recognition. Extensive empirical experiments are performed to compare the proposed methods with other approaches.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Q. Zhang and A. Benveniste, “Wavelet networks,” IEEE Trans. Neural Networks 3 (6), 889–898 (1992).
Q. Zhang, “Using wavelet network in nonparametric estimation,” IEEE Trans. Neural Networks 8 (2), 227–236 (1997).
J. Zhang, G. Walter, Y. Miao, and W. N. W. Lee, “Wavelet neural networks for function learning,” IEEE Trans. Signal Processing 43 (6), 1485–1497 (1995).
Y. Oussar and G. Dreyfus, “Initialization by selection for wavelet network training,” Neurocomputing 34 (1‒4), 131–143 (2000).
J. Xu and D. W. Ho, “A constructive algorithm for wavelet neural networks,” in Advances in Natural Computation (Springer, Berlin/Heidelberg, 2005), Vol. 3610, pp. 730–739.
G. Y. S. Qingmei, “A stepwise updating algorithm for multiresolution wavelet neural networks,” in Proc. Int. Conf. on Wavelet Analysis and Its Applications (WAA) (Chongqing, 2003), pp. 633–638.
K. E. L. ChangGyoon and K. Kangchui, “Modeling for an adaptive wavelet network parameter learning using genetic algorithms,” in Proc. 15th IASTED Int. Conf. on Modeling and Simulation (Marina del Rey, CA, 2004), pp. 55–59.
H. Y. C. Kai, “An adaptive hybrid wavelet neural network and its application,” in Proc. IEEE Int. Conf. on Robotics and Biomimetics ROBIO 2004 (Shenyang, 2004), pp. 779–784.
C. B. H. Min, “A novel learning algorithm for wavelet neural networks,” in Advances in Natural Computation (Springer Berlin/Heidelberg, 2005), Vol. 3610, pp. 1–7.
Z. Zhang, “Learning algorithm of wavelet network based on sampling theory,” Neurocomputing 71 (1–3), 244–269 (2007).
M. Yang and T. Su, “Automated diagnosis of sewer pipe defects based on machine learning approaches,” Expert Syst. Appl. 35 (3), 1327–1337 (2008).
I. Daubechies, Ten Lectures on Wavelets (CBMS-NSF Regional Conference Series in Applied Mathematics) (Society for Industrial and Applied Mathematics, SIAM, 1992).
W. Bellil, C. B. Amar, and A.M. Alimi, “A new survey on wavelet network, mutli library wavelet network training, 1D–2D function approximation and new image compression method,” Int. J. Comput. 8 (1), 79–86 (2014).
Y. Meyer, Ondelettes et opérateurs. I, ser. Actualités Mathématiques (Hermann, Paris, 1990).
M. Zaied, C. Ben Amar, and M. Alimi, “Award a new wavelet based beta function,” in Proc. Int. Conf. on Signal, System and Design, SSD03 (Tunisia, 2003), Vol. 1, pp. 185–191.
M. Zaied, O. Jemai, and C. Ben Amar, “Training of the beta wavelet networks by the frames theory: Application to face recognition,” in Proc. 1st Workshops on Image Processing Theory, Tools and Applications IPTA 2008 (Sousse, 2008), pp. 1–6.
M. Zaied, C. Amar, and A. Alimi, “Beta wavelet networks for face recognition,” J. Decision Syst. 14 (1–2), 109–122 (2005).
O. Jemai, M. Zaied, C. Ben Amar, and A. M. Alimi, “FBWN: An architecture of fast beta wavelet networks for image classification,” in Proc. Int. Joint Conf. on Neural Networks (IJCNN) (Barcelona, 2010), pp. 1–8.
V. Krager, “Gabor wavelet networks for object representation,” J. Opt. Soc. Am., 13–15 (2000).
C. Hu, R. Feris, and M. Turk, “Real-time view-based face alignment using active wavelet networks,” in Proc. IEEE Int. Workshop on Analysis and Modeling of Faces and Gestures AMFG 2003 (Nice, 2003), pp. 215–221.
O. Jemai, M. Zaied, C. Amar, and M. Alimi, “Fast learning algorithm of wavelet network based on fast wavelet transform,” Int. J. Pattern Recogn. Artificial Intellig. 25 (08), 1297–1319 2011.
D. J. Newman, S. Hettich, C. L. Blake, and C. J. Merz, UCI Repository of Machine Learning Databases (Department of Information and Computer Science, Univ. of California, Irvine, CA, 1998). http://www.ics.uci.edu/mlearn/MLRepository.html
A. Hoang, “Supervised classifier performance on the uci database,” M.S. Thesis (Department of Computer Science, Univ. of Adelaide, 1997).
P. W. Eklund, “A performance survey of public domain supervised machine learning algorithms,” Australian J. Intellig. Syst. 9 (1), 1–47 (2006).
P. Eklund and A. Hoang, “A comparative study of public domain supervised classifier performance on the uci database,” Australian J. Intellig. Inf. Processing Syst. 9(1) (2006).
J.-T. Chien and C.-H. Chueh, “Joint acoustic and language modeling for speech ecognition,” Speech Commun. 52 (3), 223–235 (2010).
R. Ejbali, M. Zaied, and C. Ben Amar, “Wavelet network for recognition system of arabic word,” Int. J. Speech Technol. 13 (3), 163–174 (2010).
B. Guedri, M. Zaied, and C. Ben Amar, “Indexing and images retrieval by content,” in Proc. IEEE Int. Conf. on High Performance Computing and Simulation (HPCS) (Istanbul, 2011), pp. 369–375.
M. Zaied, R. Mohamed, and C. Ben Amar, “A power tool for contentbased image retrieval using multiresolution wavelet network modeling and dynamic histograms,” Int. Rev. Comput. Software (IRECOS) 7(4) (2012).
A. ElAdel, R. Ejbali, M. Zaied, and C. B. Amar, “A new semantic approach for cbir based on beta wavelet network modeling shape refined by texture and color features,” in Proc. 15th Int. Conf. on Intelligent Data Engineering and Automated Learning (IDEAL 2014) (Salamanca, 2014), pp. 378–385.
O. Jemai, M. Zaied, C. Amar, and M. Alimi, “Pyramidal hybrid approach: Wavelet network with ols algorithm-based image classification,” Int. J. Wavelets, Multiresolution Inf. Processing 9 (01), 111–130 (2011).
A. El Adel, M. Zaied, and C. Ben Amar, “Learning wavelet networks based on multiresolution analysis: application to images copy detection,” in Proc. IEEE Int. Conf. on Communications, Computing and Control Applications (CCCA) (Hammamet, 2011), pp. 1–6.
M. Zaied, I. Ben Abdennour, and C. Ben Amar, “Decision support system including fuzzy logic and multiresolution wavelet network modeling for content-based image retrieval,” Wulfenia J. 19 (10), 200–218 (2012).
T. Bouchrika, M. Zaied, O. Jemai, and C. Amar, “Neural solutions to interact with computers by hand gesture recognition,” J. Multimedia Tools Appl. 72 (3), 2949–2975 (2014).
T. Bouchrika, O. Jemai, M. Zaied, and C. B. Amar, “A new hand posture recognizer based on hybrid wavelet network including a fuzzy decision support system,” in Proc. 15th Int. Conf. on Intelligent Data Engineering and Automated Learning (IDEAL 2014) (Salamanca, 2014), pp. 183–190.
T. Bouchrika, O. Jemai, M. Zaied, and C. Ben Amar, “Cascaded hybrid wavelet network for hand gestures recognition, systems,” in Proc. 2014 IEEE Int. Conf. on Man and Cybernetics (SMC) (San Diego, 2014), pp. 1360–1365.
M. Zaied, I. Ben Gharat, R. Ejbali, and C. B. Amar, “Hands gestures recognition for virtual objects commanding in augmented reality applications,” in Proc. 5th Int. Conf. on Web and Information Technologie (ICWIT’13) (Hammamet, 2013).
D. Bousnina, R. Ejbali, M. Zaied, and C. B. Amar, “A wavelet network speech recognition system to control an augmented reality object,” in Proc. 9th Int. Conf. on Information Assurance and Security (IAS) (Kuala Lumpur, 2013), pp. 121–124.
R. Ejbali, M. Zaied and C. B. Amar, “Face recognition based on beta 2D elastic bunch graph matching,” in Proc. 13th Int. Conf. on Hybrid Intelligent Systems (HIS) (Gammarth, 2013), pp. 89–93.
I. Teyeb, O. Jemai, M. Zaied, and C. B. Amar, “A drowsy driver detection system based on a new method of head posture estimation,” in Proc. 15th Int. Conf. on Intelligent Data Engineering and Automated Learning (IDEAL 2014) (Salamanca, 2014), pp. 362–369.
H. Shao, T. Svoboda, and L. van Gool, “ZuBuD–Zurich Buildings Database for Image Based Recognition,” Tech. Rep. Technical Report (Computer Vision Lab., Swiss Federal Institute of Technology, Zurich, April 2003), No.260.
S. Moustakidis, G. Mallinis, N. Koutsias, J. B. Theocharis, and V. Petridis, “SVM-based fuzzy decision trees for classification of high spatial resolution remote sensing images,” IEEE Trans. Geosci. Remote Sensing 50 (1), 149–169 (2012).
H. Shao, T. Svoboda, V. Ferrari, T. Tuytelaars, and L. J. V. Gool, “Fast indexing for image retrieval based on local appearance with re-ranking,” in Proc. ICIP (Barcelona, 2003), pp. 737–740.
T. Deselaers, D. Keysers, and H. Ney, “Features for image retrieval: a quantitative comparison,” in Proc. DAGM Symp., Ser. Lecture Notes in Computer Science, Ed. by C. E. Rasmussen, H. H. Bolthoff, B. Schoolkopf, and M. A. Giese, (Springer, 2004), Vol. 3175, pp. 228–236.
L. Sirovich and M. Kirby, “Low-dimensional procedure for the characterization of human faces,” J. Opt. Soc. Am. A 4 (3), 519–524 (1987).
M. Turk and A. Pentland, “Face recognition using eigenfaces,” in Proc. IEEE Computer Society Conf. on Computer Vision and Pattern Recognition CVPR’91 (Lahaina, Jun. 1991), pp. 586–591.
D. Swets and J. Weng, “Using discriminant eigenfeatures for image retrieval,” IEEE Trans. Pattern Anal. Mach. Intellig. 18 (8), 831–836 (1996).
X. Zhang and Y. Gao, “Face recognition across pose: A review,” Pattern Recogn. 42 (11), 2876–2896 (2009).
W.-C. Kao, M.-C. Hsu, and Y.-Y. Yang, “Local contrast enhancement and adaptive feature extraction for illumination-invariant face recognition,” Pattern Recogn. 43 (5), 1736–1747 (2010).
H. Drira, B.B. Amor, A. Srivastava, M. Daoudi, and R. Slama, “3D face recognition under expressions, occlusions, and pose variations,” IEEE Trans. Pattern Anal. Mach. Intellig. 35 (9), 2270–2283 (2013).
M. Zaied, “Etude des réseaux d’ondelettes bêta: application à la reconnaissance de visages,” Ph.D. dissertation, Thèse de doctorat de l’Ecole Nationale d’Ingénieurs de Sfax (Département de génie informatique et mathématique appliquées, 2008).
W. Liu, Y. Wang, S. Z. Li, and T. Tan, “Null space approach of fisher discriminant analysis for face recognition.” in Proc._ECCV Workshop BioAW, ser. Lecture Notes in Computer Science, Ed. by D. Maltoni and A. K. Jain (Springer, 2004), Vol. 3087, pp. 32–44.
M. Zaied, S. Said, O. Jemai, and C. Amar, “A novel approach for face recognition based on fast learning algorithm and wavelet network theory,” Int. J. Wavelets, Multiresolution Inf. Processing 9 (06), 923–945 (2011).
T. C. Faltemier, K. W. Bowyer, and P. J. Flynn, “A region ensemble for 3D face recognition,” IEEE Trans. Inf. Forensics Security 3 (1), 62–73 (2008).
X. Lu and A. K. Jain, “Automatic feature extraction for multiview 3d face recognition,” in Proc. 7th Int. Conf. on Automatic Face and Gesture Recognition FGR 2006 (Southampton, 2006), pp. 585–590.
P. Besl and H. McKay, “A method for registration of 3D shapes,” IEEE Trans. Pattern Anal. Mach. Intellig. 14 (2), 239–256 (1992).
A. M. Bronstein, M. M. Bronstein, and R. Kimmel, “Three-dimensional face recognition,” Int. J. Comput. Vision 64 (1), 5–30 (2005).
C. Samir, A. Srivastava, and M. Daoudi, “Threedimensional face recognition using shapes of facial curves,” IEEE Trans. Pattern Anal. Mach. Intell. 28 (11), 1858–1863 (2006).
R. Afdhal, R. Ejbali, M. Zaied, and C. Ben Amar, “Emotion recognition using features distances classified by wavelets network and trained by fast wavelets transform,” in Proc. Int. Conf. on Hybrid Intelligent Systems (HIS) (Kuwait, 2014), pp. 238–241.
R. Ejbali, M. Zaied, and C. Ben Amar, “Face recognition based on beta 2D elastic bunch graph matching,” in Proc. Int. Conf. on Hybrid Intelligent Systems (HIS) (Gammarth, 2013), pp. 88–92.
Author information
Authors and Affiliations
Corresponding author
Additional information
The article is published in the original.
Ridha Ejbali. He was born in Kebili, Tunisia on 1978. He received the PhD degree in Computer Engineering, Master degree and computer engineer degree from the National Engineering School of Sfax Tunisia (ENIS) respectively in 2012, 2006, and 2004. He was assistant technologist at the Higher Institute of Technological Studies, Kebili Tunisia since 2005. He joined the faculty of sciences of Gabes Tunisia (FSG) where he becomes an assistant professor in the Department of computer sciences since 2012. His research area is now in pattern recognition and machine learning using Wavelets and Wavelet network theories. He has 25 publications. He has been an IEEE Senior Member, SPS society and member of REsearch Group on Intelligent Machines laboratory (REGIM-Lab) in ENIS since 2005.
Olfa JEMAI received her B.S. in Computer Science from the National School of Computer Sciences of Tunis (ENSI) in 1999. She obtained her M.S. and PhD degrees in Computer Engineering from the National Engineering School of Sfax (ENIS) in 2004 and 2010, respectively. She spent seven years as a Contractual assistant in the Higher Institute of Technologies and the Higher Institute of Computer Sciences and Multimedia of Gabes. In 2006, she joined the Gabes University as a permanent assistant. She is currently an assistant professor in the Department of Multimedia and Computer sciences of the Higher Institute of Computer Sciences and Multimedia of Gabes (ISIMG). Also, she has been a member of the REsearch Groups on Intelligent Machines laboratory (REGIM-Lab) since 2003. Her wide research areas include computer vision and image analysis. Her current research interests focus on Wavelets and Wavelet networks and their applications to data classification, image coding and computer vision. She was the chair of the Workshop on Intelligent Machines: Theories and Applications (17th WIMTA of 2010).
Mourad Zaied. He was born in Gabes Tunisia 1972. He received the HDR, the PhD degrees in Computer Engineering and the Master of science from the National Engineering School of Sfax, respectively in 2013, 2008, and 2003. He obtained the degree of Computer Engineer from the National Engineering School of Monastir in 1995. Since 1997, he had served in several institutes and faculties belonging to the university of Gabes as a teaching assistant. He joined in 2007 the National Engineering School of Gabes (ENIG) where he is currently an associate professor in the Department of Electrical Engineering. He has been a member of the REsearch Group on Intelligent Machines laboratory (REGIM-Lab) http://www.regim.org in the National Engineering School of Sfax (ENIS) since 2001. He has 65 publications. His research interests include Computer Vision and Image and video analysis. These research activities are centered around Wavelets and Wavelet networks and their applications to data classification and approximation, pattern recognition and image, audio and video coding and indexing. He is an IEEE member and he was the chair of the Workshop on Intelligent Machines: Theories and Applications (WIMTA II 2009) and he organized two Winter Schools on “the wavelet and its applications” in 2005 and on “Matlab toolkits” in 2004.
Rights and permissions
About this article
Cite this article
Ejbali, R., Jemai, O. & Zaied, M. A multiresolution wavelet networks architecture and its application to pattern recognition. Pattern Recognit. Image Anal. 27, 494–510 (2017). https://doi.org/10.1134/S1054661817030105
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S1054661817030105