Abstract
A novel pose normalization method, based on reflective symmetry computed on panoramic views, is presented. Qualitative and experimental investigation in 3D data-sets has led us to the observation that most objects possess a single plane of symmetry. Our approach is thus guided by this observation. Initially, through an iterative procedure, the symmetry plane of a 3D model is estimated, thus computing the first axis of the model. This is achieved by rotating the 3D model and computing reflective symmetry scores on panoramic view images. The other principal axes of the 3D model are estimated by computing the variance of the 3D model’s panoramic views. The proposed method is incorporated in a hybrid scheme, that serves as the pose normalization method in a state-of-the-art 3D object retrieval system. The effectiveness of this system, using the hybrid pose normalization scheme, is evaluated in terms of retrieval accuracy and the results clearly show improved performance against current approaches.










Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Alizadeh, F., Sutherland, A.: 3D model retrieval using the 2D poisson equation. In: Lambert, P. (ed.) CBMI, pp. 1–6. IEEE (2012). doi:10.1109/CBMI.2012.6269797
Axenopoulos, A., Litos, G., Daras, P.: 3D model retrieval using accurate pose estimation and view-based similarity. In: Natale, F.G.B.D., Bimbo, A.D., Hanjalic, A., Manjunath, B.S., Satoh, S. (eds.) ICMR, p. 41. ACM (2011). doi:10.1145/1991996.1992037
Chaouch, M., Verroust-Blondet, A.: 3D model retrieval based on depth line descriptor. In: ICME, pp. 599–602. IEEE (2007). doi:10.1109/ICME.2007.4284721
Chaouch, M., Verroust-Blondet, A.: Alignment of 3D models. Graph. Models 71(2), 63–76 (2009). doi:10.1016/j.gmod.2008.12.006
yun Chen, D., Ouhyoung, M.: A 3D model alignment and retrieval system. In: Proceedings of International Computer Symposium, Workshop on Multimedia Technologies (dec 2002, pp. 1436–1443 (2002)
Chen, D.Y., Tian, X.P., Shen, Y.T., Ouhyoung, M.: On visual similarity based 3D model retrieval. Comput. Graph. Forum 22(3), 223–232 (2003). doi:10.1111/1467-8659.00669
Elad, M., Tal, A., Ar, S.: Content based retrieval of VRML objects: an iterative and interactive approach. In: Proceedings of the 6th Eurographics workshop on Multimedia 2001, pp. 107–118. Springer, New York (2002)
Fang, R., Godil, A., Li, X., Wagan, A.: A new shape benchmark for 3D object retrieval. In: Bebis, G., Boyle, R.D., Parvin, B., Koracin, D., Remagnino, P., Porikli, F.M., Peters, J., Klosowski, J.T., Arns, L.L., Chun, Y.K., Rhyne, T.M., Monroe, L. (eds.) ISVC (1), Lecture Notes in Computer Science, vol. 5358, pp. 381–392. Springer, Berlin (2008). doi:10.1007/978-3-540-89639-5_37
Furuya, T., Ohbuchi, R.: Dense sampling and fast encoding for 3D model retrieval using bag-of-visual features. In: Marchand-Maillet, S., Kompatsiaris, Y. (eds.) CIVR. ACM (2009). doi:10.1145/1646396.1646430
Geurts, P., Ernst, D., Wehenkel, L.: Extremely randomized trees. Mach. Learn. 63(1), 3–42 (2006). doi:10.1007/s10994-006-6226-1
Gorelick, L., Galun, M., Sharon, E., Basri, R., Brandt, A.: Shape representation and classification using the poisson equation. Pattern Anal. Mach. Intell. IEEE Trans. 28(12), 1991–2005 (2006). doi:10.1109/TPAMI.2006.253
Jayanti, S., Kalyanaraman, Y., Iyer, N., Ramani, K.: Developing an engineering shape benchmark for CAD models. Comput. Aided Des. 38(9), 939–953 (2006). doi:10.1016/j.cad.2006.06.007
Kazhdan, M.M.: An approximate and efficient method for optimal rotation alignment of 3D models. IEEE Trans. Pattern Anal. Mach. Intell. 29(7), 1221–1229 (2007). doi:10.1109/TPAMI.2007.1032
Kazhdan, M.M., Chazelle, B., Dobkin, D.P., Finkelstein, A., Funkhouser, T.A.: A reflective symmetry descriptor. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV (2), Lecture Notes in Computer Science, vol. 2351, pp. 642–656. Springer, Berlin (2002). doi:10.1007/3-540-47967-8_43
Kazhdan, M.M., Funkhouser, T.A., Rusinkiewicz, S.: Rotation invariant spherical harmonic representation of 3D shape descriptors. In: Kobbelt, L., Schröder, P., Hoppe, H. (eds.) Symposium on Geometry Processing, ACM International Conference Proceeding Series, vol. 43, pp. 156–164. Eurographics Association (2003)
Kazhdan, M.M., Funkhouser, T.A., Rusinkiewicz, S.: Symmetry descriptors and 3D shape matching. In: Boissonnat, J.D., Alliez, P. (eds.) Symposium on Geometry Processing, ACM International Conference Proceeding Series, vol. 71, pp. 115–123. Eurographics Association (2004). doi:10.1145/1057432.1057448
Kim, D.H., Park, I.K., Yun, I.D., Lee, S.U.: A new MPEG-7 standard: Perceptual 3D shape descriptor. In: Aizawa, K., Nakamura, Y., Satoh, S. (eds.) PCM (2), Lecture Notes in Computer Science, vol. 3332, pp. 238–245. Springer, Berlin (2004)
Li, B., Godil, A., Aono, M., Bai, X., Furuya, T., Li, L., López-Sastre, R., Johan, H., Ohbuchi, R., Redondo-Cabrera, C., et al.: Shrec’12 track: generic 3d shape retrieval. In: Proceedings of the 5th Eurographics conference on 3D Object Retrieval, pp. 119–126. Eurographics Association (2012)
Li, B., Johan, H.: 3d model retrieval using hybrid features and class information. Multimed. Tools Appl. 62(3), 821–846 (2013). doi:10.1007/s11042-011-0873-3
Lian, Z., Rosin, P.L., Sun, X.: Rectilinearity of 3D meshes. Int. J. Comput. Vis. 89(2–3), 130–151 (2010). doi:10.1007/s11263-009-0295-0
Lowe, D.G.: Object recognition from local scale-invariant features. In: Proceedings of the Seventh IEEE International Conference on Computer Vision, vol. 2, pp.1150–1157 (1999). doi:10.1109/ICCV.1999.790410
Lv, D., Sun, J.F., Li, Q., Wang, Q.: 3D pose estimation of ground rigid target based on ladar range image. Appl. Opt. 52(33), 8073–8081 (2013)
Martinet, A., Soler, C., Holzschuch, N., Sillion, F.X.: Accurate detection of symmetries in 3D shapes. ACM Trans. Graph. 25(2), 439–464 (2006). doi:10.1145/1138450.1138462
Mitra, N.J., Guibas, L.J., Pauly, M.: Partial and approximate symmetry detection for 3D geometry. ACM Trans. Graph. 25(3), 560–568 (2006). doi:10.1145/1141911.1141924
Ohbuchi, R., Furuya, T.: Scale-weighted dense bag of visual features for 3D model retrieval from a partial view 3D model. In: Computer Vision Workshops (ICCV Workshops), 2009 IEEE 12th International Conference on, pp. 63–70 (2009). doi:10.1109/ICCVW.2009.5457716
Ohbuchi, R., Osada, K., Furuya, T., Banno, T.: Salient local visual features for shape-based 3D model retrieval. In: Shape Modeling International, pp. 93–102. IEEE (2008). doi:10.1109/SMI.2008.4547955
Osada, R., Funkhouser, T.A., Chazelle, B., Dobkin, D.P.: Shape distributions. ACM Trans. Graph. 21(4), 807–832 (2002). doi:10.1145/571647.571648
Papadakis, P., Pirri, F.: Consistent pose normalization of non-rigid shapes using one-class support vector machines. In: Computer Vision and Pattern Recognition Workshops (CVPRW), 2011 IEEE Computer Society Conference on, pp. 23–30 (2011). doi:10.1109/CVPRW.2011.5981714
Papadakis, P., Pratikakis, I., Perantonis, S.J., Theoharis, T.: Efficient 3D shape matching and retrieval using a concrete radialized spherical projection representation. Pattern Recognit. 40(9), 2437–2452 (2007). doi:10.1016/j.patcog.2006.12.026
Papadakis, P., Pratikakis, I., Theoharis, T., Passalis, G., Perantonis, S.J.: 3D object retrieval using an efficient and compact hybrid shape descriptor. In: Perantonis, S.J., Sapidis, N.S., Spagnuolo, M., Thalmann, D. (eds.) 3DOR, pp. 9–16. Eurographics Association (2008). doi:10.2312/3DOR/3DOR08/009-016
Papadakis, P., Pratikakis, I., Theoharis, T., Perantonis, S.J.: Panorama: a 3d shape descriptor based on panoramic views for unsupervised 3d object retrieval. Int. J. Comput. Vis. 89(2–3), 177–192 (2010). doi:10.1007/s11263-009-0281-6
Paquet, E., Rioux, M., Murching, A.M., Naveen, T., Tabatabai, A.J.: Description of shape information for 2D and 3D objects. Signal Proc. Image Commun. 16(1–2), 103–122 (2000). doi:10.1016/S0923-5965(00)00020-5
Podolak, J., Shilane, P., Golovinskiy, A., Rusinkiewicz, S., Funkhouser, T.A.: A planar-reflective symmetry transform for 3D shapes. ACM Trans. Graph. 25(3), 549–559 (2006). doi:10.1145/1141911.1141923
Rustamov, R.M.: Augmented symmetry transforms. In: Shape Modeling International, pp. 13–20. IEEE Computer Society (2007). doi:10.1109/SMI.2007.6
Sfikas, K., Pratikakis, I., Theoharis, T.: Sympan: 3d model pose normalization via panoramic views and reflective symmetry. In: Castellani, U., Schreck, T., Biasotti, S., Pratikakis, I., Godil, A., Veltkamp, R.C. (eds.) 3DOR, pp. 41–48. Eurographics Association (2013)
Sfikas, K., Theoharis, T., Pratikakis, I.: ROSy+: 3D object pose normalization based on PCA andreflective object symmetry with application in 3D object retrieval. Int. J. Comput. Vis. 91(3), 262–279 (2011). doi:10.1007/s11263-010-0395-x
Shilane, P., Min, P., Kazhdan, M.M., Funkhouser, T.A.: The princeton shape benchmark. In: SMI, pp. 167–178. IEEE Computer Society (2004). doi:10.1109/SMI.2004.63
Tatsuma, A., Aono, M.: Multi-fourier spectra descriptor and augmentation with spectral clustering for 3d shape retrieval. Vis. Comput. 25(8), 785–804 (2009). doi:10.1007/s00371-008-0304-2
Theodoridis, S., Koutroumbas, K.: Pattern recognition. 3rd edn. Academic Press, Inc., Orlando, FL (2006). ISBN 0123695317
Vranic, D.V.: 3D model retrieval. Ph.D. thesis (2004)
Vranic, D.V.: DESIRE: a composite 3D-shape descriptor. In: ICME, pp. 962–965. IEEE (2005). doi:10.1109/ICME.2005.1521584
Vranić, D.V., Saupe, D., Richter, J.: Tools for 3D-object retrieval: Karhunen-loeve transform and spherical harmonics. IEEE MMSP 2001, 293–298 (2001)
Yuan, H., Pang, M., Lu, Z.P.: Pose normalization based on rotation transformation. Key Eng. Mater. 464, 453–456 (2011)
Zaharia, T., Preteux, F.J.: 3D-shape-based retrieval within the MPEG-7 framework. pp. 133–145. SPIE (2001). doi:10.1117/12.424969
Zaharia, T.B., Prêteux, F.J.: 3D versus 2D/3D shape descriptors: a comparative study. In: Dougherty, E.R., Astola, J., Egiazarian, K.O. (eds.) Image Processing: Algorithms and Systems, SPIE Proceedings, vol. 5289, pp. 47–58. SPIE (2004). doi:10.1117/12.533092
Zhang, J., Huebner, K.: Using symmetry as a feature in panoramic images for mobile robot applications In : Proceedings of Robotik 2002, VDI-Berichte, vol. 1679, pp. 263–268. Ludwigsburg (2002). http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.72.1017
Acknowledgments
This research has been co-financed by the European Union (European Social Fund—ESF) and Greek national funds through the Operational Program “Education and Lifelong Learning” of the National Strategic Reference Framework (NSRF)-Research Funding Program: THALES-3DOR (MIS 379516). Investing in knowledge society through the European Social Fund.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Sfikas, K., Theoharis, T. & Pratikakis, I. Pose normalization of 3D models via reflective symmetry on panoramic views. Vis Comput 30, 1261–1274 (2014). https://doi.org/10.1007/s00371-014-0935-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-014-0935-4