research-article

Context-based search for 3D models

Authors:

Matthew Fisher,

Pat HanrahanAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 29, Issue 6

Article No.: 182, Pages 1 - 10

https://doi.org/10.1145/1882261.1866204

Published: 15 December 2010 Publication History

Abstract

Large corpora of 3D models, such as Google 3D Warehouse, are now becoming available on the web. It is possible to search these databases using a keyword search. This makes it possible for designers to easily include existing content into new scenes. In this paper, we describe a method for context-based search of 3D scenes. We first downloaded a large set of scene graphs from Google 3D Warehouse. These scene graphs were segmented into individual objects. We also extracted tags from the names of the models. Given the object shape, tags, and spatial relationship between pairs of objects, we can predict the strength of a relationship between a candidate model and an existing object in the scene. Using this function, we can perform context-based queries. The user specifies a region in the scene they are modeling using a 3D bounding box, and the system returns a list of related objects. We show that context-based queries perform better than keyword queries alone, and that without any keywords our algorithm still returns a relevant set of models.

References

[1]

Chen, D., Tian, X., Shen, Y., and Ouhyoung, M. 2003. On visual similarity based 3D model retrieval. In Computer graphics forum, vol. 22, Amsterdam: North Holland, 1982-, 223--232.

[2]

Fellbaum, C., et al. 1998. WordNet: An electronic lexical database. MIT press Cambridge, MA.

[3]

Funkhouser, T., and Shilane, P. 2006. Partial matching of 3D shapes with priority-driven search. In Proceedings of the fourth Eurographics symposium on Geometry processing, Eurographics Association, 142.

Digital Library

[4]

Funkhouser, T., Min, P., Kazhdan, M., Chen, J., Halderman, A., Dobkin, D., and Jacobs, D. 2003. A search engine for 3D models. ACM Transactions on Graphics 22, 1, 83--105.

Digital Library

[5]

Funkhouser, T., Kazhdan, M., Shilane, P., Min, P., Kiefer, W., Tal, A., Rusinkiewicz, S., and Dobkin, D. 2004. Modeling by example. In ACM SIGGRAPH, ACM, 663.

Digital Library

[6]

Galleguillos, C., Rabinovich, A., and Belongie, S. 2008. Object categorization using co-occurrence, location and appearance. In IEEE Conference on Computer Vision and Pattern Recognition, 2008. CVPR 2008, 1--8.

[7]

Goldfeder, C., and Allen, P. 2008. Autotagging to improve text search for 3d models. In JCDL '08: Proceedings of the 8th ACM/IEEE-CS joint conference on Digital libraries, ACM, New York, NY, USA, 355--358.

Digital Library

[8]

Hays, J., and Efros, A. A. 2007. Scene completion using millions of photographs. ACM Transactions on Graphics (SIGGRAPH 2007) 26, 3.

Digital Library

[9]

He, X., Zemel, R., and Carreira-Perpinán, M. 2004. Multiscale conditional random fields for image labeling. CVPR, 695--702.

Digital Library

[10]

Malisiewicz, T., and Efros, A. A. 2009. Beyond categories: The visual memex model for reasoning about object relationships. In NIPS.

[11]

Min, P., Kazhdan, M., and Funkhouser, T. 2004. A comparison of text and shape matching for retrieval of online 3D models. Research and Advanced Technology for Digital Libraries, 209--220.

[12]

Novotni, M., and Klein, R. 2003. 3D Zernike descriptors for content based shape retrieval. In Solid modeling and applications, ACM, 225.

Digital Library

[13]

Papadakis, P., Pratikakis, I., Trafalis, T., Theoharis, T., and Perantonis, S. 2008. Relevance Feedback in Content-based 3D Object Retrieval: A Comparative Study. Computer-Aided Design and Applications Journal 5, 5.

[14]

Rabinovich, A., Vedaldi, A., Galleguillos, C., Wiewiora, E., and Belongie, S. 2007. Objects in context. IEEE 11th International Conference on Computer Vision, 1--8.

[15]

Russell, B., Torralba, A., Murphy, K., and Freeman, W. 2008. LabelMe: a database and web-based tool for image annotation. International Journal of Computer Vision 77, 1, 157--173.

Digital Library

[16]

Salton, G., Wong, A., and Yang, C. S. 1975. A vector space model for automatic indexing. Commun. ACM 18, 11, 613--620.

Digital Library

[17]

Shilane, P., Min, P., Kazhdan, M., and Funkhouser, T. 2004. The princeton shape benchmark. In Shape Modeling International.

[18]

Strat, T. M., and Fischler, M. A. 1991. Context-based vision: Recognizing objects using information from both 2d and 3d imagery. IEEE PAMI 13, 1050--1065.

Digital Library

[19]

Torralba, A., 2010. The context challenge. http://web.mit.edu/torralba/www/carsAndFacesInContext.html.

Cited By

Zhang SXie WWang CZhang S(2024)ScenePalette: Contextually Exploring Object Collections Through Multiplex Relations in 3D ScenesJournal of Computer Science and Technology10.1007/s11390-022-2194-639:5(1180-1192)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1007/s11390-022-2194-6
Pronina OAynahoz A(2023)A system for finding identical geometries when building 3-D modelsReporter of the Priazovskyi State Technical University. Section: Technical sciencesВестник Приазовского государственного технического университета. Серия: Технические наукиВісник Приазовського Державного Технічного Університету. Серія: Технічні науки10.31498/2225-6733.47.2023.299984(82-88)Online publication date: 28-Dec-2023
https://doi.org/10.31498/2225-6733.47.2023.299984
Meltzer PLambourne JGrandi D(2023)What’s in a Name? Evaluating Assembly-Part Semantic Knowledge in Language Models Through User-Provided Names in Computer Aided Design FilesJournal of Computing and Information Science in Engineering10.1115/1.406245424:1Online publication date: 23-Jun-2023
https://doi.org/10.1115/1.4062454
Show More Cited By

Context-based search for 3D models
1. Computing methodologies
  1. Computer graphics

Recommendations

Context-based search for 3D models
SIGGRAPH ASIA '10: ACM SIGGRAPH Asia 2010 papers

Large corpora of 3D models, such as Google 3D Warehouse, are now becoming available on the web. It is possible to search these databases using a keyword search. This makes it possible for designers to easily include existing content into new scenes. In ...
Characterizing structural relationships in scenes using graph kernels
SIGGRAPH '11: ACM SIGGRAPH 2011 papers

Modeling virtual environments is a time consuming and expensive task that is becoming increasingly popular for both professional and casual artists. The model density and complexity of the scenes representing these virtual environments is rising ...
A search engine for 3D models

As the number of 3D models available on the Web grows, there is an increasing need for a search engine to help people find them. Unfortunately, traditional text-based search techniques are not always effective for 3D data. In this article, we ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 29, Issue 6

December 2010

480 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1882261

Issue’s Table of Contents

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 December 2010

Published in TOG Volume 29, Issue 6

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

76
Total Citations
View Citations
1,273
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)0

Reflects downloads up to 25 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zhang SXie WWang CZhang S(2024)ScenePalette: Contextually Exploring Object Collections Through Multiplex Relations in 3D ScenesJournal of Computer Science and Technology10.1007/s11390-022-2194-639:5(1180-1192)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1007/s11390-022-2194-6
Pronina OAynahoz A(2023)A system for finding identical geometries when building 3-D modelsReporter of the Priazovskyi State Technical University. Section: Technical sciencesВестник Приазовского государственного технического университета. Серия: Технические наукиВісник Приазовського Державного Технічного Університету. Серія: Технічні науки10.31498/2225-6733.47.2023.299984(82-88)Online publication date: 28-Dec-2023
https://doi.org/10.31498/2225-6733.47.2023.299984
Meltzer PLambourne JGrandi D(2023)What’s in a Name? Evaluating Assembly-Part Semantic Knowledge in Language Models Through User-Provided Names in Computer Aided Design FilesJournal of Computing and Information Science in Engineering10.1115/1.406245424:1Online publication date: 23-Jun-2023
https://doi.org/10.1115/1.4062454
Fu QHe SFu HLi XDeng Z(2023)Fuzzy-based indoor scene modeling with differentiated examplesComputational Visual Media10.1007/s41095-022-0299-z9:4(717-732)Online publication date: 23-May-2023
https://doi.org/10.1007/s41095-022-0299-z
Kuo LLin YChang TLai C(2023)Test the configuration and color of 3D model space design with web multimedia interfaceMultimedia Tools and Applications10.1007/s11042-023-17000-683:11(33107-33121)Online publication date: 25-Sep-2023
https://doi.org/10.1007/s11042-023-17000-6
WU FYAN FSHI WZHOU Z(2022)3D scene graph prediction from point cloudsVirtual Reality & Intelligent Hardware10.1016/j.vrih.2022.01.0054:1(76-88)Online publication date: Feb-2022
https://doi.org/10.1016/j.vrih.2022.01.005
Liang YFan LRen PXie XHua X(2021)DecorIn: An Automatic Method for Plane-Based DecoratingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.297289727:8(3438-3450)Online publication date: 1-Aug-2021
https://doi.org/10.1109/TVCG.2020.2972897
Liang HLv KSun YZhang QPan MChang J(2021)Semantic-Driven 3D Scene Construction Based on Spatial Relationship and Case-Base2021 IEEE 7th International Conference on Virtual Reality (ICVR)10.1109/ICVR51878.2021.9483826(54-61)Online publication date: 20-May-2021
https://doi.org/10.1109/ICVR51878.2021.9483826
Barreau JEsnault EFoucher JSix MLe Faou C(2020)3D modelling of a 15th century city gate of Rennes: Portes MordelaisesVirtual Archaeology Review10.4995/var.2020.1265311:22(41)Online publication date: 28-Jan-2020
https://doi.org/10.4995/var.2020.12653
Zhang ZYang ZMa CLuo LHuth AVouga EHuang Q(2020)Deep Generative Modeling for Scene Synthesis via Hybrid RepresentationsACM Transactions on Graphics10.1145/338186639:2(1-21)Online publication date: 9-Apr-2020
https://dl.acm.org/doi/10.1145/3381866
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents