Cited By
View all- Cannavò AGatteschi VMacis LLamberti F(2022)Automatic Generation of 3D Animations from Text and ImagesExtended Reality10.1007/978-3-031-15546-8_6(77-91)Online publication date: 6-Jul-2022
An Automatic 3D Scene Generation Pipeline Based on a Single 2D Image
Authors: 
Alberto Cannavò, Christian Bardella, Lorenzo Semeraro, Federico De Lorenzis, Congyi Zhang, Ying Jiang, Fabrizio LambertiAuthors Info & Claims
Alberto Cannavò, Christian Bardella, Lorenzo Semeraro, Federico De Lorenzis, Congyi Zhang, Ying Jiang, Fabrizio LambertiAuthors Info & ClaimsPages 109 - 117
Abstract
In the last years, solutions were proposed in the literature to alleviate the complexity of using sophisticated graphic suites for 3D scene generation by leveraging automatic tools. The most common approach based on the processing of text descriptions, however, may not represent the ideal solution, e.g., for fast prototyping purposes. This paper proposes an alternative methodology able to extract information about the objects and the layout of the scene to be created from a single 2D image. Compared to previous works, experimental results reported in this work show improvements in terms of similarity between the 2D and 3D scenes.
References
[1]
Cannavò, A., D’Alessandro, A., Maglione, D., Marullo, G., Zhang, C., Lamberti, F.: Automatic generation of affective 3D virtual environments from 2D images. In: Proceedings of the International Conference on Computer Graphics Theory and Applications, pp. 113–124 (2020)
[2]
Cannavò A, Demartini C, Morra L, and Lamberti F Immersive virtual reality-based interfaces for character animation IEEE Access 2019 7 125463-125480
[3]
Cannavò, A., Lamberti, F.: A virtual character posing system based on reconfigurable tangible user interfaces and immersive virtual reality. In: Proceedings of the Smart Tools and Applications for Graphics - Eurographics Italian Chapter Conference, pp. 1–11 (2018)
[4]
Chang, A., Savva, M., Manning, C.: Interactive learning of spatial knowledge for text to 3D scene generation. In: Proceedings of the Workshop on Interactive Language Learning, Visualization, and Interfaces, pp. 14–21 (2014)
[5]
Chang, A.X., Eric, M., Savva, M., Manning, C.D.: SceneSeer: 3D scene design with natural language. arXiv preprint arXiv:1703.00050 (2017)
[6]
Esteban, I., Dijk, J., Groen, F.C.: From images to 3D models made easy. In: Proceedings of the 19th ACM International Conference on Multimedia, pp. 695–698 (2011)
[7]
Laina, I., Rupprecht, C., Belagiannis, V., Tombari, F., Navab, N.: Deeper depth prediction with fully convolutional residual networks. In: 4th International Conference on 3D Vision, pp. 239–248 (2016)
[8]
Lu, J., Li, C., Yin, C., Ma, L.: A new framework for automatic 3d scene construction from text description. In: Proceedings of IEEE International Conference on Progress in Informatics and Computing, vol. 2, pp. 964–968 (2010)
[9]
Lu, X., Yaoy, J., Li, H., Liu, Y., Zhang, X.: 2-line exhaustive searching for real-time vanishing point estimation in Manhattan world. In: Proceedings of the IEEE Winter Conference on Applications of Computer Vision, pp. 345–353 (2017)
[10]
Oliveira, B., Azulay, D., Carvalho, P.: GVRf and blender: a path for android apps and games development. In: Proceedings of the International Conference on Human-Computer Interaction, pp. 329–337 (2019)
[11]
Payne, B.R., Lay, J.F., Hitz, M.A.: Automatic 3D object reconstruction from a single image. In: Proceedings of the ACM Southeast Regional Conference, p. 31 (2014)
[12]
Sra, M., Maes, P., Vijayaraghavan, P., Roy, D.: Auris: creating affective virtual spaces from music. In: Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology, p. 26 (2017)
[13]
Vouzounaras G, Daras P, and Strintzis MG Automatic generation of 3D outdoor and indoor building scenes from a single image Multimedia Tools Appl. 2011 70 1 361-378
[14]
Xu K, Stewart J, and Fiume E Constraint-based automatic placement for scene composition Proc. Graph. Interface 2002 2 25-34
Index Terms
- An Automatic 3D Scene Generation Pipeline Based on a Single 2D Image
Index terms have been assigned to the content through auto-classification.
Recommendations
3D-modeling by ortho-image generation from image sequences
A semi-automatic approach is presented that enables the generation of a high-quality 3D model of a static object from an image sequence that was taken by a moving, uncalibrated consumer camera. A bounding box is placed around the object, and ...
Automatic Scene Inference for 3D Object Compositing
We present a user-friendly image editing system that supports a drag-and-drop object insertion (where the user merely drags objects into the image, and the system automatically places them in 3D and relights them appropriately), postprocess illumination ...
Physically-Based Editing of Indoor Scene Lighting from a Single Image
Computer Vision – ECCV 2022AbstractWe present a method to edit complex indoor lighting from a single image with its predicted depth and light source segmentation masks. This is an extremely challenging problem that requires modeling complex light transport, and disentangling HDR ...
Comments
Information & Contributors
Information
Published In
Sep 2021
743 pages
ISBN:978-3-030-87594-7
DOI:10.1007/978-3-030-87595-4
© Springer Nature Switzerland AG 2021.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 07 September 2021
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 14 Oct 2024
Other Metrics
Citations
Cited By
View all- Cannavò AGatteschi VMacis LLamberti F(2022)Automatic Generation of 3D Animations from Text and ImagesExtended Reality10.1007/978-3-031-15546-8_6(77-91)Online publication date: 6-Jul-2022
View Options
View options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in