research-article

Visibility-driven processing of streaming volume data

Authors:

Veronika Solteszova,

Åsmund Birkeland,

Stefan BrucknerAuthors Info & Claims

VCBM '14: Proceedings of the 4th Eurographics Workshop on Visual Computing for Biology and Medicine

Pages 127 - 136

Published: 04 September 2014 Publication History

Abstract

In real-time volume data acquisition, such as 4D ultrasound, the raw data is challenging to visualize directly without additional processing. Noise removal and feature detection are common operations, but many methods are too costly to compute over the whole volume when dealing with live streamed data. In this paper, we propose a visibility-driven processing scheme for handling costly on-the-fly processing of volumetric data in real-time. In contrast to the traditional visualization pipeline, our scheme utilizes a fast computation of the potentially visible subset of voxels which significantly reduces the amount of data required to process. As filtering operations modify the data values which may affect their visibility, our method for visibility-mask generation ensures that the set of elements deemed visible does not change after processing. Our approach also exploits the visibility information for the storage of intermediate values when multiple operations are performed in sequence, and can therefore significantly reduce the memory overhead of longer filter pipelines. We provide a thorough technical evaluation of the approach and demonstrate it on several typical scenarios where on-the-fly processing is required.

References

[1]

{BBBV12} Birkeland Å., Bruckner S., Brambilla A., Viola I.: Illustrative membrane clipping. Computer Graphics Forum 31, 3 (2012), 905--914. 4

Digital Library

[2]

{BHMF08} Beyer J., Hadwiger M., Möller T., Fritz L.: Smooth mixed-resolution gpu volume rendering. In Proceedings of Point-Based Graphics 2008 (2008), pp. 163--170. 3

Digital Library

[3]

{BJE^*11} Bruder R., Jauer P., Ernst F., Richter L., Schweikard A.: Real-time 4d ultrasound visualization with the voreen framework. In Proceedings of ACM SIGGRAPH 2011 Posters (2011), pp. 74:1--74:1. 3

Digital Library

[4]

{BNS01} Boada I., Navazo I., Scopigno R.: Multiresolution volume visualization with a texture-based octree. The Visual Computer 17, 3 (2001), 185--197. 3

[5]

{BW03} Bittner J., Wonka P.: Visibility in computer graphics. Journal of Environment and Planning B: Planning and Design 5, 30 (2003), 729--756. 3

[6]

{CNLE09} Crassin C., Neyret F., Lefebvre S., Eisemann E.: Gigavoxels: Ray-guided streaming for efficient and detailed voxel rendering. In Proceedings of Symposium on Interactive 3D Graphics and Games (2009), ACM, pp. 15--22. 3

Digital Library

[7]

{COCSD03} Cohen-Or D., Chrysanthou Y. L., Silva C. T., Durand F.: A survey of visibility for walkthrough applications. IEEE Transactions on Visualization and Computer Graphics 9, 3 (2003), 412--431. 3

Digital Library

[8]

{DWS^*88} Deering M., Winner S., Schediwy B., Duffy C., Hunt N.: The triangle processor and normal vector shader: A vlsi system for high performance graphics. ACM SIGGRAPH Computer Graphics 22, 4 (1988), 21--30. 3

Digital Library

[9]

{EEH^*09} Elnokrashy A., Elmalky A., Hosny T., Ellah M., Megawer A., Elsebai A., Youssef A.-B., Kadah Y.: Gpu-based reconstruction and display for 4d ultrasound data. In Proceedings of the IEEE International Ultrasonics Symposium 2009 (2009), pp. 189--192. 3

[10]

{EKE01} Engel K., Kraus M., Ertl T.: High-quality pre-integrated volume rendering using hardware accelerated pixel shading. In Proceedings of the ACM SIGGRAPH/EG Workshop on Graphics Hardware 2001 (2001), pp. 9--16. 5

Digital Library

[11]

{FNVV98} Frangi A. F., Niessen W. J., Vincken K. L., Viergever M. A.: Multiscale vessel enhancement filtering. In Proceedings of Medical Image Computing and Computer--Assisted Intervention (1998), pp. 130--137. 4

Digital Library

[12]

{FSK13} Fogal T., Schiewe A., Krüger J.: An analysis of scalable GPU-based ray-guided volume rendering. In IEEE Symposium on Large Data Analysis and Visualization (2013). 3

[13]

{GM05} Gobbetti E., Marton F.: Far Voxels -- a multiresolution framework for interactive rendering of huge complex 3d models on commodity graphics platforms. ACM Transactions on Graphics 24, 3 (2005), 878--885. 3

Digital Library

[14]

{HBJP12} Hadwiger M., Beyer J., Jeong W.-K., Pfister H.: Interactive volume exploration of petascale microscopy data streams using a visualization-driven virtual memory approach. IEEE Transactions of Visualization and Computer Graphics 18, 2 (2012), 2285--2294. 3, 5

Digital Library

[15]

{HHSG05} Hadwiger M., Henning Scharsach K. B., Gross M.: Real-time ray-casting and advanced shading of discrete isosurfaces. Computer Graphics Forum 24, 3 (2005), 303--312. 3

[16]

{HKG00} Hladuvka J., König A., Gröller M. E.: Curvature-based transfer functions for direct volume rendering. In Proceedings of Spring Conference of Computer Graphics (2000), pp. 58--65. 3

[17]

{Ion10} Ionescu C.: The benefits of 3D-4D fetal echocardiography. Maedica (Buchar) 5, 1 (2010), 45--50. 2

[18]

{JBH^*09} Jeong W.-K., Beyer J., Hadwiger M., Vazquez A., Pfister H., Whitaker R. T.: Scalable and interactive segmentation and visualization of neural processes in em datasets. IEEE Transactions on Visualization and Computer Graphics 15, 6 (2009), 1505--1514. 3

Digital Library

[19]

{KE02} Kraus M., Ertl T.: Adaptive texture maps. In Proceedings of ACM SIGGRAPH/EG Conference on Graphics Hardware (2002), pp. 7--15. 3

Digital Library

[20]

{KLF05} Kniss J., Lefohn A., Fout N.: Deferred Filtering: Rendering from Difficult Data Formats. Addison Wesley, 2005, ch. 41, pp. 669--677. 3

[21]

{KWTM03} Kindlmann G., Whitaker R., Tasdizen T., Moller T.: Curvature-based transfer functions for direct volume rendering: Methods and applications. In Proceedings of IEEE Visualization (2003), pp. 513--520. 3

Digital Library

[22]

{Lev90} Levoy M.: Efficient ray tracing of volume data. ACM Transactions on Graphics 9, 3 (1990), 245--261. 3

Digital Library

[23]

{LL94} Lacroute P., Levoy M.: Fast volume rendering using a shear-warp factorization of the viewing transformation. In Proceedings of ACM SIGGRAPH 1994 (1994), pp. 451--458. 3

Digital Library

[24]

{LLY06} Ljung P., Lundström C., Ynnerman A.: Multiresolution interblock interpolation in direct volume rendering. In Proceedings of EuroVis 2006 (2006), pp. 259--266. 3

Digital Library

[25]

{LV11} Lebit F.-D., Vladareanu R.: The role of 4d ultrasound in the assessment of fetal behaviour. Maedica (Buchar) 6, 2 (2011), 120--127. 2

[26]

{MJC02} Mora B., Jessel J.-P., Caubet R.: A new object-order ray-casting algorithm. In Proceedings of IEEE Visualization 2002 (2002), pp. 203--210. 3

Digital Library

[27]

{NPH^*00} Nelson T., Pretorius D., Hull A., Riccabona M., Sklansky M., James G.: Sources and impact of artifacts on clinical three-dimensional ultrasound imaging. Ultrasound in Obstetrics & Gynecology 16, 4 (2000), 374--383. 2

[28]

{PM87} Perona P., Malik J.: Scale-space and edge detection using anisotropic diffusion. In Proceedings of IEEE Computer Society Workshop on Computer Vision (1987), pp. 16--22. 4

[29]

{PVMd12} Perri D., Vasilyev N., Marx G., del Nido P.: Temporal enhancement of 3d echocardiography by frame re-ordering. J Am Coll Cardiol Img 5, 3 (2012), 300--304. 9

[30]

{TM99} Tomasi C., Manduchi R.: Bilateral filtering for gray and color images. In Proceedings of International Conference on Computer Vision (1999), pp. 839--846. 4

Digital Library

[31]

{vPBV10} Šoltészová V., Patel D., Bruckner S., Viola I.: A multidirectional occlusion shading model for direct volume rendering. Computer Graphics Forum 29, 3 (2010), 883--891. 8

Digital Library

[32]

{vSHW^*12} šoltészová V., Sævil-Helljesen L. E., Wein W., Gilja O. H., Viola I.: Lowest-variance streamlines for filtering of 3d ultrasound. In Proceedings of EG Workshop on Visual Computing for Biomedicine (2012), pp. 41--48. 2, 4, 7

Cited By

Solteszova VBirkeland ÅStoppel SViola IBruckner S(2017)Output-Sensitive Filtering of Streaming Volume DataComputer Graphics Forum10.1111/cgf.1279936:1(249-262)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.1111/cgf.12799
Beyer JHadwiger MPfister H(2015)State-of-the-Art in GPU-Based Large-Scale Volume VisualizationComputer Graphics Forum10.1111/cgf.1260534:8(13-37)Online publication date: 1-Dec-2015
https://dl.acm.org/doi/10.1111/cgf.12605

Index Terms

Visibility-driven processing of streaming volume data
1. Computing methodologies
  1. Computer graphics
    1. Image manipulation
    2. Shape modeling
      1. Parametric curve and surface models

Recommendations

Visibility-driven progressive volume photon tracing

In this paper, we present a novel approach to progressive photon-based volume rendering techniques. By making use of two Kd-trees (built in a preprocessing step) to store view beams (primary rays intersecting the medium) and visible points, our method ...
Efficient Visibility Encoding for Dynamic Illumination in Direct Volume Rendering

We present an algorithm that enables real-time dynamic shading in direct volume rendering using general lighting, including directional lights, point lights, and environment maps. Real-time performance is achieved by encoding local and global volumetric ...
Output-Sensitive Filtering of Streaming Volume Data

Real-time volume data acquisition poses substantial challenges for the traditional visualization pipeline where data enhancement is typically seen as a pre-processing step. In the case of 4D ultrasound data, for instance, costly processing operations to ...

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

VCBM '14: Proceedings of the 4th Eurographics Workshop on Visual Computing for Biology and Medicine

September 2014

216 pages

ISBN:9783905674620

Conference Chairs:
Ivan Viola
Vienna University of Technology
,
Katja Bühler
VRVis Vienna
,
Timo Ropinski
Linköping University

Publisher

Eurographics Association

Goslar, Germany

Publication History

Published: 04 September 2014

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Solteszova VBirkeland ÅStoppel SViola IBruckner S(2017)Output-Sensitive Filtering of Streaming Volume DataComputer Graphics Forum10.1111/cgf.1279936:1(249-262)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.1111/cgf.12799
Beyer JHadwiger MPfister H(2015)State-of-the-Art in GPU-Based Large-Scale Volume VisualizationComputer Graphics Forum10.1111/cgf.1260534:8(13-37)Online publication date: 1-Dec-2015
https://dl.acm.org/doi/10.1111/cgf.12605

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents