keynote

Extreme visualization: squeezing a billion records into a million pixels

Author:

Ben ShneidermanAuthors Info & Claims

SIGMOD '08: Proceedings of the 2008 ACM SIGMOD international conference on Management of data

Pages 3 - 12

https://doi.org/10.1145/1376616.1376618

Published: 09 June 2008 Publication History

Abstract

Database searches are usually performed with query languages and form fill in templates, with results displayed in tabular lists. However, excitement is building around dynamic queries sliders and other graphical selectors for query specification, with results displayed by information visualization techniques. These filtering techniques have proven to be effective for many tasks in which visual presentations enable discovery of relationships, clusters, outliers, gaps, and other patterns. Scaling visual presentations from millions to billions of records will require collaborative research efforts in information visualization and database management to enable rapid aggregation, meaningful coordinated windows, and effective summary graphics. This paper describes current and proposed solutions (atomic, aggregated, and density plots) that facilitate sense-making for interactive visual exploration of billion record data sets.

Supplementary Material

Low Resolution (p3-shneiderman_56k.mp4)

Download
39.06 MB

High Resolution (p3-shneiderman_768k.mp4)

Download
363.61 MB

References

[1]

Abello, J., van Ham, F., and Krishnan, N., ASK-GraphView: A Large Scale Graph Visualization System, IEEE Trans. Visualization & Computer Graphics 12, 5 (2006), 669--676.

Digital Library

[2]

Ahlberg, C. and Shneiderman, B., Visual Information Seeking: Tight Coupling of Dynamic Query Filters with Starfield Display. Conference proceedings on Human factors in computing systems, April 1994, 313--318, ACM New York.

Digital Library

[3]

Ahlberg, C. and Shneiderman, B., AlphaSlider: A compact and rapid selector, Proc. of ACM CHI94 Conference, ACM Press, New York (April 1994), 365--371.

Digital Library

[4]

Aris, A. and Shneiderman, B., A node aggregation to reduce complexity in network visualizations using semantic substrates, University of Maryland Technical Report, Dept of Computer Science (February 2008).

[5]

Bederson, B. B., & Meyer, J., Implementing a Zooming User Interface: Experience Building Pad++, Software: Practice and Experience, 28, 10 (1998), 1101--1135.

Digital Library

[6]

Buono, P., Aris, A., Plaisant, C., Khella, A., and Shneiderman, B., Interactive pattern search in time series, Proc. SPIE Conference on Visual Data Analysis, SPIE, Washington, DC (January 2005), 175--186.

[7]

Card, S. K., MacKinlay, J. D., Shneiderman, B., Readings in Information Visualization: Using Vision to Think, Morgan Kaufmann Publishers, San Francisco, CA (1999).

Digital Library

[8]

Card, S. K. and Nation, D., Degree of Interest Trees: A Component of an Attention-Reactive User Interface, Proc. Advanced Visual Interfaces, Available from ACM Press, New York (2002).

Digital Library

[9]

Chen, C., Top 10 Unsolved Information Visualization Problems, IEEE Computer Graphics & Applications (July/August 2005), 12--16.

Digital Library

[10]

Eick, S. and Karr, A., Visual Scalability, Journal of Computational and Graphical Statistics 11, 1 (March 2002), 22--43.

[11]

Elmqvist, N., Do, T.-N., Goodell, H., Henry, N., and Fekete, J.-D., ZAME: Interactive Large-Scale Graph Visualization, Proc. IEEE Pacific Visualization Symposium 2008, IEEE Press (March 2008), 215--222.

[12]

Fekete, J.-D., Plaisant, C., Interactive Information Visualization of a Million Items, Proc. IEEE Symposium on Information Visualization 2002 (InfoVis 2002, Boston, USA), IEEE Press, Los Alamitos, CA (October 2002), 117--124.

Digital Library

[13]

Fua, Y.-H., Ward, M., and Rundensteiner, E., Hierarchical Parallel Coordinates for Exploration of Large Datasets, Proc. IEEE Visualization'99, IEEE Press, Los Alamitos, CA (1999), 43--50.

Digital Library

[14]

Guha, S., Koudas, N., and Srivastava, D., Fast algorithms for hierarchical range histogram construction, Proc. ACM Symposium on Principles of Database Systems, ACM Press, New York (2002), 180--187.

Digital Library

[15]

Hochheiser, H. and Shneiderman, B., Dynamic query tools for time series data sets, Timebox widgets for interactive exploration, Information Visualization 3, 1 (March 2004), 1--18.

Digital Library

[16]

Inselberg, A. and Dimsdale, B., Parallel coordinates: A tool for visualizing multidimensional geometry, Proc. Visualization'90 (San Francisco, Oct. 23-26). IEEE Press, Los Alamitos, CA (1990), 361--370.

Digital Library

[17]

Keim, D. A., Information Visualization and Visual Data Mining, IEEE Transactions on Visualization and Computer Graphics 8, 1 (January 2002), 1--8.

Digital Library

[18]

Keim, D. A., Visual Exploration of Large Data Sets, Communications of the ACM 44, 8 (August 2001), 38--44.

Digital Library

[19]

Keim, D. A., Designing Pixel-Oriented Visualization Techniques: Theory and Applications, IEEE Trans. on Visualization and Computer Graphics 6, 1 (January 2000), 59--78. {doi>10.1109/2945.841121 }

Digital Library

[20]

Koren, Y., Carmel, L., and Harel, D., Drawing Huge Graphs by Algebraic Multigrid Optimization, SIAM Multiscale Modeling and Simulation 1, 4 (2003), 645--673.

[21]

Koren, Y., Carmel, L., and Harel, D., ACE: A Fast Multiscale Eigenvector Computation for Drawing Huge Graphs, Proc. IEEE Information Visualization 2002 (InfoVis'02) 2002), 137--144.

Digital Library

[22]

Kreuseler, M., Lopez, N., and Schumann, H., A. scalable framework for information visualization, Proc. IEEE Symposium on Information Visualization (2000), 27--36.

Digital Library

[23]

Lamping, J., Rao, R., and Pirolli, P., A focus+context technique based on hyperbolic geometry for visualizing large hierarchies, Proc. of ACM CHI95 Conference, ACM Press, New York (1995), 401--408.

Digital Library

[24]

Munzner, T., Drawing Large Graphs with H3Viewer and Site Manager, Proc. Symp. Graph Drawing'98 (1998): 384--393.

Digital Library

[25]

Munzner, T., Guimbretiere, F., Tasiran, S., Zhang, L., and Zhou, Y., TreeJuxtaposer: Scalable Tree Comparison using Focus+Context with Guaranteed Visibility, ACM Trans. on Graphics 22, 3 (2002), 453--462.

Digital Library

[26]

Perer, A. and Shneiderman, B., Balancing systematic and flexible exploration of social networks, IEEE Symposium on Information Visualization and IEEE Transactions on Visualization and Computer Graphics 12, 5 (October 2006), 693--700.

Digital Library

[27]

Plaisant, C., Grosjean, J., Bederson, B., SpaceTree: Supporting Exploration in Large Node Link Tree, Design Evolution and Empirical Evaluation, IEEE Symposium on Information Visualization (2002), 57--64.

Digital Library

[28]

Saint-Paul, R., Raschia, G., and Mouaddib, N., General purpose database summarization, Proc. 31st International Conference on Very Large Data Bases, Trondheim, Norway (August 30-September 02, 2005), 733--744.

Digital Library

[29]

Saraiya, P., North, C., and Duca, K., An Insight-Based Methodology for Evaluating Bioinformatics Visualization, IEEE Trans. Visualization and Computer Graphics 11, 4 (July/Aug. 2005).

Digital Library

[30]

Saraiya, P., North, C., and Duca, K., An Evaluation of Microarray Visualization Tools for Biological Insight", IEEE Symposium on Information Visualization 2004 (InfoVis 2004) (2004), 1--8.

Digital Library

[31]

Seo, J. and Shneiderman, B., Knowledge discovery in high dimensional data: Case studies and a user survey for the rank-by-feature framework, IEEE Transactions on Visualization and Computer Graphics 12, 3 (May/June, 2006), 311--322.

Digital Library

[32]

Seo, J. and Shneiderman, B., A rank-by-feature framework for interactive exploration of multidimensional data, Information Visualization 4, 2 (June 2005), 99--113.

Digital Library

[33]

Shneiderman, B., Dynamic queries for visual information seeking, IEEE Software, 11, 6 (1994), 70--77.

Digital Library

[34]

Shneiderman, B., The eyes have it: A task by data-type taxonomy for information visualizations, Proc. Visual Languages (Boulder, CO, Sept. 3-6). IEEE Computer Science Press, Los Alamitos, CA (1996), 336--343.

Digital Library

[35]

Shneiderman, B., Feldman, D., Rose, A., and Ferre, X. A., Visualizing digital library search results with categorical and hierarchical axes, Proc. 5th ACM International Conference on Digital Libraries, ACM, New York (June 2000), 57--66.

Digital Library

[36]

Sripada, S. G., Reiter, E., Hunter, J., and Yu, J., Generating English Summaries of Time Series Data using the Gricean Maxims, Proc. ACM Conference on Knowledge Discovery and Data Mining (KDD) (2003), 187--196.

Digital Library

[37]

Stolte, C., Tang, D., and Hanrahan, P., Multiscale visualization using data cubes, Proc. Eighth IEEE Symposium on Information Visualization, Boston, MA (October 2002), 7--14.

Digital Library

[38]

Tang, L. and Shneiderman, B., Dynamic aggregation to support pattern discovery: A case study with web logs, Proc. Discovery Science: 4th International Conference 2001, Editors (Jantke, K. P. and Shinohara, A.), Springer-Verlag, Berlin (March 2001), 464--469.

Digital Library

[39]

Thomas, J.J. and Cook, K.A. (eds.), Illuminating the Path: Research and Development Agenda for Visual Analytics, IEEE Press (2005).

[40]

Tukey, J. W. and Tukey P. A., Computer graphics and exploratory data analysis: An introduction. Annual Conference and Exposition: Computer Graphics 1985 (Fairfax, VA, USA), National Micrographics Association: Silver Spring; 3 (1985), 773--785.

[41]

Ward, M., Peng, W., and Wang, X., Hierarchical visual data mining for large-scale data, Computational Statistics 19 (2004), 147--158.

Digital Library

[42]

Wattenberg, M., Visual Exploration of Multivariate Graphs, Proc. ACM SIGCHI Conference on Human Factors in Computing Systems, ACM Press, New York (2006), 811--819.

Digital Library

[43]

Wilkinson, L., Anand, A., and Grossman, R., Graph-theoretic scagnostics, Proc. IEEE Information Visualization 2005 (INFOVIS'05) (2005), 157--164.

Digital Library

[44]

Wong, P. C., Foote, H., Mackey, P., Chin Jr., G., Sofia, H., and Thomas, J., A Dynamic Multiscale Magnifying Tool for Exploring Large Sparse Graphs, Information Visualization 7, 2 (June 2008, to appear).

Digital Library

[45]

Yost, B., Haciahmetoglu, Y., and North, C., Beyond visual acuity: the perceptual scalability of information visualizations for large displays, Proc. ACM SIGCHI Conference on Human Factors in Computing Systems, San Jose, California, USA (April 28-May 03, 2007), 101--110.

Digital Library

Cited By

Damri ALast MCohen N(2023)Towards efficient image-based representation of tabular dataNeural Computing and Applications10.1007/s00521-023-09074-y36:2(1023-1043)Online publication date: 4-Oct-2023
https://doi.org/10.1007/s00521-023-09074-y
Freller LKeck MNeumayr TAugstein MBottoni PPanizzi E(2022)Towards a Construction Kit for Visual Recommender SystemsProceedings of the 2022 International Conference on Advanced Visual Interfaces10.1145/3531073.3534484(1-3)Online publication date: 6-Jun-2022
https://dl.acm.org/doi/10.1145/3531073.3534484
Chakrabarti AAhmad FJarke MQuix C(2022)Monitoring Large Scale Production Processes Using a Rule-Based Visualization Recommendation SystemSN Computer Science10.1007/s42979-022-01419-z4:1Online publication date: 26-Oct-2022
https://doi.org/10.1007/s42979-022-01419-z
Show More Cited By

Index Terms

Extreme visualization: squeezing a billion records into a million pixels
1. Human-centered computing
2. Information systems
  1. Data management systems

Recommendations

Snap-together visualization: a user interface for coordinating visualizations via relational schemata
AVI '00: Proceedings of the working conference on Advanced visual interfaces

Multiple coordinated visualizations enable users to rapidly explore complex information. However, users often need unforeseen combinations of coordinated visualizations that are appropriate for their data. Snap-Together Visualization enables data users ...
Starfield visualization with interactive smooth zooming
Proceedings of the third IFIP WG2.6 working conference on Visual database systems 3 (VDB-3)
Dynamic switching of data visualization method for increased plotting scalability
NordiCHI '14: Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational

In information visualization every method performs best in its own range of plotting density. When the available area for the visualization is unknown or when the data is supplied in packages of various sizes, the best suited method cannot be chosen in ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGMOD '08: Proceedings of the 2008 ACM SIGMOD international conference on Management of data

June 2008

1396 pages

ISBN:9781605581026

DOI:10.1145/1376616

General Chairs:
Laks V. S. Lakshmanan
University of British Columbia, Canada
,
Raymond T. Ng
University of British Columbia, Canada
,
Dennis Shasha
New York University, USA

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 June 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Keynote

Conference

SIGMOD/PODS '08

Sponsor:

SIGMOD/PODS '08: SIGMOD/PODS '08 - International Conference on Management of Data

June 9 - 12, 2008

Vancouver, Canada

Acceptance Rates

Overall Acceptance Rate 785 of 4,003 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

63
Total Citations
View Citations
2,779
Total Downloads

Downloads (Last 12 months)18
Downloads (Last 6 weeks)1

Reflects downloads up to 27 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

Damri ALast MCohen N(2023)Towards efficient image-based representation of tabular dataNeural Computing and Applications10.1007/s00521-023-09074-y36:2(1023-1043)Online publication date: 4-Oct-2023
https://doi.org/10.1007/s00521-023-09074-y
Freller LKeck MNeumayr TAugstein MBottoni PPanizzi E(2022)Towards a Construction Kit for Visual Recommender SystemsProceedings of the 2022 International Conference on Advanced Visual Interfaces10.1145/3531073.3534484(1-3)Online publication date: 6-Jun-2022
https://dl.acm.org/doi/10.1145/3531073.3534484
Chakrabarti AAhmad FJarke MQuix C(2022)Monitoring Large Scale Production Processes Using a Rule-Based Visualization Recommendation SystemSN Computer Science10.1007/s42979-022-01419-z4:1Online publication date: 26-Oct-2022
https://doi.org/10.1007/s42979-022-01419-z
Khalemsky AGelbard R(2021)ExpanDrogram: Dynamic Visualization of Big Data Segmentation over TimeJournal of Data and Information Quality10.1145/343477813:2(1-27)Online publication date: 2-Jun-2021
https://dl.acm.org/doi/10.1145/3434778
Bradbury JGuadagno R(2021)Enhanced data narrativesJournal of Management Analytics10.1080/23270012.2021.1886883(1-24)Online publication date: 12-Mar-2021
https://doi.org/10.1080/23270012.2021.1886883
Chiba KSawahara MSumimoto THatta TKanazaki M(2021)Hypothesis derivation and its verification by a wholly automated many-objective evolutionary optimization systemNeural Computing and Applications10.1007/s00521-021-05786-135:2(1-13)Online publication date: 6-Mar-2021
https://doi.org/10.1007/s00521-021-05786-1
Nascimento DXavier CFelipe INeto F(2020)Dynamic Conditional Correlation GARCH: A Multivariate Time Series Novel using a Bayesian ApproachJournal of Modern Applied Statistical Methods10.22237/jmasm/155666922018:1(2-17)Online publication date: 25-Feb-2020
https://doi.org/10.22237/jmasm/1556669220
Tanted SAgarwal AMitra SBahuman CRamamritham KVarma VKambhampati SBhattacharya ANatarajan SRoy R(2020)Database and Caching Support for Adaptive Visualization of Large Sensor DataProceedings of the 7th ACM IKDD CoDS and 25th COMAD10.1145/3371158.3371170(98-106)Online publication date: 5-Jan-2020
https://dl.acm.org/doi/10.1145/3371158.3371170
Bludau MBrüggemann VBusch ADörk M(2020)Reading Traces: Scalable Exploration in Elastic Visualizations of Cultural Heritage DataComputer Graphics Forum10.1111/cgf.1396439:3(77-87)Online publication date: 18-Jul-2020
https://doi.org/10.1111/cgf.13964
Kammer DKeck MGrunder TMaasch AThom TKleinsteuber MGroh R(2020)Glyphboard: Visual Exploration of High-Dimensional Data Combining Glyphs with Dimensionality ReductionIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.296906026:4(1661-1671)Online publication date: 1-Apr-2020
https://doi.org/10.1109/TVCG.2020.2969060
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents