demonstration

Stat!: an interactive analytics environment for big data

Authors:

Mike Barnett,

Badrish Chandramouli,

John PlattAuthors Info & Claims

SIGMOD '13: Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data

Pages 1013 - 1016

https://doi.org/10.1145/2463676.2463683

Published: 22 June 2013 Publication History

Get Access

Abstract

Exploratory analysis on big data requires us to rethink data management across the entire stack -- from the underlying data processing techniques to the user experience. We demonstrate Stat! -- a visualization and analytics environment that allows users to rapidly experiment with exploratory queries over big data. Data scientists can use Stat! to quickly refine to the correct query, while getting immediate feedback after processing a fraction of the data. Stat! can work with multiple processing engines in the backend; in this demo, we use Stat! with the Microsoft StreamInsight streaming engine. StreamInsight is used to generate incremental early results to queries and refine these results as more data is processed. Stat! allows data scientists to explore data, dynamically compose multiple queries to generate streams of partial results, and display partial results in both textual and visual form.

References

[1]

B. Babcock et al. Models and Issues in Data Stream Systems. In PODS, 2002.

Digital Library

Google Scholar

[2]

J. Hellerstein et al. Interactive Data Analysis: The Control Project. IEEE Computer, August, 1999.

Digital Library

Google Scholar

[3]

D. Fisher, I. Popov, S. Drucker, and m c schraefel. "Trust Me, I'm Partially Right: Incremental Visualization Lets Analysts Explore Large Datasets Faster". In CHI, 2012.

Digital Library

Google Scholar

[4]

E. Meijer. 2011. "The world according to LINQ". Commun. ACM 54, 10 (October 2011), 45--51.

Digital Library

Google Scholar

[5]

S. Melnik et al., "Dremel: Interactive Analysis of Web-Scale Datasets". In VLDB, 2010.

Digital Library

Google Scholar

[6]

C. Jermaine et al. Scalable approximate query processing with the DBO engine. In SIGMOD, 2007.

Digital Library

Google Scholar

[7]

T. Condie et al. MapReduce Online. In NSDI, 2010.

Digital Library

Google Scholar

[8]

A. Hall et al. Processing a trillion cells per mouse click. In VLDB, 2012.

Digital Library

Google Scholar

[9]

B. Chandramouli et al. Temporal analytics on big data for Web advertising. In ICDE, 2012.

Digital Library

Google Scholar

[10]

Microsoft StreamInsight. http://aka.ms/stream.

Google Scholar

Cited By

View all

Ahmed SIslam MRajan H(2022)Semantics and Anomaly Preserving Sampling Strategy for Large-Scale Time Series DataACM/IMS Transactions on Data Science10.1145/35119182:4(1-25)Online publication date: 30-Mar-2022
https://dl.acm.org/doi/10.1145/3511918
Bruhwiler KBuddhika TPallickara SPallickara S(2020)Iris: Amortized, Resource Efficient Visualizations of Voluminous Spatiotemporal Datasets2020 IEEE/ACM International Conference on Big Data Computing, Applications and Technologies (BDCAT)10.1109/BDCAT50828.2020.00003(47-56)Online publication date: Dec-2020
https://doi.org/10.1109/BDCAT50828.2020.00003
Budiu MGopalan PSuresh LWieder UKruiger HAguilera M(2019)HillviewProceedings of the VLDB Endowment10.14778/3342263.334227912:11(1442-1457)Online publication date: 1-Jul-2019
https://dl.acm.org/doi/10.14778/3342263.3342279
Show More Cited By

Index Terms

Stat!: an interactive analytics environment for big data
1. Information systems
  1. Data management systems
    1. Database management system engines

Recommendations

Big Data Analysis with Interactive Visualization using R packages
BigDataScience '14: Proceedings of the 2014 International Conference on Big Data Science and Computing

Compared to the traditional data storing, processing, analyzing and visualization which have been performed, Big data requires evolutionary technologies of massive data processing on distributed and parallel systems, such as Hadoop system. Big data ...
Vixen: interactive visualization of gameplay experiences
FDG '17: Proceedings of the 12th International Conference on the Foundations of Digital Games

Visualization techniques can facilitate the understanding and exploration of relationships in usertesting data. For example, data from players' in-game movement can be combined with interview data or questionnaire results. However, the process of ...
Challenges and opportunities with big data visualization
MEDES '15: Proceedings of the 7th International Conference on Management of computational and collective intElligence in Digital EcoSystems

In this big data era, huge amount data are continuously acquired for a variety of purposes. Advanced computing, imaging, and sensing technologies enable scientists to study natural and physical phenomena at unprecedented precision, resulting in an ...

Comments

Information & Contributors

Information

Published In

SIGMOD '13: Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data

June 2013

1322 pages

ISBN:9781450320375

DOI:10.1145/2463676

General Chairs:
Kenneth Ross
Columbia University
,
Divesh Srivastava
AT&T Research
,
Program Chair:
Dimitris Papadias
HKUST

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 June 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Demonstration

Conference

SIGMOD/PODS'13

Sponsor:

SIGMOD

SIGMOD/PODS'13: International Conference on Management of Data

June 22 - 27, 2013

New York, New York, USA

Acceptance Rates

SIGMOD '13 Paper Acceptance Rate 76 of 372 submissions, 20%;

Overall Acceptance Rate 785 of 4,003 submissions, 20%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

23
Total Citations
View Citations
922
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)1

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Ahmed SIslam MRajan H(2022)Semantics and Anomaly Preserving Sampling Strategy for Large-Scale Time Series DataACM/IMS Transactions on Data Science10.1145/35119182:4(1-25)Online publication date: 30-Mar-2022
https://dl.acm.org/doi/10.1145/3511918
Bruhwiler KBuddhika TPallickara SPallickara S(2020)Iris: Amortized, Resource Efficient Visualizations of Voluminous Spatiotemporal Datasets2020 IEEE/ACM International Conference on Big Data Computing, Applications and Technologies (BDCAT)10.1109/BDCAT50828.2020.00003(47-56)Online publication date: Dec-2020
https://doi.org/10.1109/BDCAT50828.2020.00003
Budiu MGopalan PSuresh LWieder UKruiger HAguilera M(2019)HillviewProceedings of the VLDB Endowment10.14778/3342263.334227912:11(1442-1457)Online publication date: 1-Jul-2019
https://dl.acm.org/doi/10.14778/3342263.3342279
Kamat NNandi A(2018)A Session-Based Approach to Fast-But-Approximate Interactive Data Cube ExplorationACM Transactions on Knowledge Discovery from Data10.1145/307064812:1(1-26)Online publication date: 13-Feb-2018
https://dl.acm.org/doi/10.1145/3070648
Choi HGim JSeo YBaik D(2018)VPL-Based Big Data Analysis System: UDASIEEE Access10.1109/ACCESS.2018.28578456(40883-40897)Online publication date: 2018
https://doi.org/10.1109/ACCESS.2018.2857845
Mani MFei SDesai BHong J(2017)Effective Big Data VisualizationProceedings of the 21st International Database Engineering & Applications Symposium10.1145/3105831.3105857(298-303)Online publication date: 12-Jul-2017
https://dl.acm.org/doi/10.1145/3105831.3105857
Dayarathna MMalshan MPerera SJayasinghe M(2017)Scalable Complex Event Processing on a NotebookProceedings of the 11th ACM International Conference on Distributed and Event-based Systems10.1145/3093742.3095093(327-330)Online publication date: 8-Jun-2017
https://dl.acm.org/doi/10.1145/3093742.3095093
Wang ZFerreira NWei YBhaskar AScheidegger C(2017)Gaussian CubesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2016.259869423:1(681-690)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.1109/TVCG.2016.2598694
Budiu MIsaacs RMurray DPlotkin GBarham PAl-Kiswany SBoshmaf YLuo QAndoni ATelea AGobbetti EBethel W(2016)Interacting with large distributed datasets using sketchProceedings of the 16th Eurographics Symposium on Parallel Graphics and Visualization10.5555/3061436.3061442(31-43)Online publication date: 6-Jun-2016
https://dl.acm.org/doi/10.5555/3061436.3061442
Khalifa SElshater YSundaravarathan KBhat AMartin PImam FRope DMcroberts MStatchuk C(2016)The Six Pillars for Building Big Data Analytics EcosystemsACM Computing Surveys10.1145/296314349:2(1-36)Online publication date: 2-Aug-2016
https://dl.acm.org/doi/10.1145/2963143
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Big Data Analysis with Interactive Visualization using R packages

Vixen: interactive visualization of gameplay experiences

Challenges and opportunities with big data visualization