Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/2207676.2207741acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Semantic interaction for visual text analytics

Published: 05 May 2012 Publication History

Abstract

Visual analytics emphasizes sensemaking of large, complex datasets through interactively exploring visualizations generated by statistical models. For example, dimensionality reduction methods use various similarity metrics to visualize textual document collections in a spatial metaphor, where similarities between documents are approximately represented through their relative spatial distances to each other in a 2D layout. This metaphor is designed to mimic analysts' mental models of the document collection and support their analytic processes, such as clustering similar documents together. However, in current methods, users must interact with such visualizations using controls external to the visual metaphor, such as sliders, menus, or text fields, to directly control underlying model parameters that they do not understand and that do not relate to their analytic process occurring within the visual metaphor. In this paper, we present the opportunity for a new design space for visual analytic interaction, called semantic interaction, which seeks to enable analysts to spatially interact with such models directly within the visual metaphor using interactions that derive from their analytic process, such as searching, highlighting, annotating, and repositioning documents. Further, we demonstrate how semantic interactions can be implemented using machine learning techniques in a visual analytic tool, called ForceSPIRE, for interactive analysis of textual data within a spatial visualization. Analysts can express their expert domain knowledge about the documents by simply moving them, which guides the underlying model to improve the overall layout, taking the user's feedback into account.

Supplementary Material

MOV File (paperfile1970-3.mov)
Supplemental video for “Semantic interaction for visual text analytics”

References

[1]
Alias-i. 2008. LingPipe 4.0.1. City, 2008.
[2]
i2 Analyst's Notebook. City.
[3]
Alsakran, J., Chen, Y., Zhao, Y., Yang, J. and Luo, D. STREAMIT: Dynamic visualization and interactive exploration of text streams. In Proceedings of the IEEE Pacific Visualization Symposium, 2011.
[4]
Andrews, C., Endert, A. and North, C. Space to Think: Large, High-Resolution Displays for Sensemaking. In Proceedings of the CHI '10, 2010.
[5]
Callahan, S. P., Freire, J., Santos, E., Scheidegger, C. E., C, Silva, u. T. and Vo, H. T. VisTrails: visualization meets data management. In Proceedings of the SIGMOD international conference on Management of data (Chicago, IL, USA, 2006). ACM.
[6]
Cowley, P., Haack, J., Littlefield, R. and Hampson, E. Glass box: capturing, archiving, and retrieving workstation activities. In Proceedings of the workshop on Continuous archival and retrival of personal experences (Santa Barbara, California, USA, 2006). ACM.
[7]
Dou, W., Jeong, D. H., Stukes, F., Ribarsky, W., Lipford, H. R. and Chang, R. Recovering Reasoning Processes from User Interactions. IEEE Computer Graphics and Applications, 2009.
[8]
Endert, A., Andrews, C., Fink, G. A. and North, C. Professional Analysts using a Large, High-Resolution Display. In Proceedings of the IEEE VAST Extended Abstract (2009).
[9]
Endert, A., Han, C., Maiti, D., House, L., Leman, S. C. and North, C. Observation-level Interaction with Statistical Models for Visual Analytics. IEEE VAST, 2011.
[10]
Frank M. Shipman, I. and Marshall, C. C. Formality Considered Harmful: Experiences, Emerging Themes, and Directions on the Use of Formal Representations inInteractive Systems. ACM CSCW, 8, 4, 1999, 333--352.
[11]
Fruchterman, T. M. J. and Reingold, E. M. Graph drawing by force-directed placement. Software: Practice and Experience, 21, 11 1991, 1129--1164.
[12]
Gotz, D. Interactive Visual Synthesis of Analytic Knowledge. IEEE VAST, 2006.
[13]
Heer, J. prefuse manual, 2006.
[14]
Heer, J., Mackinlay, J., Stolte, C. and Agrawala, M. Graphical Histories for Visualization: Supporting Analysis, Communication, and Evaluation. IEEE Transactions on Visualization and Computer Graphics, 14, 6, 2008, 1189--1196.
[15]
Jeong, D. H., Ziemkiewicz, C., Fisher, B., Ribarsky, W. and Chang, R. iPCA: An Interactive System for PCAbased Visual Analytics. Computer Graphics Forum, 28, 2009, 767--774.
[16]
Karen A Statistical Interpretation of Term Specificity and its Application in Retrieval. Journal of Documentation, 28, 1972, 11--21.
[17]
Marshall, C. C., Frank M. Shipman, I. and Coombs, J. H. VIKI: spatial hypertext supporting emergent structure. In Proceedings of the European conference on Hypermedia technology (Edinburgh, Scotland, 1994). ACM.
[18]
Olsen, K. A., Korfhage, R. R., Sochats, K. M., Spring, M. B. and Williams, J. G. Visualization of a document collection: the vibe system. Information Process Management, 29, 1 1993, 69--81.
[19]
Pirolli, P. and Card, S. Sensemaking Processes of Intelligence Analysts and Possible Leverage Points as Identified Though Cognitive Task Analysis Proceedings of the International Conference on Intelligence Analysis, 2005, 6.
[20]
Plaisant, C., Grinstein, G., Scholtz, J., Whiting, M., O'Connell, T., Laskowski, S., Chien, L., Tat, A., Wright, W., Gorg, C., Zhicheng, L., Parekh, N., Singhal, K. and Stasko, J. Evaluating Visual Analytics at the 2007 VAST Symposium Contest. Computer Graphics and Applications, IEEE, 28, 2 2008, 12--21.
[21]
Shrinivasan, Y. B. and Wijk, J. J. v. Supporting the analytical reasoning process in information visualization. In Proceedings of the CHI '08 (Florence, Italy, 2008). ACM.
[22]
Skupin, A. A Cartographic Approach to Visualizing Conference Abstracts. IEEE Computer Graphics and Applications, pp. 50--58, January/February, 2002.
[23]
Thomas, J. J., Cook, K. A., National, V. and Analytics, C. Illuminating the path. IEEE Computer Society, 2005.
[24]
Torres, R. S., Silva, C. G., Medeiros, C. B. and Rocha, H. V. Visual structures for image browsing. In Proceedings of the conference on Information and knowledge management (New Orleans, LA, USA, 2003). ACM.
[25]
Wise, J. A., Thomas, J. J., Pennock, K., Lantrip, D., Pottier, M., Schur, A. and Crow, V. Visualizing the nonvisual: spatial analysis and interaction with information for text documents. Morgan Kaufmann Publishers, 1999.
[26]
Wright, W., Schroh, D., Proulx, P., Skaburskis, A. and Cort, B. The Sandbox for analysis: concepts and methods. In Proceedings of the CHI '06 (New York, NY, 2006). ACM.
[27]
Yi, J. S., Melton, R., Stasko, J. and Jacko, J. A. Dust & magnet: multivariate information visualization using a magnet metaphor. Information Visualization, 4, 4, 2005, 239--256.

Cited By

View all
  • (2024)Toward an Optimized Human-AI Reviewing Strategy for Contract InspectionThe New Era of Business Intelligence [Working Title]10.5772/intechopen.1005255Online publication date: 1-Jul-2024
  • (2024)Leveraging Machine Learning to Analyze Semantic User Interactions in Visual AnalyticsInformation10.3390/info1506035115:6(351)Online publication date: 13-Jun-2024
  • (2024)Assessing User Trust in Active Learning Systems: Insights from Query Policy and Uncertainty VisualizationProceedings of the 29th International Conference on Intelligent User Interfaces10.1145/3640543.3645207(772-786)Online publication date: 18-Mar-2024
  • Show More Cited By

Index Terms

  1. Semantic interaction for visual text analytics

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
    May 2012
    3276 pages
    ISBN:9781450310154
    DOI:10.1145/2207676
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 05 May 2012

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. interaction
    2. visual analytics
    3. visualization

    Qualifiers

    • Research-article

    Conference

    CHI '12
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)102
    • Downloads (Last 6 weeks)10
    Reflects downloads up to 14 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Toward an Optimized Human-AI Reviewing Strategy for Contract InspectionThe New Era of Business Intelligence [Working Title]10.5772/intechopen.1005255Online publication date: 1-Jul-2024
    • (2024)Leveraging Machine Learning to Analyze Semantic User Interactions in Visual AnalyticsInformation10.3390/info1506035115:6(351)Online publication date: 13-Jun-2024
    • (2024)Assessing User Trust in Active Learning Systems: Insights from Query Policy and Uncertainty VisualizationProceedings of the 29th International Conference on Intelligent User Interfaces10.1145/3640543.3645207(772-786)Online publication date: 18-Mar-2024
    • (2024)ImageSI: Semantic Interaction for Deep Learning Image Projections2024 IEEE Visualization and Visual Analytics (VIS)10.1109/VIS55277.2024.00026(91-95)Online publication date: 13-Oct-2024
    • (2023)Interaction Proxy ManagerProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109297:3(1-39)Online publication date: 27-Sep-2023
    • (2023)Toward Addressing Ambiguous Interactions and Inferring User Intent with Dimension Reduction and Clustering Combinations in Visual AnalyticsACM Transactions on Interactive Intelligent Systems10.1145/358856514:1(1-35)Online publication date: 17-Apr-2023
    • (2023)Mixed Multi-Model Semantic Interaction for Graph-based Narrative VisualizationsProceedings of the 28th International Conference on Intelligent User Interfaces10.1145/3581641.3584076(866-888)Online publication date: 27-Mar-2023
    • (2023)Tracing and Visualizing Human-ML/AI Collaborative Processes through Artifacts of Data WorkProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580819(1-22)Online publication date: 19-Apr-2023
    • (2023)A Model for Types and Levels of Automation in Visual Analytics: A Survey, a Taxonomy, and ExamplesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.316376529:8(3550-3568)Online publication date: 1-Aug-2023
    • (2023)Evaluating the Feasibility of Predicting Information Relevance During Sensemaking with Eye Gaze Data2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00086(713-722)Online publication date: 16-Oct-2023
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media