research-article

Chronodes: Interactive Multifocus Exploration of Event Sequences

Authors:

Peter J. Polack Jr.,

Shang-Tse Chen,

Kaya De Barbaro,

Moushumi Sharmin, and

Duen Horng ChauAuthors Info & Claims

ACM Transactions on Interactive Intelligent Systems (TiiS), Volume 8, Issue 1

Article No.: 2, Pages 1 - 21

https://doi.org/10.1145/3152888

Published: 06 February 2018 Publication History

Abstract

The advent of mobile health (mHealth) technologies challenges the capabilities of current visualizations, interactive tools, and algorithms. We present Chronodes, an interactive system that unifies data mining and human-centric visualization techniques to support explorative analysis of longitudinal mHealth data. Chronodes extracts and visualizes frequent event sequences that reveal chronological patterns across multiple participant timelines of mHealth data. It then combines novel interaction and visualization techniques to enable multifocus event sequence analysis, which allows health researchers to interactively define, explore, and compare groups of participant behaviors using event sequence combinations. Through summarizing insights gained from a pilot study with 20 behavioral and biomedical health experts, we discuss Chronodes’s efficacy and potential impact in the mHealth domain. Ultimately, we outline important open challenges in mHealth, and offer recommendations and design guidelines for future research.

References

[1]

Wolfgang Aigner, Silvia Miksch, Wolfgang Müller, Heidrun Schumann, and Christian Tominski. 2007. Visualizing time-oriented data—a systematic view. Computers and Graphics 31, 3, 401--409.

Digital Library

[2]

Mustafa al’Absi, Dorothy Hatsukami, and Gary L. Davis. 2005. Attenuated adrenocorticotropic responses to psychological stress are associated with early smoking relapse. Psychopharmacology 181, 1, 107--117.

[3]

A. Bar-Or, J. Healey, L. Kontothanassis, and J. M. Van Thong. 2004. BioStream: A system architecture for real-time processing of physiological signals. In Proceedings of the 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Vol. 2. IEEE, Los Alamitos, CA, 3101--3104.

[4]

Rahul C. Basole, Mark L. Braunstein, Vikas Kumar, Hyunwoo Park, Minsuk Kahng, Duen Horng Polo Chau, Acar Tamersoy, et al. 2015. Understanding variations in pediatric asthma care processes in the emergency department using visual analytics. Journal of the American Medical Informatics Association 22, 2, 318--323.

[5]

Thomas H. Brandon, Steven T. Tiffany, Karen M. Obremski, and Timothy B. Baker. 1990. Postcessation cigarette use: The process of relapse. Addictive Behaviors 15, 2, 105--114.

[6]

Matthew Brehmer, Bongshin Lee, Benjamin Bach, Nathalie Henry Riche, and Tamara Munzner. 2016. Timelines revisited: A design space and considerations for expressive storytelling. IEEE Transactions on Visualization and Computer Graphics 22, 1, 449--458.

Digital Library

[7]

Paolo Buono, Aleks Aris, Catherine Plaisant, Amir Khella, and Ben Shneiderman. 2005. Interactive pattern search in time series. In Electronic Imaging 2005. International Society for Optics and Photonics, Bellingham, WA, 175--186.

[8]

Bill Chiu, Eamonn Keogh, and Stefano Lonardi. 2003. Probabilistic discovery of time series motifs. In Proceedings of the 9th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, New York, NY, 493--498.

Digital Library

[9]

Krzysztof J. Cios and G. William Moore. 2002. Uniqueness of medical data mining. Artificial Intelligence in Medicine 26, 1, 1--24.

Digital Library

[10]

Sheldon Cohen and Edward Lichtenstein. 1990. Perceived stress, quitting smoking, and smoking relapse. Health Psychology 9, 4, 466.

[11]

Emre Ertin, Nathan Stohs, Santosh Kumar, Andrew Raij, Mustafa al’Absi, and Siddharth Shah. 2011. AutoSense: Unobtrusively wearable sensor suite for inferring the onset, causality, and consequences of stress in the field. In Proceedings of the 9th ACM Conference on Embedded Networked Sensor Systems. ACM, New York, NY, 274--287.

Digital Library

[12]

Jerry Alan Fails, Amy Karlson, Layla Shahamat, and Ben Shneiderman. 2006. A visual interface for multivariate temporal data: Finding patterns of events across multiple histories. In Proceedings of the 2006 IEEE Symposium on Visual Analytics Science and Technology. IEEE, Los Alamitos, CA, 167--174.

[13]

Adam Fouse, Nadir Weibel, Edwin Hutchins, and James D. Hollan. 2011. ChronoViz: A system for supporting navigation of time-coded data. In CHI’11 Extended Abstracts on Human Factors in Computing Systems. ACM, New York, NY, 299--304.

Digital Library

[14]

Cyril Goutte, Peter Toft, Egill Rostrup, Finn Å. Nielsen, and Lars Kai Hansen. 1999. On clustering fMRI time series. NeuroImage 9, 3, 298--310.

[15]

Jane Grimson, William Grimson, and Wilhelm Hasselbring. 2000. The SI challenge in health care. Communications of the ACM 43, 6, 48--55.

Digital Library

[16]

Theresia Gschwandtner, Wolfgang Aigner, Katharina Kaiser, Silvia Miksch, and Andreas Seyfang. 2011. CareCruiser: Exploring and visualizing plans, events, and effects interactively. In Proceedings of the 2011 IEEE Pacific Visualization Symposium (PacificVis’11). IEEE, Los Alamitos, CA, 43--50.

Digital Library

[17]

François Guimbretière, Morgan Dixon, and Ken Hinckley. 2007. ExperiScope: An analysis tool for interaction data. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 1333--1342.

Digital Library

[18]

Harry Hochheiser and Ben Shneiderman. 2002. A dynamic query interface for finding patterns in time series data. In CHI’02 Extended Abstracts on Human Factors in Computing Systems. ACM, Los Alamitos, CA, 522--523.

Digital Library

[19]

K. Hovsepian, M. al’Absi, E. Ertin, T. Kamarck, M. Nakajima, and S. Kumar. 2015. cStress: Towards a gold standard for continuous stress assessment in the mobile environment. In Proceedings of the ACM International Conference on Ubiquitous Computing (UbiComp’15). 493--504.

Digital Library

[20]

H. Kong, Z. Liu, and K. Karahalios. Internal and external visual cue preferences for visualizations in presentations. Computer Graphics Forum 36, 3, 515--525.

Digital Library

[21]

Josua Krause, Adam Perer, and Harry Stavropoulos. 2016. Supporting iterative cohort construction with visual temporal queries. IEEE Transactions on Visualization and Computer Graphics 22, 1, 91--100.

Digital Library

[22]

Zhicheng Liu, Yang Wang, Mira Dontcheva, Matthew Hoffman, Seth Walker, and Alan Wilson. 2017. Patterns and sequences: Interactive exploration of clickstreams to understand common visitor paths. IEEE Transactions on Visualization and Computer Graphics 23, 1, 321--330.

Digital Library

[23]

Sana Malik, Fan Du, Megan Monroe, Eberechukwu Onukwugha, Catherine Plaisant, and Ben Shneiderman. 2015. Cohort comparison of event sequences with balanced integration of visual analytics and statistics. In Proceedings of the 20th International Conference on Intelligent User Interfaces. ACM, New York, NY, 38--49.

Digital Library

[24]

Megan Monroe, Rongjian Lan, Hanseung Lee, Catherine Plaisant, and Ben Shneiderman. 2013. Temporal event sequence simplification. IEEE Transactions on Visualization and Computer Graphics 19, 12, 2227--2236.

Digital Library

[25]

Raymond S. Niaura, Damaris J. Rohsenow, Jody A. Binkoff, Peter M. Monti, Magda Pedraza, and David B. Abrams. 1988. Relevance of cue reactivity to understanding alcohol and smoking relapse. Journal of Abnormal Psychology 97, 2, 133.

[26]

George C. Patton, John B. Carlin, Carolyn Coffey, Rory Wolfe, M. Hibbert, and Glenn Bowes. 1998. The course of early smoking: A population-based cohort study over three years. Addiction 93, 8, 1251--1260.

[27]

Jian Pei, Jiawei Han, Behzad Mortazavi-Asl, Helen Pinto, Qiming Chen, Umeshwar Dayal, and Mei-Chun Hsu. 2001. Prefixspan: Mining sequential patterns efficiently by prefix-projected pattern growth. In Proceedings of the 17th International Conference on Data Engineering (ICDE’01). IEEE, Los Alamitos, CA, 215--224.

Digital Library

[28]

Adam Perer and David Gotz. 2013. Data-driven exploration of care plans for patients. In CHI’13 Extended Abstracts on Human Factors in Computing Systems. ACM, New York, NY, 439--444.

Digital Library

[29]

Adam Perer and Fei Wang. 2014. Frequence: Interactive mining and visualization of temporal frequent event sequences. In Proceedings of the 19th International Conference on Intelligent User Interfaces. ACM, New York, NY.

Digital Library

[30]

Le Phu and Duong Tuan Anh. 2011. Motif-based method for initialization the K-means clustering for time series data. In AI 2011: Advances in Artificial Intelligence. Springer, 11--20.

Digital Library

[31]

Peter J. Polack Jr., Shang-Tse Chen, Minsuk Kahng, Moushumi Sharmin, and Duen Horng Chau. 2015. TimeStitch: Interactive multi-focus cohort discovery and comparison. In Proceedings of the 2015 IEEE Conference on Visual Analytics Science and Technology (VAST’15). IEEE, Los Alamitos, CA.

[32]

M. Rahman, R. Bari, A. Ali, M. Sharmin, A. Raij, K. Hovsepian, S. Hossain, et al. 2014. Are we there yet? Feasibility of continuous stress assessment via wireless physiological sensors. In Proceedings of the 5th ACM Conference on Bioinformatics, Computational Biology, and Health Informatics (BCB’14). 479--488.

Digital Library

[33]

N. Saleheen, A. Ali, S. Hossain, H. Sarker, S. Chatterjee, B. Marlin, E. Ertin, M. al’Absi, and S. Kumar. 2015. puffMarker: A multi-sensor approach for pinpointing the timing of first lapse in smoking cessation. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp’15). 999--1010.

Digital Library

[34]

Pavel Senin and Sergey Malinchik. 2013. SAX-VSM: Interpretable time series classification using SAX and Vector Space Model. In Proceedings of the 2013 IEEE 13th International Conference on Data Mining (ICDM’13). IEEE, Los Alamitos, CA, 1175--1180.

[35]

Moushumi Sharmin, Andrew Raij, David Epstien, Inbal Nahum-Shani, J. Gayle Beck, Sudip Vhaduri, Kenzie Preston, and Santosh Kumar. 2015. Visualization of time-series sensor data to inform the design of just-in-time adaptive stress interventions. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, New York, NY, 505--516.

Digital Library

[36]

Charles D. Stolper, Adam Perer, and David Gotz. 2014. Progressive visual analytics: User-driven visual exploration of in-progress analytics. IEEE Transactions on Visualization and Computer Graphics 20, 12, 1653--1662.

[37]

Katerina Vrotsou, Jimmy Johansson, and Matthew Cooper. 2009. ActiviTree: Interactive visual exploration of sequences in event-based data using graph similarity. IEEE Transactions on Visualization and Computer Graphics 15, 6, 945--952.

Digital Library

[38]

James Walker, Rita Borgo, and Mark W. Jones. 2016. TimeNotes: A study on effective chart visualization and interaction techniques for time-series data. IEEE Transactions on Visualization and Computer Graphics 22, 1, 549--558.

Digital Library

[39]

Krist Wongsuphasawat, John Alexis Guerra Gómez, Catherine Plaisant, Taowei David Wang, Meirav Taieb-Maimon, and Ben Shneiderman. 2011. LifeFlow: Visualizing an overview of event sequences. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY.

Digital Library

[40]

Krist Wongsuphasawat and Jimmy Lin. 2014. Using visualizations to monitor changes and harvest insights from a global-scale logging infrastructure at Twitter. In Proceedings of the 2014 IEEE Conference on Visual Analytics Science and Technology (VAST’14). IEEE, Los Alamitos, CA, 113--122.

[41]

Emanuel Zgraggen, Steven M. Drucker, Danyel Fisher, and Robert Deline. 2015. (s| qu) eries: Visual regular expressions for querying and exploring event sequences. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI’15). 2683--2692.

Digital Library

[42]

Jian Zhao, Fanny Chevalier, and Ravin Balakrishnan. 2011. Kronominer: Using multi-foci navigation for the visual exploration of time-series data. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 1737--1746.

Digital Library

[43]

Jian Zhao, Fanny Chevalier, Emmanuel Pietriga, and Ravin Balakrishnan. 2011. Exploratory analysis of time-series with chronolenses. IEEE Transactions on Visualization and Computer Graphics 17, 12, 2422--2431.

Digital Library

Cited By

Wong KWang XWang YHe JZhang RQu H(2024)Anchorage: Visual Analysis of Satisfaction in Customer Service Videos Via Anchor EventsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.324560930:7(4008-4022)Online publication date: Jul-2024
https://doi.org/10.1109/TVCG.2023.3245609
Chan GNwagu COdenigbo IAlslaity AOrji R(2024)The Shape of Mobile Health: A Systematic Review of Health Visualization on Mobile DevicesInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2313282(1-19)Online publication date: 20-Feb-2024
https://doi.org/10.1080/10447318.2024.2313282
Choi SSajib MManzano JChlebek C(2023)mHealth Technology Experiences of Middle-Aged and Older Individuals With Visual Impairments: Cross-Sectional Interview StudyJMIR Formative Research10.2196/524107(e52410)Online publication date: 25-Dec-2023
https://doi.org/10.2196/52410
Show More Cited By

Index Terms

Chronodes: Interactive Multifocus Exploration of Event Sequences
1. Applied computing
  1. Life and medical sciences
    1. Health care information systems
2. Human-centered computing
  1. Visualization
    1. Visualization application domains
      1. Visual analytics

Recommendations

Personalized Health Monitoring System for Managing Well-Being in Rural Areas

Rural India lacks easy access to health practitioners and medical centers, depending instead on community health workers. In these areas, common ailments that are easy to manage with medicines, often lead to medical escalations and even fatalities due ...
Read More
MedLink: a mobile intervention to address failure points in the treatment of depression in general medicine
PervasiveHealth '15: Proceedings of the 9th International Conference on Pervasive Computing Technologies for Healthcare

Major depression is common, and imposes a high burden in terms of cost, morbidity, and suffering. Most people with depression are treated in general medicine using antidepressant medication. Outcomes are poor due to failure points across the care system,...
Read More
EEMI-An Electronic Health Record for Pediatricians: Adoption Barriers, Services and Use in Mexico

The use of paper health records and handwritten prescriptions are prone to preset errors of misunderstanding instructions or interpretations that derive in affecting patients' health. Electronic Health Records EHR systems are useful tools that among ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Interactive Intelligent Systems

ACM Transactions on Interactive Intelligent Systems Volume 8, Issue 1

Special Issue on Interactive Visual Analysis of Human Crowd Behaviors and Regular Paper

March 2018

132 pages

ISSN:2160-6455

EISSN:2160-6463

DOI:10.1145/3185338

Editor:
Michelle Zhou
Juji, Inc., USA

Issue’s Table of Contents

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 February 2018

Accepted: 01 October 2017

Revised: 01 July 2017

Received: 01 January 2017

Published in TIIS Volume 8, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

National Institutes of Health

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
403
Total Downloads

Downloads (Last 12 months)46
Downloads (Last 6 weeks)7

Other Metrics

View Author Metrics

Citations

Cited By

Wong KWang XWang YHe JZhang RQu H(2024)Anchorage: Visual Analysis of Satisfaction in Customer Service Videos Via Anchor EventsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.324560930:7(4008-4022)Online publication date: Jul-2024
https://doi.org/10.1109/TVCG.2023.3245609
Chan GNwagu COdenigbo IAlslaity AOrji R(2024)The Shape of Mobile Health: A Systematic Review of Health Visualization on Mobile DevicesInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2313282(1-19)Online publication date: 20-Feb-2024
https://doi.org/10.1080/10447318.2024.2313282
Choi SSajib MManzano JChlebek C(2023)mHealth Technology Experiences of Middle-Aged and Older Individuals With Visual Impairments: Cross-Sectional Interview StudyJMIR Formative Research10.2196/524107(e52410)Online publication date: 25-Dec-2023
https://doi.org/10.2196/52410
Dritsa DHouben S(2023)Dimension Hopper: A Tool for Exploring Multidimensional Data in Design ResearchProceedings of the 2nd International Conference of the ACM Greek SIGCHI Chapter10.1145/3609987.3609995(1-5)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3609987.3609995
Lee UJung GMa EKim JKim HAlikhanov JNoh YKim H(2023)Toward Data-Driven Digital Therapeutics Analytics: Literature Review and Research DirectionsIEEE/CAA Journal of Automatica Sinica10.1109/JAS.2023.12301510:1(42-66)Online publication date: Jan-2023
https://doi.org/10.1109/JAS.2023.123015
Mansoor HGerych WAlajaji ABuquicchio LChandrasekaran KAgu ERundensteiner ERodriguez A(2023)INPHOVIS: Interactive visual analytics for smartphone-based digital phenotypingVisual Informatics10.1016/j.visinf.2023.01.0027:2(13-29)Online publication date: Jun-2023
https://doi.org/10.1016/j.visinf.2023.01.002
Scheer JVolkert ABrich NWeinert LSanthanam NKrone MGanslandt TBoeker MNagel T(2022)Visualization Techniques of Time-Oriented Data for the Comparison of Single Patients With Multiple Patients or Cohorts: Scoping ReviewJournal of Medical Internet Research10.2196/3804124:10(e38041)Online publication date: 24-Oct-2022
https://doi.org/10.2196/38041
Guo YGuo SJin ZKaul SGotz DCao N(2022)Survey on Visual Analysis of Event Sequence DataIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.310041328:12(5091-5112)Online publication date: 1-Dec-2022
https://doi.org/10.1109/TVCG.2021.3100413
Kwon BAnand VSeverson KGhosh SSun ZFrohnert BLundgren MNg K(2021)DPVis: Visual Analytics With Hidden Markov Models for Disease Progression PathwaysIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.298568927:9(3685-3700)Online publication date: 1-Sep-2021
https://doi.org/10.1109/TVCG.2020.2985689
Mansoor HGerych WAlajaji ABuquicchio LChandrasekaran KAgu ERundensteiner E(2021)ARGUS: Interactive visual analysis of disruptions in smartphone-detected Bio-Behavioral RhythmsVisual Informatics10.1016/j.visinf.2021.07.0015:3(39-53)Online publication date: Sep-2021
https://doi.org/10.1016/j.visinf.2021.07.001
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents