research-article

Visual Interfaces for Recommendation Systems: Finding Similar and Dissimilar Peers

Authors:

Catherine Plaisant,

Ben ShneidermanAuthors Info & Claims

ACM Transactions on Intelligent Systems and Technology (TIST), Volume 10, Issue 1

Article No.: 9, Pages 1 - 23

https://doi.org/10.1145/3200490

Published: 28 November 2018 Publication History

Abstract

Recommendation applications can guide users in making important life choices by referring to the activities of similar peers. For example, students making academic plans may learn from the data of similar students, while patients and their physicians may explore data from similar patients to select the best treatment. Selecting an appropriate peer group has a strong impact on the value of the guidance that can result from analyzing the peer group data. In this article, we describe a visual interface that helps users review the similarity and differences between a seed record and a group of similar records and refine the selection. We introduce the LikeMeDonuts, Ranking Glyph, and History Heatmap visualizations. The interface was refined through three rounds of formative usability evaluation with 12 target users, and its usefulness was evaluated by a case study with a student review manager using real student data. We describe three analytic workflows observed during use and summarize how users’ input shaped the final design.

References

[1]

F. Gregory Ashby and Daniel M. Ennis. 2007. Similarity measures. Scholarpedia 2, 12 (2007), 4116.

[2]

Benjamin B. Bederson, Ben Shneiderman, and Martin Wattenberg. 2002. Ordered and quantum treemaps: Making effective use of 2D space to display hierarchies. ACM Trans. Graph. 21, 4 (2002), 833–854.

Digital Library

[3]

Nan Cao, Yu-Ru Lin, Fan Du, and Dashun Wang. 2016. Episogram: Visual summarization of egocentric social interactions. IEEE Comput. Graph. Appl. 36, 5 (2016), 72–81.

[4]

William B. Cavnar and John M. Trenkle. 1994. N-gram-based text categorization. In Proceedings of the Annual Symposium on Document Analysis and Information Retrieval. 161–175.

[5]

Florin Chelaru, Llewellyn Smith, Naomi Goldstein, and Héctor Corrada Bravo. 2014. Epiviz: Interactive visual analytics for functional genomics data. Nat. Methods 11, 9 (2014), 938–940.

[6]

Fanny Chevalier, Nathalie Henry Riche, Catherine Plaisant, Amira Chalbi, and Christophe Hurter. 2016. Animations 25 years later: New roles and opportunities. In Proceedings of the International Working Conference on Advanced Visual Interfaces. 280–287.

Digital Library

[7]

Richard Chimera. 1992. Value bars: An information visualization and navigation tool for multi-attribute listings. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 293–294.

Digital Library

[8]

Gouthami Chintalapani, Catherine Plaisant, and Ben Shneiderman. 2004. Extending the utility of treemaps with flexible hierarchy. In Information Visualisation. 335–344.

Digital Library

[9]

Lieven Decock and Igor Douven. 2011. Similarity after goodman. Rev. Philos. Psychol. 2, 1 (2011), 61–75.

[10]

Geoffrey M. Draper, Yarden Livnat, and Richard F. Riesenfeld. 2009. A survey of radial methods for information visualization. IEEE Trans. Vis. Comput. Graph. 15, 5 (2009), 759–776.

Digital Library

[11]

Steven Drucker and Roland Fernandez. 2015. A Unifying Framework for Animated and Interactive Unit Visualizations. Technical Report. Microsoft Research.

[12]

Fan Du, Catherine Plaisant, Neil Spring, and Ben Shneiderman. 2016. EventAction: Visual analytics for temporal event sequence recommendation. In Proceedings of the IEEE Visual Analytics Science and Technology. 61–70.

[13]

Fan Du, Catherine Plaisant, Neil Spring, and Ben Shneiderman. 2017. Finding similar people to guide life choices: Challenge, design, and evaluation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 5498–5509.

Digital Library

[14]

Niklas Elmqvist and Jean-Daniel Fekete. 2010. Hierarchical aggregation for information visualization: Overview, techniques, and design guidelines. IEEE Trans. Vis. Comput. Graph. 16, 3 (2010), 439–454.

Digital Library

[15]

Lyndsey Franklin, Catherine Plaisant, Kazi Minhazur Rahman, and Ben Shneiderman. 2016. TreatmentExplorer: An interactive decision aid for medical risk communication and treatment exploration. Interact. Comput. 28, 3 (2016), 238–252.

[16]

Michael Gleicher, Danielle Albers, Rick Walker, Ilir Jusufi, Charles D. Hansen, and Jonathan C. Roberts. 2011. Visual comparison for information visualization. Inf. Vis. 10, 4 (2011), 289–309.

Digital Library

[17]

Michael Glueck, Alina Gvozdik, Fanny Chevalier, Azam Khan, Michael Brudno, and Daniel Wigdor. 2017. PhenoStacks: Cross-sectional cohort phenotype comparison visualizations. IEEE Trans. Vis. Comput. Graph. 23, 1 (2017), 191–200.

Digital Library

[18]

Michael Glueck, Peter Hamilton, Fanny Chevalier, Simon Breslav, Azam Khan, Daniel Wigdor, and Michael Brudno. 2016. PhenoBlocks: Phenotype comparison visualizations. IEEE Trans. Vis. Comput. Graph. 22, 1 (2016), 101–110.

[19]

Carlos A. Gomez-Uribe and Neil Hunt. 2016. The Netflix recommender system: Algorithms, business value, and innovation. ACM Trans. Manage. Inf. Syst. 6, 4 (2016), 13:1–13:19.

Digital Library

[20]

Fabio Grandi. 2010. T-SPARQL: A TSQL2-like temporal query language for RDF. In Proceedings of the International Workshop on Querying Graph Structured Data. 21–30.

[21]

Marti A. Hearst. 1995. TileBars: Visualization of term distribution information in full text information access. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 59–66.

Digital Library

[22]

Jeffrey Heer and George Robertson. 2007. Animated transitions in statistical data graphics. IEEE Trans. Vis. Comput. Graph. 13, 6 (2007), 1240–1247.

Digital Library

[23]

Jonathan L. Herlocker, Joseph A. Konstan, and John Riedl. 2000. Explaining collaborative filtering recommendations. In Proceedings of the ACM Conference on Computer Supported Cooperative Work. 241–250.

Digital Library

[24]

Sylvia Ann Hewlett, Melinda Marshall, and Laura Sherbin. 2013. How diversity can drive innovation. Harv. Bus. Rev. 91, 12 (2013), 30–30.

[25]

Harry Hochheiser and Ben Shneiderman. 2004. Dynamic query tools for time series data sets: Timebox widgets for interactive exploration. Inf. Vis. 3, 1 (2004), 1–18.

Digital Library

[26]

Daniel A Keim. 2000. Designing pixel-oriented visualization techniques: Theory and applications. IEEE Trans. Vis. Comput. Graph. 6, 1 (2000), 59–78.

Digital Library

[27]

Josua Krause, Adam Perer, and Harry Stavropoulos. 2016. Supporting iterative cohort construction with visual temporal queries. IEEE Trans. Vis. Comput. Graph. 22, 1 (2016), 91–100.

[28]

Eric S. Lander, Lauren M. Linton, Bruce Birren, Chad Nusbaum, Michael C. Zody, Jennifer Baldwin, Keri Devon, Ken Dewar, Michael Doyle, William FitzHugh, et al. 2001. Initial sequencing and analysis of the human genome. Nature 409, 6822 (2001), 860–921.

[29]

Weizhong Li and Adam Godzik. 2006. Cd-hit: A fast program for clustering and comparing large sets of protein or nucleotide sequences. Bioinformatics 22, 13 (2006), 1658–1659.

Digital Library

[30]

Greg Linden, Brent Smith, and Jeremy York. 2003. Amazon.com recommendations: Item-to-item collaborative filtering. IEEE Internet Comput. 7, 1 (2003), 76–80.

Digital Library

[31]

Ran Liu, Tiffany Chao, Catherine Plaisant, and Ben Shneiderman. 2012. ManyLists: Product Comparison Tool Using Spatial Layouts with Animated Transitions. Technical Report. University of Maryland.

[32]

Sana Malik, Ben Shneiderman, Fan Du, Catherine Plaisant, and Margret Bjarnadottir. 2016. High-volume hypothesis testing: Systematic exploration of event sequence comparisons. ACM Trans. Interact. Intell. Syst. 6, 1 (2016), 9:1–9:23.

Digital Library

[33]

Matthew Louis Mauriello, Ben Shneiderman, Fan Du, Sana Malik, and Catherine Plaisant. 2016. Simplifying overviews of temporal event sequences. In CHI Extended Abstracts on Human Factors in Computing Systems. 2217–2224.

Digital Library

[34]

Megan Monroe, Rongjian Lan, Juan Morales del Olmo, Ben Shneiderman, Catherine Plaisant, and Jeff Millstein. 2013. The challenges of specifying intervals and absences in temporal queries: A graphical language approach. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2349–2358.

Digital Library

[35]

Gonzalo Navarro. 2001. A guided tour to approximate string matching. Comput. Surv. 33, 1 (2001), 31–88.

Digital Library

[36]

Cathy O’Neil. 2016. Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy. Crown Publishing Group.

Digital Library

[37]

Alexandra Papoutsaki, Hua Guo, Danae Metaxa-Kakavouli, Connor Gramazio, Jeff Rasley, Wenting Xie, Guan Wang, and Jeff Huang. 2015. Crowdsourcing from scratch: A pragmatic experiment in data collection by novice requesters. In Proceedings of the AAAI Conference on Human Computation and Crowdsourcing.

[38]

Catherine Plaisant, Ben Shneiderman, and Rich Mushlin. 1998. An information architecture to support the visualization of personal histories. Inf. Process. Manage. 34, 5 (1998), 581–597.

Digital Library

[39]

Catherine Plaisant, Johnny Wu, A. Zach Hettinger, Seth Powsner, and Ben Shneiderman. 2015. Novel user interface design for medication reconciliation: An evaluation of Twinlist. J. Am. Med. Inf. Assoc. 22, 2 (2015), 340–349.

[40]

Katie Powell, John Wilcox, Angie Clonan, Paul Bissell, Louise Preston, Marian Peacock, and Michelle Holdsworth. 2015. The role of social networks in the development of overweight and obesity among adults: A scoping review. BMC Publ. Health 15, 1 (2015), 996.

[41]

Paul Resnick, Neophytos Iacovou, Mitesh Suchak, Peter Bergstrom, and John Riedl. 1994. GroupLens: An open architecture for collaborative filtering of netnews. In Proceedings of the ACM Conference on Computer Supported Cooperative Work. 175–186.

Digital Library

[42]

Simone Santini and Ramesh Jain. 1999. Similarity measures. IEEE Trans. Pattern Anal. Mach. Intell. 21, 9 (1999), 871–883.

Digital Library

[43]

Ben Shneiderman. 1994. Dynamic queries for visual information seeking. IEEE Softw. 11, 6 (1994), 70–77.

Digital Library

[44]

Rashmi Sinha and Kirsten Swearingen. 2002. The role of transparency in recommender systems. In CHI Extended Abstracts on Human Factors in Computing Systems. 830–831.

Digital Library

[45]

Mike Sips, Jörn Schneidewind, Daniel A. Keim, and Heidrun Schumann. 2006. Scalable pixel-based visual interfaces: Challenges and solutions. In Information Visualization. 32–38.

Digital Library

[46]

Richard Snodgrass. 1987. The temporal query language TQuel. ACM Trans. Database Syst. 12, 2 (1987), 247–298.

Digital Library

[47]

Michael Spenke. 2001. Visualization and interactive analysis of blood parameters with InfoZoom. Artif. Intell. Med. 22, 2 (2001), 159–172.

Digital Library

[48]

Melanie Swan. 2012. Crowdsourced health research studies: An important emerging complement to clinical trials in the public health research ecosystem. J. Med. Internet Res. 14, 2 (2012), e46.

[49]

Daniel Tunkelang. 2009. Faceted search. Synth. Lect. Inf. Concepts Retriev. Serv. 1, 1 (2009), 1–80.

Digital Library

[50]

Junpeng Wang, Xiaotong Liu, Han-Wei Shen, and Guang Lin. 2017. Multi-resolution climate ensemble parameter analysis with nested parallel coordinates plots. IEEE Trans. Vis. Comput. Graph. 23, 1 (2017), 81–90.

Digital Library

[51]

Paul Wicks, Michael Massagli, Jeana Frost, Catherine Brownstein, Sally Okun, Timothy Vaughan, Richard Bradley, and James Heywood. 2010. Sharing health data for better outcomes on PatientsLikeMe. J. Med. Internet Res. 12, 2 (2010), e19.

[52]

Max L. Wilson, Paul André, et al. 2008. Backward highlighting: Enhancing faceted search. In Proceedings of the Annual ACM Symposium on User Interface Software and Technology. 235–238.

Digital Library

[53]

Kanit Wongsuphasawat, Zening Qu, Dominik Moritz, Riley Chang, Felix Ouk, Anushka Anand, Jock Mackinlay, Bill Howe, and Jeffrey Heer. 2017. Voyager 2: Augmenting visual analysis with partial view specifications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2648–2659.

Digital Library

[54]

Krist Wongsuphasawat and Ben Shneiderman. 2009. Finding comparable temporal categorical records: A similarity measure with an interactive visualization. In Proceedings of the IEEE Symposium on Visual Analytics Science and Technology. 27–34.

[55]

World Health Organization. 1992. The tenth revision of the international classification of diseases and related health problems (ICD-10).

[56]

Yingcai Wu, Nan Cao, David Gotz, Yap-Peng Tan, and Daniel A. Keim. 2016. A survey on visual analytics of social media data. IEEE Trans. Multimedia 18, 11 (2016), 2135–2148.

Digital Library

[57]

Yanhong Wu, Naveen Pitipornvivat, Jian Zhao, Sixiao Yang, Guowei Huang, and Huamin Qu. 2016. egoslider: Visual analysis of egocentric network evolution. IEEE Trans. Visu. Comput. Graph. 22, 1 (2016), 260–269.

[58]

Mehmet Adil Yalçın, Niklas Elmqvist, and Benjamin B. Bederson. 2018. Keshif: Rapid and expressive tabular data exploration for novices. IEEE Trans. Vis. Comput. Graph. 24, 8 (2018), 2339–2352.

[59]

Emanuel Zgraggen, Steven M. Drucker, Danyel Fisher, and Robert DeLine. 2015. (s|qu)eries: Visual regular expressions for querying and exploring event sequences. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2683–2692.

Digital Library

[60]

Jian Zhao, Michael Glueck, Fanny Chevalier, Yanhong Wu, and Azam Khan. 2016. Egocentric analysis of dynamic networks with EgoLines. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 5003–5014.

Digital Library

[61]

Jian Zhao, Zhicheng Liu, Mira Dontcheva, Aaron Hertzmann, and Alan Wilson. 2015. MatrixWave: Visual comparison of event sequence data. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 259–268.

Digital Library

Cited By

Margaris DSgardelis KSpiliotopoulos DVassilakis C(2024)Exploiting Rating Prediction Certainty for Recommendation Formulation in Collaborative FilteringBig Data and Cognitive Computing10.3390/bdcc80600538:6(53)Online publication date: 27-May-2024
https://doi.org/10.3390/bdcc8060053
Guo ZTao JChen SChawla NWang C(2023) SD 2 : Slicing and Dicing Scholarly Data for Interactive Evaluation of Academic Performance IEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.316372729:8(3569-3585)Online publication date: 1-Aug-2023
https://doi.org/10.1109/TVCG.2022.3163727
van der Linden Sde Fouw Evan den Elzen SVilanova A(2023)A survey of visualization techniques for comparing event sequencesComputers & Graphics10.1016/j.cag.2023.05.016115(522-542)Online publication date: Oct-2023
https://doi.org/10.1016/j.cag.2023.05.016
Show More Cited By

Index Terms

Visual Interfaces for Recommendation Systems: Finding Similar and Dissimilar Peers
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Graphical user interfaces
  2. Visualization
    1. Visualization application domains
      1. Visual analytics
2. Information systems
  1. Information retrieval
    1. Retrieval models and ranking
      1. Similarity measures
    2. Retrieval tasks and goals
      1. Recommender systems

Recommendations

EventAction: A Visual Analytics Approach to Explainable Recommendation for Event Sequences

People use recommender systems to improve their decisions; for example, item recommender systems help them find films to watch or books to buy. Despite the ubiquity of item recommender systems, they can be improved by giving users greater transparency ...
Evaluating the Role of Time in Investigative Analysis of Document Collections

Time is a universal and essential aspect of data in any investigative analysis. It helps analysts establish causality, build storylines from evidence, and reject infeasible hypotheses. For this reason, many investigative analysis tools provide visual ...
Advanced visual analytics interfaces
AVI '10: Proceedings of the International Conference on Advanced Visual Interfaces

Advanced visual interfaces, like the ones found in information visualization, intend to offer a view on abstract data spaces to enable users to make sense of them. By mapping data to visual representations and providing interactive tools to explore and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Intelligent Systems and Technology

ACM Transactions on Intelligent Systems and Technology Volume 10, Issue 1

Special Issue on Visual Analytics

January 2019

235 pages

ISSN:2157-6904

EISSN:2157-6912

DOI:10.1145/3295616

Editor:
Yu Zheng
JD Finance, China

Issue’s Table of Contents

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 November 2018

Accepted: 01 February 2018

Revised: 01 February 2018

Received: 01 August 2017

Published in TIST Volume 10, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Adobe Research

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
493
Total Downloads

Downloads (Last 12 months)58
Downloads (Last 6 weeks)7

Reflects downloads up to 30 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Margaris DSgardelis KSpiliotopoulos DVassilakis C(2024)Exploiting Rating Prediction Certainty for Recommendation Formulation in Collaborative FilteringBig Data and Cognitive Computing10.3390/bdcc80600538:6(53)Online publication date: 27-May-2024
https://doi.org/10.3390/bdcc8060053
Guo ZTao JChen SChawla NWang C(2023) SD 2 : Slicing and Dicing Scholarly Data for Interactive Evaluation of Academic Performance IEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.316372729:8(3569-3585)Online publication date: 1-Aug-2023
https://doi.org/10.1109/TVCG.2022.3163727
van der Linden Sde Fouw Evan den Elzen SVilanova A(2023)A survey of visualization techniques for comparing event sequencesComputers & Graphics10.1016/j.cag.2023.05.016115(522-542)Online publication date: Oct-2023
https://doi.org/10.1016/j.cag.2023.05.016
Guesmi MChatti MTayyar AAin QJoarder S(2022)Interactive Visualizations of Transparent User Models for Self-Actualization: A Human-Centered Design ApproachMultimodal Technologies and Interaction10.3390/mti60600426:6(42)Online publication date: 30-May-2022
https://doi.org/10.3390/mti6060042
Kavaz EPuig ARodríguez IChacón RDe-La-Paz DTorralba ANofre MTaule M(2022)Visualisation of hierarchical multivariate data: Categorisation and case study on hate speechInformation Visualization10.1177/1473871622112050922:1(31-51)Online publication date: 2-Sep-2022
https://doi.org/10.1177/14738716221120509
Buono PValdivia PBottoni PPanizzi E(2022)Applications of dynamic hypergraph visualizationProceedings of the 2022 International Conference on Advanced Visual Interfaces10.1145/3531073.3534495(1-3)Online publication date: 6-Jun-2022
https://dl.acm.org/doi/10.1145/3531073.3534495
Guo YGuo SJin ZKaul SGotz DCao N(2022)Survey on Visual Analysis of Event Sequence DataIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.310041328:12(5091-5112)Online publication date: 1-Dec-2022
https://dl.acm.org/doi/10.1109/TVCG.2021.3100413
Guo RFujiwara TLi YLima KSen STran NMa K(2020)Comparative visual analytics for assessing medical records with sequence embeddingVisual Informatics10.1016/j.visinf.2020.04.001Online publication date: Apr-2020
https://doi.org/10.1016/j.visinf.2020.04.001
Du FPlaisant CSpring NCrowley KShneiderman B(2019)EventActionACM Transactions on Interactive Intelligent Systems10.1145/33014029:4(1-31)Online publication date: 9-Aug-2019
https://dl.acm.org/doi/10.1145/3301402

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Issue’s Table of Contents