research-article

Visual Re-Ranking for Multi-Aspect Information Retrieval

Authors:

Khalil Klouche,

Tuukka Ruotsalo,

Luana Micallef,

Salvatore Andolina,

Giulio JacucciAuthors Info & Claims

CHIIR '17: Proceedings of the 2017 Conference on Conference Human Information Interaction and Retrieval

Pages 57 - 66

https://doi.org/10.1145/3020165.3020174

Published: 07 March 2017 Publication History

Abstract

We present visual re-ranking, an interactive visualization technique for multi-aspect information retrieval. In multi-aspect search, the information need of the user consists of more than one aspect or query simultaneously. While visualization and interactive search user interface techniques for improving user interpretation of search results have been proposed, the current research lacks understanding on how useful these are for the user: whether they lead to quantifiable benefits in perceiving the result space and allow faster, and more precise retrieval. Our technique visualizes relevance and document density on a two-dimensional map with respect to the query phrases. Pointing to a location on the map specifies a weight distribution of the relevance to each of the query phrases, according to which search results are re-ranked. User experiments compared our technique to a uni-dimensional search interface with typed query and ranked result list, in perception and retrieval tasks. Visual re-ranking yielded improved accuracy in perception, higher precision in retrieval and overall faster task execution. Our findings demonstrate the utility of visual re-ranking, and can help designing search user interfaces that support multi-aspect search.

References

[1]

C. Ahlberg and B. Shneiderman. Visual information seeking: Tight coupling of dynamic query filters with starfield displays. In Proc. CHI'94, pages 313--317. ACM, 1994.

Digital Library

[2]

C. Ahlberg, C. Williamson, and B. Shneiderman. Dynamic queries for information exploration: An implementation and evaluation. In Proc. CHI'92, pages 619--626. ACM, 1992.

Digital Library

[3]

J.-W. Ahn and P. Brusilovsky. Adaptive visualization of search results: Bringing user models to visual analytics. Information Visualization, 8(3):167--179, 2009.

Digital Library

[4]

B. Alsallakh, L. Micallef, W. Aigner, H. Hauser, S. Miksch, and P. Rodgers. Visualizing sets and set-typed data: State-of-the-art and future challenges. In EuroVis- State of The Art Reports, pages 1--21. Eurographics, 2014.

[5]

B. Amento, W. Hill, L. Terveen, D. Hix, and P. Ju. An empirical evaluation of user interfaces for topic management of web sites. In Proc. CHI'99, pages 552--559. ACM, 1999.

Digital Library

[6]

S. Andolina, K. Klouche, J. Peltonen, M. Hoque, T. Ruotsalo, D. Cabral, A. Klami, D. Głowacka, P. Floréen, and G. Jacucci. Intentstreams: smart parallel search streams for branching exploratory search. In Proc. IUI'15, pages 300--305. ACM, 2015.

Digital Library

[7]

S. Benford, D. Snowdon, C. Greenhalgh, R. Ingram, I. Knox, and C. Brown. Vr-vibe: A virtual environment for co-operative information retrieval. In Computer Graphics Forum, volume 14, pages 349--360. Wiley, 1995.

Digital Library

[8]

P. P. Bonissone, R. Subbu, and J. Lizzi. Multicriteria decision making (MCDM): a framework for research and applications. Computational Intelligence Magazine, 4(3):48--61, 2009.

Digital Library

[9]

K. W. Boyack, B. N. Wylie, and G. S. Davidson. Domain visualization using VxInsight® for science and technology management. JASIST, 53(9):764--774, 2002.

Digital Library

[10]

M. Chalmers and P. Chitson. Bead: Explorations in information visualization. In Proc. SIGIR'92, pages 330--337. ACM, 1992.

Digital Library

[11]

F. Das-Neves, E. A. Fox, and X. Yu. Connecting topics in document collections with stepping stones and pathways. In Proc. CIKM'05, pages 91--98. ACM, 2005.

Digital Library

[12]

B. Fortuna, M. Grobelnik, and D. Mladenic. Visualization of text document corpus. Informatica, 29(4):497--502, 2005.

[13]

S. Gratzl, A. Lex, N. Gehlenborg, H. Pfister, and M. Streit. Lineup: Visual analysis of multi-attribute rankings. TVCG, 19(12):2277--2286, Dec 2013.

Digital Library

[14]

S. Havre, E. Hetzler, K. Perrine, E. Jurrus, and N. Miller. Interactive visualization of multiple query results. In Information Visualization, page 105. IEEE, 2001.

Digital Library

[15]

M. A. Hearst. Tilebars: Visualization of term distribution information in full text information access. In Proc. CHI'95, pages 59--66. ACM, 1995.

Digital Library

[16]

E. Hetzler and A. Turner. Analysis experiences using information visualization. IEEE CG&A, 24(5):22--26, 2004.

Digital Library

[17]

O. Hoeber and X. D. Yang. Interactive web information retrieval using wordbars. In International Conference on Web Intelligence, pages 875--882. IEEE, 2006.

Digital Library

[18]

O. Hoeber and X. D. Yang. The visual exploration of web search results using hotmap. In Proc. IV'06, pages 157--165. IEEE Computer Society, 2006.

Digital Library

[19]

C. Kang, X. Wang, Y. Chang, and B. Tseng. Learning to rank with multi-aspect relevance for vertical search. In Proc. WSDM'12, pages 453--462. ACM, 2012.

Digital Library

[20]

S. Kaski, T. Honkela, K. Lagus, and T. Kohonen. WEBSOM--self-organizing maps of document collections. Neurocomputing, 21(1):101--117, 1998.

[21]

A. Kerne, E. Koh, B. Dworaczyk, J. M. Mistrot, H. Choi, S. M. Smith, R. Graeber, D. Caruso, A. Webb, R. Hill, and J. Albea. combinformation: A mixed-initiative system for representing collections as compositions of image and text surrogates. In Proc. JCDL'06, pages 11--20. ACM, 2006.

Digital Library

[22]

P. Kidwell, G. Lebanon, and W. S. Cleveland. Visualizing incomplete and partially ranked data. volume 14, pages 1356--1363. IEEE, 2008.

Digital Library

[23]

K. Klouche, T. Ruotsalo, D. Cabral, S. Andolina, A. Bellucci, and G. Jacucci. Designing for exploratory search on touch devices. In Proc. CHI'15, pages 4189--4198. ACM, 2015.

Digital Library

[24]

K. Kucher and A. Kerren. Text visualization techniques: Taxonomy, visual survey, and community insights. In PacificVis'15, pages 117--121. IEEE Computer Society, 2015.

[25]

B. Kules and B. Shneiderman. Users can change their web search tactics: Design guidelines for categorized overviews. IPM, 44(2):463--484, 2008.

Digital Library

[26]

X. Lin. Map displays for information retrieval. JASIS, 48(1):40--54, 1997.

Digital Library

[27]

J. Mackinlay. Automating the design of graphical presentations of relational information. TOG, 5(2):110--141, 1986.

Digital Library

[28]

J. Matejka, F. Anderson, and G. Fitzmaurice. Dynamic opacity optimization for scatter plots. In Proc. CHI'15, pages 2707--2710. ACM, 2015.

Digital Library

[29]

N. E. Miller, P. C. Wong, M. Brewster, and H. Foote. Topic islands tm-a wavelet-based text visualization system. In Proc. VIS, pages 189--196. IEEE, 1998.

Digital Library

[30]

E. Morse and M. Lewis. Why information retrieval visualizations sometimes fail. In Proc. IEEE SMC'97, volume 2, pages 1680--1685, Oct 1997.

[31]

T. Munzner, F. Guimbretière, S. Tasiran, L. Zhang, and Y. Zhou. TreeJuxtaposer: scalable tree comparison using focus context with guaranteed visibility. TOG, 22(3):453--462, 2003.

Digital Library

[32]

A. Nuchprayoon and R. R. Korfhage. Guido, a visual tool for retrieving documents. In Proc. VL/HCC'94, pages 64--71. IEEE, 1994.

[33]

K. A. Olsen, R. R. Korfhage, K. M. Sochats, M. B. Spring, and J. G. Williams. Visualization of a document collection: The VIBE system. IPM, 29(1):69--81, 1993.

Digital Library

[34]

J. M. Ponte and W. B. Croft. A language modeling approach to information retrieval. In Proc. SIGIR'98, pages 275--281. ACM, 1998.

Digital Library

[35]

T. Porter and T. Duff. Compositing digital images. In Proc. SIGGRAPH'84, pages 253--259. ACM, 1984.

Digital Library

[36]

V. V. Raghavan and S. M. Wong. A critical analysis of vector space model for information retrieval. JASIS, 37(5):279--287, 1986.

[37]

S. E. Robertson. Readings in information retrieval. chapter The Probability Ranking Principle in IR, pages 281--286. Morgan Kaufmann Publishers Inc., 1997.

Digital Library

[38]

R. M. Rohrer, D. S. Ebert, and J. L. Sibert. The shape of Shakespeare: visualizing text using implicit surfaces. In Proc. InfoVis, pages 121--129. IEEE, 1998.

Digital Library

[39]

T. Ruotsalo, G. Jacucci, P. Myllym\"aki, and S. Kaski. Interactive intent modeling: Information discovery beyond search. Communications of the ACM, 58(1):86--92, 2015.

Digital Library

[40]

T. Ruotsalo, J. Peltonen, M. Eugster, D. Głowacka, K. Konyushkova, K. Athukorala, I. Kosunen, A. Reijonen, P. Myllymäki, G. Jacucci, et al. Directing exploratory search with interactive intent modeling. In Proc. CIKM'13, pages 1759--1764. ACM, 2013.

Digital Library

[41]

J. Seo and B. Shneiderman. A rank-by-feature framework for interactive exploration of multidimensional data. Information Visualization, 4(2):96--113, 2005.

Digital Library

[42]

C. Shi, W. Cui, S. Liu, P. Xu, W. Chen, and H. Qu. RankExplorer: Visualization of ranking changes in large time series data. TVCG, 18(12):2669--2678, 2012.

Digital Library

[43]

B. Shneiderman. Dynamic queries for visual information seeking. Software, 11(6):70--77, Nov 1994.

Digital Library

[44]

B. Shneiderman. The eyes have it: A task by data type taxonomy for information visualizations. In Proc. VL/HCC'96, pages 336--343. IEEE, 1996.

Digital Library

[45]

B. Shneiderman, D. Feldman, A. Rose, and X. F. Grau. Visualizing digital library search results with categorical and hierarchical axes. In Proc. DL'00, pages 57--66. ACM, 2000.

Digital Library

[46]

B. Shneiderman, C. Plaisant, M. Cohen, and S. Jacobs. Designing the User Interface: Strategies for Effective Human-Computer Interaction. Addison-Wesley Publishing Company, 5th edition, 2009.

Digital Library

[47]

W. Song, Q. Yu, Z. Xu, T. Liu, S. Li, and J.-R. Wen. Multi-aspect query summarization by composite query. In Proc. SIGIR'12, pages 325--334. ACM, 2012.

Digital Library

[48]

A. Spoerri. InfoCrystal: A visual tool for information retrieval & management. In Proc. CIKM'93, pages 11--20. ACM, 1993.

Digital Library

[49]

J. Wise, J. J. Thomas, K. Pennock, D. Lantrip, M. Pottier, A. Schur, V. Crow, et al. Visualizing the non-visual: spatial analysis and interaction with information from text documents. In Proc. Information Visualization, pages 51--58. IEEE, 1995.

Digital Library

[50]

D. Xin, J. Han, H. Cheng, and X. Li. Answering top-k queries with multi-dimensional selections: The ranking cube approach. In Proc. VLDB'06, pages 463--474. VLDB, 2006.

Digital Library

[51]

C. Zhai and J. Lafferty. A study of smoothing methods for language models applied to information retrieval. TOIS, 22(2):179--214, 2004.

Digital Library

[52]

J. Zhang. Tofir: A tool of facilitating information retrieval--introduce a visual retrieval model. IPM, 37(4):639--657, 2001.

Digital Library

[53]

J. Zhang and R. R. Korfhage. Dare: Distance and angle retrieval environment: A tale of the two measures. JASIS, 50(9):779--787, 1999.

Digital Library

Cited By

Roßner DAtzenbeck CBrooker S(2023)SPOREProceedings of the 34th ACM Conference on Hypertext and Social Media10.1145/3603163.3609075(1-6)Online publication date: 4-Sep-2023
https://dl.acm.org/doi/10.1145/3603163.3609075
Roßner DAtzenbeck CGross TBellogín ABoratto LCena F(2022)The Effects of Spatial Visualization versus Ranked Lists on Quality, Time Efficiency, and InteractionProceedings of the 33rd ACM Conference on Hypertext and Social Media10.1145/3511095.3531286(132-142)Online publication date: 28-Jun-2022
https://dl.acm.org/doi/10.1145/3511095.3531286
He CMicallef LSerim BVuong TRuotsalo TJacucci G(2022)Interactive visual facets to support fluid exploratory searchJournal of Visualization10.1007/s12650-022-00865-426:1(211-230)Online publication date: 30-Jul-2022
https://doi.org/10.1007/s12650-022-00865-4
Show More Cited By

Index Terms

Visual Re-Ranking for Multi-Aspect Information Retrieval
1. Information systems
  1. Information retrieval
    1. Evaluation of retrieval results
      1. Presentation of retrieval results
    2. Users and interactive retrieval
      1. Search interfaces

Recommendations

Empirical Study of a 3D Visualization for Information Retrieval Tasks
Special issue: A survey of research questions for intelligent information systems in education

There are many challenges to visualizing information including choosing between 2D and 3D interfaces, navigation and interaction methods, and selecting an appropriate level of detail. Visualizing information retrieval (IR) search results, including Web ...
Interactive Information Retrieval Using Clustering and Spatial Proximity

A web-based search engine responds to a user's query with a list of documents. This list can be viewed as the engine's model of the user's idea of relevance--the engine `believes' that the first document is the most likely to be relevant, the second is ...
MapReduce Based Information Retrieval Algorithms for Efficient Ranking of Webpages

In this paper, the authors discuss the MapReduce implementation of crawler, indexer and ranking algorithms in search engines. The proposed algorithms are used in search engines to retrieve results from the World Wide Web. A crawler and an indexer in a ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHIIR '17: Proceedings of the 2017 Conference on Conference Human Information Interaction and Retrieval

March 2017

454 pages

ISBN:9781450346771

DOI:10.1145/3020165

Conference Chairs:
Ragnar Nordlie
Oslo & Akershus University College of Applied Sciences, Norway
,
Nils Pharo
Oslo and Akershus University College of Applied Sciences, Norway
,
Program Chairs:
Luanne Freund
University of British Columbia, Canada
,
Birger Larsen
Aalborg University, Denmark
,
Dan Russel
Google, USA

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGIR: ACM Special Interest Group on Information Retrieval

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 March 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

FP7

Conference

CHIIR '17

Sponsor:

SIGIR

CHIIR '17: Conference on Human Information Interaction and Retrieval

March 7 - 11, 2017

Oslo, Norway

Acceptance Rates

CHIIR '17 Paper Acceptance Rate 10 of 48 submissions, 21%;

Overall Acceptance Rate 55 of 163 submissions, 34%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

23
Total Citations
View Citations
543
Total Downloads

Downloads (Last 12 months)39
Downloads (Last 6 weeks)2

Reflects downloads up to 04 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Roßner DAtzenbeck CBrooker S(2023)SPOREProceedings of the 34th ACM Conference on Hypertext and Social Media10.1145/3603163.3609075(1-6)Online publication date: 4-Sep-2023
https://dl.acm.org/doi/10.1145/3603163.3609075
Roßner DAtzenbeck CGross TBellogín ABoratto LCena F(2022)The Effects of Spatial Visualization versus Ranked Lists on Quality, Time Efficiency, and InteractionProceedings of the 33rd ACM Conference on Hypertext and Social Media10.1145/3511095.3531286(132-142)Online publication date: 28-Jun-2022
https://dl.acm.org/doi/10.1145/3511095.3531286
He CMicallef LSerim BVuong TRuotsalo TJacucci G(2022)Interactive visual facets to support fluid exploratory searchJournal of Visualization10.1007/s12650-022-00865-426:1(211-230)Online publication date: 30-Jul-2022
https://doi.org/10.1007/s12650-022-00865-4
Düring MKalyakin RBunout EGuido D(2021)Impresso Inspect and Compare. Visual Comparison of Semantically Enriched Historical Newspaper ArticlesInformation10.3390/info1209034812:9(348)Online publication date: 27-Aug-2021
https://doi.org/10.3390/info12090348
He CMicallef LSerim BVuong TRuotsalo TJacucci G(2021)Interactive Visual Facets to Support Fluid Exploratory SearchProceedings of the 14th International Symposium on Visual Information Communication and Interaction10.1145/3481549.3481565(1-10)Online publication date: 6-Sep-2021
https://dl.acm.org/doi/10.1145/3481549.3481565
Jacucci GDaee PVuong TAndolina SKlouche KSjöberg MRuotsalo TKaski S(2021)Entity Recommendation for Everyday Digital TasksACM Transactions on Computer-Human Interaction10.1145/345891928:5(1-41)Online publication date: 20-Aug-2021
https://dl.acm.org/doi/10.1145/3458919
Lyu YGao FWu ILim B(2021)Imma Sort by Two or More Attributes With Interpretable Monotonic Multi-Attribute SortingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.304348727:4(2369-2384)Online publication date: 1-Apr-2021
https://doi.org/10.1109/TVCG.2020.3043487
Roßner DAtzenbeck CGross T(2021)Spatial Layout Versus List Layout: A Comparative StudyHuman-Computer-Interaction – INTERACT 202110.1007/978-3-030-85607-6_65(495-498)Online publication date: 27-Aug-2021
https://doi.org/10.1007/978-3-030-85607-6_65
di Sciascio CVeas EBarria-Pineda JCulley CPaternò FOliver NConati CSpano LTintarev N(2020)Understanding the effects of control and transparency in searching as learningProceedings of the 25th International Conference on Intelligent User Interfaces10.1145/3377325.3377524(498-509)Online publication date: 17-Mar-2020
https://dl.acm.org/doi/10.1145/3377325.3377524
Pereira MEtemad EPaulovich FHung CCerny TShin DBechini A(2020)Iterative learning to rank from explicit relevance feedbackProceedings of the 35th Annual ACM Symposium on Applied Computing10.1145/3341105.3374002(698-705)Online publication date: 30-Mar-2020
https://dl.acm.org/doi/10.1145/3341105.3374002
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents