research-article

Open access

Olio: A Semantic Search Interface for Data Repositories

Authors:

Andriy Kanyuka, and

Arjun SrinivasanAuthors Info & Claims

UIST '23: Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology

October 2023

Article No.: 95, Pages 1 - 16

https://doi.org/10.1145/3586183.3606806

Published: 29 October 2023 Publication History

All formats PDF

Abstract

Search and information retrieval systems are becoming more expressive in interpreting user queries beyond the traditional weighted bag-of-words model of document retrieval. For example, searching for a flight status or a game score returns a dynamically generated response along with supporting, pre-authored documents contextually relevant to the query. In this paper, we extend this hybrid search paradigm to data repositories that contain curated data sources and visualization content. We introduce a semantic search interface, Olio, that provides a hybrid set of results comprising both auto-generated visualization responses and pre-authored charts to blend analytical question-answering with content discovery search goals. We specifically explore three search scenarios - question-and-answering, exploratory search, and design search over data repositories. The interface also provides faceted search support for users to refine and filter the conventional best-first search results based on parameters such as author name, time, and chart type. A preliminary user evaluation of the system demonstrates that Olio’s interface and the hybrid search paradigm collectively afford greater expressivity in how users discover insights and visualization content in data repositories.

Supplementary Material

ZIP File (3606806.zip)

Supplemental File

Download
53.86 MB

References

[1]

2018. 120 years of Olympic history: Athletes and results. https://www.kaggle.com/datasets/heesoo37/120-years-of-olympic-history-athletes-and-results. Accessed: 2023.

[2]

2023. Bing Search. https://www.bing.com/.

[3]

2023. Cisco WebexTM. https://www.webex.com.

[4]

2023. Covid-19 Dataset. CC-BY Dataset: https://covid19.ca.gov.

[5]

2023. Elasticsearch. https://www.elastic.co/elasticsearch/.

[6]

2023. Google Search. https://www.google.com/.

[7]

2023. IBM Watson Analytics. http://www.ibm.com/analytics/watson-analytics.

[8]

2023. Tableau Superstore. CC-BY Dataset: https://help.tableau.com/current/guides/get-started-tutorial/en-us/get-started-tutorial-connect.htm.

[9]

2023. ThoughtSpot. http://www.thoughtspot.com.

[10]

2023. U.S. Crimes. CC-BY Dataset: https://www.kaggle.com/datasets/johnybhiduri/us-crime-data.

[11]

2023. U.S. House Listings. CC-BY Dataset: https://www.kaggle.com/datasets/austinreese/usa-housing-listings.

[12]

Marco D. Adelfio and Hanan Samet. 2013. Schema Extraction for Tabular Data on the Web. Proc. VLDB Endow. 6, 6 (apr 2013), 421–432. https://doi.org/10.14778/2536336.2536343

Digital Library

[13]

Christopher Ahlberg and Ben Shneiderman. 1994. Visual information seeking: Tight coupling of dynamic query filters with starfield displays. In Proceedings of the SIGCHI conference on Human factors in computing systems. 313–317.

Digital Library

[14]

Eija Airio, Kalervo Järvelin, Pirkko Saatsi, Jaana Kekäläinen, and Sari Suomela. 2004. CIRI - An Ontology-based Query Interface for Text Retrieval (1 ed.). Number 20 in Publications of the Finnish Artificial Intelligence Society. Finnish Artificial Intelligence Society, 73–82.

[15]

Shivam Bansal. 2021. Netflix movies and TV shows. https://www.kaggle.com/shivamb/netflix-shows. Accessed: 2023.

[16]

Cory Barr, Rosie Jones, and Moira Regelson. 2008. The linguistic structure of English web-search queries. In Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing. 1021–1030.

[17]

Leilani Battle, Danni Feng, and Kelli Webber. 2021. Exploring Visualization Implementation Challenges Faced by D3 Users Online. arXiv preprint arXiv:2108.02299 (2021).

[18]

Ravish Bhagdev, Sam Chapman, Fabio Ciravegna, Vitaveska Lanfranchi, and Daniela Petrelli. 2008. Hybrid Search: Effectively Combining Keywords and Semantic Searches. 554–568. https://doi.org/10.1007/978-3-540-68234-9_41

[19]

Arjun Bhaybhang. 2022. Coffee Chains Dataset. https://www.kaggle.com/datasets/arjunbhaybhang/coffee-chains-dataset. Accessed: 2023.

[20]

Michael Bostock, Vadim Ogievetsky, and Jeffrey Heer. 2011. D3: Data-Driven Documents. IEEE Transactions on Visualization and Computer Graphics (2011). http://idl.cs.washington.edu/papers/d3

[21]

D. Buscaldi, Paolo Rosso, and Emilio Sanchis Arnal. 2005. A WordNet-based Query Expansion Method for Geographical Information Retrieval. In Conference and Labs of the Evaluation Forum.

[22]

Gong Cheng, Weiyi Ge, and Yuzhong Qu. 2008. Falcons: Searching and Browsing Entities on the Semantic Web. In Proceedings of the 17th International Conference on World Wide Web (Beijing, China) (WWW ’08). Association for Computing Machinery, New York, NY, USA, 1101–1102. https://doi.org/10.1145/1367497.1367676

Digital Library

[23]

Christina Christodoulakis, Eric B. Munson, Moshe Gabel, Angela Demke Brown, and Renée J. Miller. 2020. Pytheas: Pattern-Based Table Discovery in CSV Files. Proc. VLDB Endow. 13, 12 (jul 2020), 2075–2089. https://doi.org/10.14778/3407790.3407810

Digital Library

[24]

Xu Chu, Ihab F. Ilyas, Sanjay Krishnan, and Jiannan Wang. 2016. Data Cleaning: Overview and Emerging Challenges. In Proceedings of the 2016 International Conference on Management of Data (San Francisco, California, USA) (SIGMOD ’16). Association for Computing Machinery, New York, NY, USA, 2201–2206. https://doi.org/10.1145/2882903.2912574

Digital Library

[25]

Jennifer Chu-Carroll, John Prager, Krzysztof Czuba, David Ferrucci, and Pablo Duboue. 2006. Semantic Search via XML Fragments: A High-Precision Approach to IR. In Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (Seattle, Washington, USA) (SIGIR ’06). Association for Computing Machinery, New York, NY, USA, 445–452. https://doi.org/10.1145/1148170.1148247

Digital Library

[26]

Philipp Cimiano, Peter Haase, Jörg Heizmann, Matthias Mantel, and Rudi Studer. 2008. Towards Portable Natural Language Interfaces to Knowledge Bases - The Case of the ORAKEL System. Data Knowl. Eng. 65, 2 (may 2008), 325–354. https://doi.org/10.1016/j.datak.2007.10.007

Digital Library

[27]

John Cocke. 1969. Programming languages and their compilers: Preliminary notes. New York University.

[28]

Joe Constantino. 2023. The Evolution of Tableau Search and Best Practices for Finding Relevant Content. https://www.tableau.com/blog/evolution-tableau-search-and-best-practices-finding-relevant-content.

[29]

Olivier Corby, Rose Dieng-Kuntz, and Catherine Faron-Zucker. 2004. Querying the Semantic Web with the CORESE search engine. Proceedings of the 16th European Conference on Artificial Intelligence (ECAI’2004), 705–709.

Digital Library

[30]

Paul A. Crook, Alex Marin, Vipul Agarwal, Samantha Anderson, Ohyoung Jang, Aliasgar Lanewala, Karthik Tangirala, and Imed Zitouni. 2018. Conversational Semantic Search: Looking Beyond Web Search,& and Dialog Systems. In Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining (Marina Del Rey, CA, USA) (WSDM ’18). Association for Computing Machinery, New York, NY, USA, 763–766. https://doi.org/10.1145/3159652.3160590

Digital Library

[31]

Zhe Cui, Sriram Karthik Badam, M Adil Yalçin, and Niklas Elmqvist. 2019. Datasite: Proactive visual data exploration with computation of insight-based recommendations. Information Visualization 18, 2 (2019), 251–267.

[32]

Danica Damljanovic, Milan Agatonovic, and Hamish Cunningham. 2010. Natural Language Interfaces to Ontologies: Combining Syntactic Analysis and Ontology-Based Lookup through the User Interaction. In Extended Semantic Web Conference.

Digital Library

[33]

Çağatay Demiralp, Peter J Haas, Srinivasan Parthasarathy, and Tejaswini Pedapati. 2017. Foresight: Recommending visual insights. arXiv preprint arXiv:1707.03877 (2017).

[34]

Kedar Dhamdhere, Kevin S. McCurley, Ralfi Nahmias, Mukund Sundararajan, and Qiqi Yan. 2017. Analyza: Exploring Data with Conversation. In Proceedings of the 22nd International Conference on Intelligent User Interfaces(IUI 2017). 493–504.

Digital Library

[35]

Li Ding, Tim Finin, Anupam Joshi, Yun Peng, Rong Pan, and Pavan Reddivari. 2005. Search on the Semantic Web. Computer 38 (11 2005), 62 – 69. https://doi.org/10.1109/MC.2005.350

Digital Library

[36]

Massimo Fasciano and Guy Lapalme. 1996. PostGraphe: A System for the Generation of Statistical Graphics and Text. In Eighth International Natural Language Generation Workshop. https://aclanthology.org/W96-0406

[37]

Christiane Fellbaum. 1998. WordNet: An Electronic Lexical Database. Bradford Books.

[38]

Miriam Fernandez, Vanessa Lopez, Marta Sabou, Victoria Uren, David Vallet, Enrico Motta, and Pablo Castells. 2008. Semantic Search Meets the Web. In 2008 IEEE International Conference on Semantic Computing. 253–260. https://doi.org/10.1109/ICSC.2008.52

Digital Library

[39]

Tim Finin, Li Ding, Rong Pan, Anupam Joshi, Pranam Kolari, Akshay Java, and Yun Peng. 2005. Swoogle: Searching for Knowledge on the Semantic Web. In Proceedings of the 20th National Conference on Artificial Intelligence - Volume 4 (Pittsburgh, Pennsylvania) (AAAI’05). AAAI Press, 1682–1683.

[40]

Pasi Fränti, Jaakko Sauvola, and Hannu Törmänen. 2005. Mobile information retrieval with local intent analysis. In Mobile and Ubiquitous Information Access. Springer, 179–192.

[41]

David Freedman, Robert Pisani, and Roger Purves. 2007. Statistics (international student edition). Pisani, R. Purves, 4th edn. WW Norton & Company, New York (2007).

[42]

Simon Frieder, Luca Pinchetti, Ryan-Rhys Griffiths, Tommaso Salvatori, Thomas Lukasiewicz, Philipp Christian Petersen, Alexis Chevalier, and Julius Berner. 2023. Mathematical Capabilities of ChatGPT. arxiv:2301.13867 [cs.LG]

[43]

Sainyam Galhotra and Udayan Khurana. 2020. Semantic Search over Structured Data. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management (Virtual Event, Ireland) (CIKM ’20). Association for Computing Machinery, New York, NY, USA, 3381–3384. https://doi.org/10.1145/3340531.3417426

Digital Library

[44]

Tong Gao, Mira Dontcheva, Eytan Adar, Zhicheng Liu, and Karrie G. Karahalios. 2015. DataTone: Managing Ambiguity in Natural Language Interfaces for Data Visualization. In Proceedings of the 28th Annual ACM Symposium on User Interface Software Technology(UIST 2015). ACM, New York, NY, USA, 489–500.

Digital Library

[45]

Thomas R. Gruber. 1993. A translation approach to portable ontology specifications. Knowledge Acquisition 5, 2 (1993), 199–220. https://doi.org/10.1006/knac.1993.1008

Digital Library

[46]

Ramanathan V. Guha, Rob McCool, and Eric Miller. 2003. Semantic search. In The Web Conference.

Digital Library

[47]

Samira Hammiche, Salima Benbernou, Mohand-Saïd Hacid, and Athena Vakali. 2004. Semantic Retrieval of Multimedia Data. In Proceedings of the 2nd ACM International Workshop on Multimedia Databases (Washington, DC, USA) (MMDB ’04). Association for Computing Machinery, New York, NY, USA, 36–44. https://doi.org/10.1145/1032604.1032612

Digital Library

[48]

Jonathan Harper and Maneesh Agrawala. 2014. Deconstructing and restyling D3 visualizations. UIST 2014 - Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (10 2014), 253–262. https://doi.org/10.1145/2642918.2647411

Digital Library

[49]

A. Harth, Aidan Hogan, Renaud Delbru, Jürgen Umbrich, Seán O’Riain, and Stefan Decker. 2007. SWSE: Answers Before Links!. In Semantic Web Challenge.

[50]

Marti Hearst. 2009. Search user interfaces. Cambridge university press.

[51]

Jeff Heflin, James A. Hendler, and Sean Luke. 2003. SHOE: A Blueprint for the Semantic Web. In Spinning the Semantic Web.

[52]

Enamul Hoque and Maneesh Agrawala. 2019. Searching the visual style and structure of D3 visualizations. IEEE Transactions on Visualization and Computer Graphics 26, 1 (2019), 1236–1245.

[53]

Enamul Hoque, Vidya Setlur, Melanie Tory, and Isaac Dykeman. 2017. Applying pragmatics principles for interaction with visual analytics. IEEE Transactions on Visualization and Computer Graphics 24, 1 (2017), 309–318.

[54]

Yushi Jing and Shumeet Baluja. 2008. VisualRank: Applying PageRank to Large-Scale Image Search. IEEE Transactions on Pattern Analysis and Machine Intelligence 30, 11 (2008), 1877–1890. https://doi.org/10.1109/TPAMI.2008.121

Digital Library

[55]

Jupyter. 2023. Jupyter. https://jupyter.org/.

[56]

Sean Kandel, Andreas Paepcke, Joseph Hellerstein, and Jeffrey Heer. 2011. Wrangler: Interactive Visual Specification of Data Transformation Scripts. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11). Association for Computing Machinery, New York, NY, USA, 3363–3372. https://doi.org/10.1145/1978942.1979444

Digital Library

[57]

Tadao Kasami. 1966. An efficient recognition and syntax-analysis algorithm for context-free languages. Coordinated Science Laboratory Report no. R-257 (1966).

[58]

Gjergji Kasneci, Fabian M. Suchanek, Georgiana Ifrim, Shady Elbassuoni, Maya Ramanath, and Gerhard Weikum. 2008. NAGA: harvesting, searching and ranking knowledge. In SIGMOD Conference.

Digital Library

[59]

Esther Kaufmann, Abraham Bernstein, and Renato Zumstein. 2006. Querix: A natural language interface to query ontologies based on clarification dialogs. (01 2006).

[60]

Dae Hyun Kim, Vidya Setlur, and Maneesh Agrawala. 2021. Towards Understanding How Readers Integrate Charts and Captions: A Case Study with Line Charts. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 610, 11 pages. https://doi.org/10.1145/3411764.3445443

Digital Library

[61]

Dan Klein and Christopher D. Manning. 2003. Accurate Unlexicalized Parsing. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, Sapporo, Japan, 423–430. https://doi.org/10.3115/1075096.1075150

Digital Library

[62]

Oleksandr Kolomiyets and Marie-Francine Moens. 2011. A survey on question answering technology from an information retrieval perspective. Information Sciences 181, 24 (2011), 5412–5434. https://doi.org/10.1016/j.ins.2011.07.047

Digital Library

[63]

Yuangui Lei, Victoria S. Uren, and Enrico Motta. 2006. SemSearch: A Search Engine for the Semantic Web. In International Conference Knowledge Engineering and Knowledge Management.

[64]

V. López, Michele Pasin, and Enrico Motta. 2005. AquaLog: An Ontology-Portable Question Answering System for the Semantic Web. In Extended Semantic Web Conference.

[65]

Vanessa Lopez, Marta Sabou, and Enrico Motta. 2006. PowerMap: Mapping the Real Semantic Web on the Fly. In Proceedings of the 5th International Conference on The Semantic Web (Athens, GA) (ISWC’06). Springer-Verlag, Berlin, Heidelberg, 414–427. https://doi.org/10.1007/11926078_30

Digital Library

[66]

Jock Mackinlay, Pat Hanrahan, and Chris Stolte. 2007. Show me: Automatic presentation for visual analysis. IEEE Transactions on Visualization and Computer Graphics 13, 6 (2007), 1137–1144.

Digital Library

[67]

Christopher D. Manning, Prabhakar Raghavan, and Hinrich Schütze. 2008. Introduction to Information Retrieval. Cambridge University Press, Cambridge, UK. http://nlp.stanford.edu/IR-book/information-retrieval-book.html

[68]

Gary Marchionini. 2006. Exploratory search: from finding to understanding. Commun. ACM 49, 4 (2006), 41–46.

Digital Library

[69]

Merriam-Webster. 2023. Olio. In Merriam-Webster Dictionary. https://www.merriam-webster.com/dictionary/olio

[70]

Observable Metadata. 2023. Searching on Observable. https://observablehq.com/@observablehq/searching-on-observable#attributes.

[71]

Selina Meyer, David Elsweiler, Bernd Ludwig, Marcos Fernandez-Pichel, and David E. Losada. 2022. Do We Still Need Human Assessors? Prompt-Based GPT-3 User Simulation in Conversational AI. In Proceedings of the 4th Conference on Conversational User Interfaces (Glasgow, United Kingdom) (CUI ’22). Association for Computing Machinery, New York, NY, USA, Article 8, 6 pages. https://doi.org/10.1145/3543829.3544529

Digital Library

[72]

Microsoft. 2023. Microsoft PowerBI. https://powerbi.microsoft.com/.

[73]

Tomás Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Efficient Estimation of Word Representations in Vector Space. In 1st International Conference on Learning Representations, ICLR 2013, Scottsdale, Arizona, USA, May 2-4, 2013, Workshop Track Proceedings, Yoshua Bengio and Yann LeCun (Eds.). http://arxiv.org/abs/1301.3781

[74]

Vibhu Mittal, Steven Roth, Johanna Moore, Joe Mattis, and Giuseppe Carenini. 1995. Generating Explanatory Captions for Information Graphics. Proceeedings of the International Joint Conference on Artificial Intelligence, 1276–1283.

[75]

Dan I. Moldovan and Rada Mihalcea. 2000. Using WordNet and Lexical Operators to Improve Internet Searches. IEEE Internet Computing 4, 1 (jan 2000), 34–43. https://doi.org/10.1109/4236.815847

Digital Library

[76]

Kristi Morton, Magdalena Balazinska, Dan Grossman, Robert Kosara, and Jock Mackinlay. 2014. Public Data and Visualizations: How are Many Eyes and Tableau Public used for Collaborative Analytics?ACM SIGMOD Record 43, 2 (2014), 17–22.

Digital Library

[77]

Observable. 2023. Observable Notebooks. https://observablehq.com/.

[78]

Observable. 2023. Observable Notebooks. https://observablehq.com/@observablehq/searching-on-observable#attributes.

[79]

OpenAI. 2023. ChatGPT. Retrieved March 23, 2023 from https://openai.com/blog/chatgpt

[80]

Eyal Oren, Christophe Guéret, and Stefan Schlobach. 2008. Anytime Query Answering in RDF through Evolutionary Algorithms. In Proceedings of the 7th International Conference on The Semantic Web (Karlsruhe, Germany) (ISWC ’08). Springer-Verlag, Berlin, Heidelberg, 98–113. https://doi.org/10.1007/978-3-540-88564-1_7

Digital Library

[81]

Srishti Palani, Yingyi Zhou, Sheldon Zhu, and Steven P. Dow. 2022. InterWeave: Presenting Search Suggestions in Context Scaffolds Information Search and Synthesis. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology (Bend, OR, USA) (UIST ’22). Association for Computing Machinery, New York, NY, USA, Article 93, 16 pages. https://doi.org/10.1145/3526113.3545696

Digital Library

[82]

Programmable Web. 2022. Thesaurus API. http://www.programmableweb.com/apitag/thesaurus

[83]

Vijayshankar Raman and Joseph M. Hellerstein. 2001. Potter’s Wheel: An Interactive Data Cleaning System. In Proceedings of the 27th International Conference on Very Large Data Bases(VLDB ’01). Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 381–390.

[84]

Jerome Ramos and Carsten Eickhoff. 2020. Search Result Explanations Improve Efficiency and Trust. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (Virtual Event, China) (SIGIR ’20). Association for Computing Machinery, New York, NY, USA, 1597–1600. https://doi.org/10.1145/3397271.3401279

Digital Library

[85]

Arvind Satyanarayan, Dominik Moritz, Kanit Wongsuphasawat, and Jeffrey Heer. 2016. Vega-lite: A grammar of interactive graphics. IEEE Transactions on Visualization and Computer Graphics 23, 1 (2016), 341–350.

Digital Library

[86]

Jordan Sechler, Lane Harrison, and Evan M Peck. 2017. Sightline: Building on the web’s visualization ecosystem. In Proceedings of the 2017 CHI Extended Abstracts. 2049–2055.

Digital Library

[87]

Vidya Setlur, Sarah E. Battersby, Melanie Tory, Rich Gossweiler, and Angel X. Chang. 2016. Eviza: A Natural Language Interface for Visual Analysis. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST 2016). ACM, New York, NY, USA, 365–377.

Digital Library

[88]

Vidya Setlur, Enamul Hoque, Dae Hyun Kim, and Angel X. Chang. 2020. Sneak Pique: Exploring Autocompletion as a Data Discovery Scaffold for Supporting Visual Analysis. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’20). Association for Computing Machinery, New York, NY, USA, 966–978. https://doi.org/10.1145/3379337.3415813

Digital Library

[89]

Vidya Setlur, Melanie Tory, and Alex Djalali. 2019. Inferencing Underspecified Natural Language Utterances in Visual Analysis. In Proceedings of the 24th International Conference on Intelligent User Interfaces (Marina del Ray, California) (IUI ’19). Association for Computing Machinery, New York, NY, USA, 40–51. https://doi.org/10.1145/3301275.3302270

Digital Library

[90]

Leixian Shen, Enya Shen, Yuyu Luo, Xiaocong Yang, Xuming Hu, Xiongshuai Zhang, Zhiwei Tai, and Jianmin Wang. 2021. Towards natural language interfaces for data visualization: A survey. arXiv preprint arXiv:2109.03506 (2021).

[91]

Milad Shokouhi and Luo Si. 2011. Federated Search. In Foundations and Trends in Information Retrieval.

[92]

Craig Silverstein, Hannes Marais, Monika Henzinger, and Michael Moricz. 1999. Analysis of a very large web search engine query log. In Acm sigir forum, Vol. 33. ACM New York, NY, USA, 6–12.

[93]

Sivic and Zisserman. 2003. Video Google: a text retrieval approach to object matching in videos. In Proceedings Ninth IEEE International Conference on Computer Vision. 1470–1477 vol.2. https://doi.org/10.1109/ICCV.2003.1238663

[94]

A.W.M. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain. 2000. Content-based image retrieval at the end of the early years. IEEE Transactions on Pattern Analysis and Machine Intelligence 22, 12 (2000), 1349–1380. https://doi.org/10.1109/34.895972

Digital Library

[95]

Rohini K. Srihari and W. Li. 1999. Information Extraction Supported Question Answering. In Text Retrieval Conference.

[96]

Arjun Srinivasan, Steven M Drucker, Alex Endert, and John Stasko. 2018. Augmenting visualizations with interactive data facts to facilitate interpretation and communication. IEEE transactions on visualization and computer graphics 25, 1 (2018), 672–681.

[97]

Arjun Srinivasan, Nikhila Nyapathy, Bongshin Lee, Steven M Drucker, and John Stasko. 2021. Collecting and characterizing natural language utterances for specifying data visualizations. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–10.

Digital Library

[98]

Arjun Srinivasan and Vidya Setlur. 2021. Snowy: Recommending utterances for conversational visual analysis. In The 34th Annual ACM Symposium on User Interface Software and Technology. 864–880.

Digital Library

[99]

Arjun Srinivasan and John Stasko. 2018. Orko: Facilitating multimodal interaction for visual exploration and analysis of networks. IEEE Transactions on Visualization and Computer Graphics 24, 1 (2018), 511–521.

[100]

Tableau Software. 2023. Tableau Public. Retrieved March 23, 2023 from https://public.tableau.com/

[101]

Edward Thomas, Jeff Z. Pan, and Derek H. Sleeman. 2007. ONTOSEARCH2: Searching Ontologies Semantically. In OWL: Experiences and Directions.

[102]

Melanie Tory and Vidya Setlur. 2019. Do what i mean, not what i say! design considerations for supporting intent and context in analytical conversation. In 2019 IEEE conference on visual analytics science and technology (VAST). IEEE, 93–103.

[103]

Thanh Tran, Philipp Cimiano, Sebastian Rudolph, and Rudi Studer. 2007. Ontology-Based Interpretation of Keywords for Semantic Search. In ISWC/ASWC.

[104]

Gonzalo Vaca-Castano and Mubarak Shah. 2015. Semantic Image Search From Multiple Query Images. In Proceedings of the 23rd ACM International Conference on Multimedia (Brisbane, Australia) (MM ’15). Association for Computing Machinery, New York, NY, USA, 887–890. https://doi.org/10.1145/2733373.2806356

Digital Library

[105]

Fernanda B Viegas, Martin Wattenberg, Frank Van Ham, Jesse Kriss, and Matt McKeon. 2007. Manyeyes: a site for visualization at internet scale. IEEE Transactions on Visualization and Computer Graphics 13, 6 (2007), 1121–1128.

Digital Library

[106]

Chong Wang, Miao Xiong, Qi Zhou, and Yong Yu. 2007. PANTO: A Portable Natural Language Interface to Ontologies. In Proceedings of the 4th European Conference on The Semantic Web: Research and Applications (Innsbruck, Austria) (ESWC ’07). Springer-Verlag, Berlin, Heidelberg, 473–487. https://doi.org/10.1007/978-3-540-72667-8_34

Digital Library

[107]

Wesley Willett, Jeffrey Heer, and Maneesh Agrawala. 2007. Scented widgets: Improving navigation cues with embedded visualizations. IEEE transactions on visualization and computer graphics 13, 6 (2007), 1129–1136.

[108]

Zhibiao Wu and Martha Palmer. 1994. Verbs semantics and lexical selection. In Proceedings of ACL. 133–138.

Digital Library

[109]

Daniel H Younger. 1967. Recognition and parsing of context-free languages in time n3. Information and control 10, 2 (1967), 189–208.

[110]

Li Yujian and Liu Bo. 2007. A normalized Levenshtein distance metric. IEEE Transactions on Pattern Analysis and Machine Intelligence 29, 6 (2007), 1091–1095.

Digital Library

[111]

Gideon Zenz, Xuan Zhou, Enrico Minack, Wolf Siberski, and Wolfgang Nejdl. 2009. From Keywords to Semantic Queries-Incremental Query Construction on the Semantic Web. Web Semant. 7, 3 (sep 2009), 166–176. https://doi.org/10.1016/j.websem.2009.07.005

Digital Library

[112]

Andrew Zhai, Hao-Yu Wu, Eric Tzeng, Dong Huk Park, and Charles Rosenberg. 2019. Learning a Unified Embedding for Visual Search at Pinterest. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (Anchorage, AK, USA) (KDD ’19). Association for Computing Machinery, New York, NY, USA, 2412–2420. https://doi.org/10.1145/3292500.3330739

Digital Library

Cited By

Spyropoulos ABratsas CMakris GGaroufallou ETsiantos V(2023)Interoperability-Enhanced Knowledge Management in Law Enforcement: An Integrated Data-Driven Forensic Ontological Approach to Crime Scene AnalysisInformation10.3390/info1411060714:11(607)Online publication date: 9-Nov-2023
https://doi.org/10.3390/info14110607

Index Terms

Olio: A Semantic Search Interface for Data Repositories
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Natural language interfaces
  2. Visualization
2. Information systems
  1. Information retrieval
    1. Specialized information retrieval

Recommendations

Collaborative multi-paradigm exploratory search
WebScience '08: Proceedings of the hypertext 2008 workshop on Collaboration and collective intelligence

New challenges for advanced web search interfaces and visualization tools arise as user needs shift from traditional lookup tasks towards more open ended search activities collectively described as exploratory search. Exploratory search opens new ...
Read More
Towards exploratory video search using linked data

Keyword-based search in general is particularly applicable if the searcher really knows what she is looking for and how to find it, i.e. to know the appropriate keywords to obtain the desired results. But in many cases either the objectives of the ...
Read More
Is visualization usable for displaying web search results in an exploratory search context?
PROMISE'12: Proceedings of the 2012 international conference on Information Retrieval Meets Information Visualization

Information visualization is defined as an interactive and graphic amplifying cognition. Moreover, the field of information retrieval is the original scope of information visualization. Nevertheless, many problems remain. The exploratory research ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '23: Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology

October 2023

1825 pages

ISBN:9798400701320

DOI:10.1145/3586183

Editors:
Sean Follmer
Stanford University, USA
,
Jeff Han,
Jürgen Steimle
Saarland University, Germany
,
Nathalie Henry Riche
Microsoft Research, USA

Copyright © 2023 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 October 2023

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

UIST '23

Sponsor:

UIST '23: The 36th Annual ACM Symposium on User Interface Software and Technology

October 29 - November 1, 2023

CA, San Francisco, USA

Acceptance Rates

Overall Acceptance Rate 842 of 3,967 submissions, 21%

Upcoming Conference

UIST '24

Sponsor:
sigchi
sigchi

The 37th Annual ACM Symposium on User Interface Software and Technology

October 13 - 16, 2024

Pittsburgh , PA , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
488
Total Downloads

Downloads (Last 12 months)488
Downloads (Last 6 weeks)71

Other Metrics

View Author Metrics

Citations

Cited By

Spyropoulos ABratsas CMakris GGaroufallou ETsiantos V(2023)Interoperability-Enhanced Knowledge Management in Law Enforcement: An Integrated Data-Driven Forensic Ontological Approach to Crime Scene AnalysisInformation10.3390/info1411060714:11(607)Online publication date: 9-Nov-2023
https://doi.org/10.3390/info14110607

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents