Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Semantic Information Retrieval on Medical Texts: Research Challenges, Survey, and Open Issues

Published: 17 September 2021 Publication History

Abstract

The explosive growth and widespread accessibility of medical information on the Internet have led to a surge of research activity in a wide range of scientific communities including health informatics and information retrieval (IR). One of the common concerns of this research, across these disciplines, is how to design either clinical decision support systems or medical search engines capable of providing adequate support for both novices (e.g., patients and their next-of-kin) and experts (e.g., physicians, clinicians) tackling complex tasks (e.g., search for diagnosis, search for a treatment). However, despite the significant multi-disciplinary research advances, current medical search systems exhibit low levels of performance. This survey provides an overview of the state of the art in the disciplines of IR and health informatics, and bridging these disciplines shows how semantic search techniques can facilitate medical IR. First,we will give a broad picture of semantic search and medical IR and then highlight the major scientific challenges. Second, focusing on the semantic gap challenge, we will discuss representative state-of-the-art work related to feature-based as well as semantic-based representation and matching models that support medical search systems. In addition to seminal works, we will present recent works that rely on research advancements in deep learning. Third, we make a thorough cross-model analysis and provide some findings and lessons learned. Finally, we discuss some open issues and possible promising directions for future research trends.

References

[1]
Emily Alsentzer, John R. Murphy, Willie Boag, Wei-Hung Weng, Di Jin, Tristan Naumann, and Matthew McDermott. 2019. Publicly available clinical BERT embeddings. arXiv:1904.033
[2]
Rie Kubota Ando, Mark Dredze, and Tong Zhang. 2005. TREC 2005 genomics track experiments at IBM Watson. In Proceedings of TREC 2005.
[3]
Alan R. Aronson and Francois-Michel Lang. 2010. An overview of MetaMap: Historical perspective and recent advances. Journal of the American Medical Informatics Association 17, 3 (2010), 229–236.
[4]
Alan R. Aronson, James G. Mork, Clifford W. Gay, Susanne M. Humphrey, and Willie J. Rogers. 2004. The NLM indexing initiative’s medical text indexer. In Proceedings of Medinfo 2004. 268–272.
[5]
Mordechai Auerbuch, Tom H. Karson, Benjamin Ben-Ami, Oded Maimon, and Lior Rokach. 2004. Context-sensitive medical information retrieval. Studies in Health Technology and Informatics 107 (2004), 282–286.
[6]
Ricardo A. Baeza-Yates and Berthier Ribeiro-Neto. 1999. Modern Information Retrieval. Addison-Wesley-Longman, Boston, MA.
[7]
Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015. Neural machine translation by jointly learning to align and translate. In Proceedings of ICLR 2015.
[8]
Tian Bai, Brian L. Egleston, Richard Bleicher, and Slobodan Vucetic. 2019. Medical concept representation learning from multi-source data. In Proceedings of IJCAI 2019. 4897–4903.
[9]
Saeid Balaneshinkordan and Alexander Kotov. 2016. Optimization method for weighting explicit and latent concepts in clinical decision support queries. In Proceedings of ICTIR 2016. ACM, New York, NY, 241–250.
[10]
Saeid Balaneshinkordan and Alexander Kotov. 2019. Bayesian approach to incorporating different types of biomedical knowledge bases into information retrieval systems for clinical decision support in precision medicine. Journal of Biomedical Informatics 98 (2019), 103238.
[11]
Imon Banerjee, Matthew C. Chen, Matthew Lungren, and Daniel Rubin. 2017. Radiology report annotation using intelligent word embeddings: Applied to multi-institutional chest CT cohort. Journal of Biomedical Informatics 77 (2017), 11–20.
[12]
Hannah Bast, Bjorn Buchhold, and Elmar Haussmann. 2016. Semantic search on text and knowledge bases. Foundations and Trends in Information Retrieval 10, 2-3 (2016), 119–271.
[13]
Holger Bast, Debapriyo Majumdar, and Ingmar Weber. 2007. Efficient interactive query expansion with complete search. In Proceedings of CIKM 2007. 857–860.
[14]
Inci M. Baytas, Cao Xiao, Xi Zhang, Fei Wang, Anil K. Jain, and Jiayu Zhou. 2017. Patient subtyping via time-aware LSTM networks. In Proceedings of ACM SIGKDD2017. 65–74.
[15]
Andrew L. Beam, Benjamin Kompa, Inbar Fried, Nathan P. Palmer, Xu Shi, Tianxi Cai, and Isaac S. Kohane. 2018. Clinical concept embeddings learned from massive sources of medical data. arXiv:1804.01486.
[16]
Maksim Belousov, William G. Dixon, and Goran Nenadic. 2019. MedNorm: A corpus and embeddings for cross-terminology medical concept normalisation. In Proceedings of #SMM4H 2019. 31–39.
[17]
Jagdev Bhogal, Andrew Macfarlane, and Peter Smith. 2007. A review of ontology based query expansion. Information Processing & Management 43, 4 (2007), 866–886.
[18]
Bodo Billerbeck, Falk Scholer, Hugh E. Williams, and Justin Zobel. 2003. Query expansion using associated queries. In Proceedings of CIKM 2003. 2–9.
[19]
Li Bin and K. C. Lun. 2001. The retrieval effectiveness of medical information on the web. International Journal of Medical Informatics 62, 2 (2001), 155–163.
[20]
Olivier Bodenreider. 2005. The Unified Medical Language System (UMLS): Integrating biomedical terminology. Nucleic Acids Research 32 (2005), D267–D270.
[21]
Vera Boteva, Demian Gholipour, Artem Sokolov, and Stefan Riezler. 2016. A full-text learning to rank dataset for medical information retrieval. In Proceedings of ECIR 2016.
[22]
Xiangrui Cai, Jinyang Gao, Kee Yuan Ngiam, Beng Chin Ooi, Ying Zhang, and Xiaojie Yuan. 2018. Medical concept embedding with time-aware attention. In Proceedings of IJCAI 2018.
[23]
Leonardo Campillos-Llanos. 2019. First steps towards a medical lexicon for Spanish with linguistic and semantic information. BioNLP 2019 (2019), 152.
[24]
YongGang Cao, Feifan Liu, Pippa Simpson, Lamont Antieau, Andrew Bennett, James J. Cimino, John Ely, and Hong Yu. 2011. AskHERMES: An online question answering system for complex clinical questions. Journal of Biomedical Informatics 44, 2 (2011), 277–288.
[25]
Claudio Carpineto and Giovanni Romano. 2012. A survey of automatic query expansion in information retrieval. ACM Computing Surveys 44, 1 (2012), Article 1, 50 pages.
[26]
Larissa Chazette and Kurt Schneider. 2020. Explainability as a non-functional requirement: Challenges and recommendations. Requirements Engineering 25 (2020), 493–514.
[27]
Jianpeng Cheng, Zhongyuan Wang, Ji-Rong Wen, Jun Yan, and Zheng Chen. 2015. Contextual text understanding in distributional semantic space. In Proceedings of CIKM 2015. 133–142.
[28]
Edward Choi, Mohammad Taha Bahadori, Elizabeth Searles, Catherine Coffey, Michael Thompson, James Bost, Javier Tejedor-Sojo, and Jimeng Sun. 2016. Multi-layer representation learning for medical concepts. In Proceedings of ACM SIGKDD 2016. 1495–1504.
[29]
Edward Choi, Taha Bahadori, Le Song, Walter Stewart, and J. Sun. 2017. GRAM: Graph-based attention model for healthcare representation learning. In Proceedings of KDD 2017. 787–795.
[30]
Edward Choi, Cao Xiao, Walter F. Stewart, and Jimeng Sun. 2020. MiME: Multilevel medical embedding of electronic health records for predictive healthcare. In Proceedings of the Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI’20). AAAI Press, 606–613. https://aaai.org/ojs/index.php/AAAI/article/view/5400.
[31]
Edward Choi, Zhen Xu, Yujia Li, Michael W. Dusenberry, Gerardo Flores, Yuan Xue, and Andrew M. Dai. 2020. Graph convolutional transformer: Learning the graphical structure of electronic health records. In Association of Artificial Intelligence AAAI.
[32]
Y. Choi, C. Y.-I. Chiu, and D. Sontag. 2016. Learning low-dimensional representations of medical concepts. AMIA Summits on Translational Science Proceedings. 2016 (2016), 41–50.
[33]
Gobinda G. Chowdhury. 1999. Introduction to Modern Information Retrieval. Library Association Publishing, London, UK.
[34]
Cyril W. Cleverdon, Jack Mills, and E. Michael Keen. 1966. Factors Determining the Performance of Indexing Systems (Volume 1: Design). College of Aeronautics, Cranfield, UK.
[35]
Lance De Vine, Guido Zuccon, Bevan Koopman, Laurianne Sitbon, and Peter Bruza. 2014. Medical semantic similarity with a neural language model. In Proceedings of CIKM 2014. 1819–1822.
[36]
Lance De Vine, Guido Zuccon, Bevan Koopman, Laurianne Sitbon, and Peter Bruza. 2014. Medical semantic similarity with a neural language model. In Proceedings of CIKM 2014. 1819–1822.
[37]
Dina Demner-Fushman, Susanne M. Humphrey, Nicholas C. Ide, Russell F. Loane, Patrick Ruch, Miguel E. Ruiz, Lawrence H. Smith, Lorraine K. Tanabe, W. John Wilbur, and Alan R. Aronson. 2006. Finding relevant passages in scientific articles: Fusion of automatic approaches vs. aninteractive team effort. In Proceedings of TREC 2006.
[38]
Duy Dinh and Lynda Tamine. 2012. Towards a context sensitive approach to searching information based on domain specific knowledge sources. Web Semantics: Science, Services and Agents on the World Wide Web 12-13 (2012), 41–52.
[39]
Duy Dinh, Lynda Tamine, and Fatiha Boubekeur. 2013. Factors affecting the effectiveness of biomedical document indexing and retrieval based on terminologies. Artificial Intelligence in Medicine 57, 2 (2013), 155–167.
[40]
Ram Dixit, Deevakar Rogith, Vidya Narayana, Mandana Salimi, Anupama Gururaj, Lucila Ohno-Machado, Hua Xu, and Todd R. Johnson. 2018. User needs analysis and usability assessment of DataMed—A biomedical data discovery index. Journal of the American Medical Informatics Association 25, 3 (2018), 337–344.
[41]
Dmitriy Dligach and Timothy Miller. 2018. Learning patient representations from text. In Proceedings of the 7th Joint Conference on Lexical and Computational Semantics. 119–123.
[42]
Tracy Edinger, Aaron M. Cohen, Steven Bedrick, Kyle Ambert, and William Hersh. 2012. Barriers to retrieving patient information from electronic health record data: Failure analysis from the TREC medical records track. AMIA Annual Symposium Proceedings 2012 (2012), 180–188.
[43]
Marco Eichelberg, Thomas Aden, Jörg Riesmeier, Asuman Dogac, and Gokce B. Laleci. 2005. A survey and analysis of electronic healthcare record standards. ACM Computing Surveys 37, 4 (2005), 277–315.
[44]
Ruogu Fang, Samira Pouyanfar, Yimin Yang, Shu-Ching Chen, and S. S. Iyengar. 2016. Computational health informatics in the big data age: A survey. ACM Computing Surveys 49, 1 (2016), Article 12, 36 pages.
[45]
Samuel G. Finlayson, Paea LePendu, and Nigam H. Shah. 2014. Building the graph of medicine from millions of clinical narratives. Scientific Data 1, 1 (2014), 140032.
[46]
Sumio Fujita. 2004. Revisiting again document length hypotheses TREC 2004 Genomics track experiments at Patolis. In Proceedings of TREC 2004.
[47]
Abraham Gale and Amélie Marian. 2019. Metrics for explainable ranking functions. In Proceedings of the SIGIR EARS Workshop 2019.
[48]
Saurav Ghosh, Prithwish Chakraborty, Emily Cohn, John S. Brownstein, and Naren Ramakrishnan. 2016. Characterizing diseases from unstructured text: A vocabulary driven word2vec approach. In Proceedings of CIKM 2016. 1129–1138.
[49]
Saurav Ghosh, Prithwish Chakraborty, Emily Cohn, John S. Brownstein, and Naren Ramakrishnan. 2017. Joint learning of representations of medical concepts and words from EHR data. In Proceedings of BIBM 2017. 764–769.
[50]
Lorraine Goeuriot, Gareth J. F. Jones, Liadh Kelly, Johannes Leveling, Allan Hanbury, Henning Müller, Sanna Salanterä, Hanna Suominen, and Guido Zuccon. 2013. ShARe/CLEF eHealth Evaluation Lab 2013, task 3: Information retrieval to address patients’ questions when reading clinical reports. In Proceedings of CLEF 2013.
[51]
Lorraine Goeuriot, Gareth J. F. Jones, Liadh Kelly, Henning Müller, and Justin Zobel. 2016. Medical information retrieval: Introduction to the special issue. Information Retrieval Journal 19, 1 (2016), 1–5.
[52]
Lorraine Goeuriot, Liadh Kelly, Leif Hanlen, Hanna Suominen, Aurélie Névéol, Joao Palotti, and Guido Zuccon. 2015. Overview of the CLEF eHealth Evaluation Lab 2015. In Proceedings of CLEF 2015.
[53]
Lorraine Goeuriot, Liadh Kelly, Wei Li, Joao Palotti, Pavel Pecina, Guido Zuccon, Allan Hanbury, Gareth J. F. Jones, and Henning Mueller. 2014. ShARe/CLEF eHealth Evaluation Lab 2014, task 3: User-centred health information retrieval. In Proceedings of CLEF 2014.
[54]
Lorraine Goeuriot, Liadh Kelly, Hanna Suominen, Aurelie Neveol, Aude Robert, Evangelos Kanoulas, Rene Spijker, Joao Palotti, and Guido Zuccon. 2017. CLEF 2017 eHealth Evaluation Lab overview. In Proceedings of CLEF 2017.
[55]
Ira Goldstein and Özlem Uzuner. 2009. Specializing for predicting obesity and its co-morbidities. Journal of Biomedical Informatics 42, 5 (2009), 873–886.
[56]
Travis R. Goodwin and Sanda M. Harabagiu. 2016. Medical question answering for clinical decision support. In Proceedings of CIKM 2016. ACM, New York, NY, 297–306.
[57]
Nicolas Griffon, Gaétan Kerdelhué, Saliha Hamek, Sylvain Hassler, César Boog, Jean-Baptiste Lamy, Catherine Duclos, Alain Venot, and Stéfan J. Darmoni. 2014. Design and usability study of an iconic user interface to ease information retrieval of medical guidelines. Journal of the American Medical Informatics Association 21, e2 (2014), e270–e277.
[58]
Paulina Grnarova, Florian Schmidt, Stephanie L. Hyland, and Carsten Eickhoff. 2016. Neural document embeddings for intensive care patient mortality prediction. arxiv:cs.CL/1612.00467.
[59]
David A. Grossman and Ophir Frieder. 1998. Information Retrieval: Algorithms and Heuristics. Kluwer Academic, Norwell, MA.
[60]
William Hersh. 2010. Information Retrieval: A Health and Biomedical Perspective. Springer.
[61]
William Hersh, Chris Buckley, T. J. Leone, and David Hickam. 1994. OHSUMED: An interactive retrieval evaluation and new large test collection for research. In Proceedings of SIGIR 1994. 192–201.
[62]
William Hersh, Aaron Cohen, Jianji Yang, Ravi Teja Bhupatiraju, Phoebe Roberts, and Marti Hearst. 2005. TREC 2005 Genomics track overview. In Proceedings of TREC 2005.
[63]
William R. Hersh and Ravi Teja Bhupatiraju. 2003. TREC Genomics track overview. In Proceedings of TREC 2003. 14–23.
[64]
William R. Hersh, Ravi Teja Bhuptiraju, Laura Ross, Phoebe Johnson, Aaron M. Cohen, and Dale F. Kraemer. 2004. TREC 2004 Genomics track overview. In Proceedings of TREC 2004.
[65]
William R. Hersh, Aaron M. Cohen, Phoebe M. Roberts, and Hari Krishna Rekapalli. 2006. TREC 2006 Genomics track overview. In Proceedings of TREC 2006.
[66]
William R. Hersh, Aaron M . Cohen, Lynn Ruslen, and Phoebe Roberts. 2007. TREC 2007 Genomics track overview. In Proceedings of TREC 2007.
[67]
Katja Hofmann, Lihong Li, and Filip Radlinski. 2016. Online evaluation for information retrieval. Foundations and Trends in Information Retrieval 10, 1 (2016), 1–117.
[68]
Xiangji Huang, Ming Zhong, and Luo Si. 2005. York University at TREC 2005: Genomics track. In Proceedings of TREC 2005.
[69]
M. Hughes, I. Li, S. Kotoulas, and T. Suzumura. 2017. Medical text classification using convolutional neural networks. Studies in Health Technology and Informatics 235 (2017), 246–250.
[70]
Kalervo Järvelin and Jaana Kekäläinen. 2002. Cumulated gain-based evaluation of IR techniques. ACM Transactions on Information Systems 20, 4 (2002), 422–446.
[71]
Alistair E. W. Johnson, Tom J. Pollard, Lu Shen, H. Lehman Li-Wei, Mengling Feng, Mohammad Ghassemi, Benjamin Moody, Peter Szolovits, Leo Anthony Celi, and Roger G. Mark. 2016. MIMIC-III, a freely accessible critical care database. Scientific Data 3, 1 (2016), 1–9.
[72]
Jayashree Kalpathy-Cramer, Alba Garcia Seco de Herrera, Dina Demner-Fushman, Sameer Antani, Steven Bedrick, and Henning Muller. 2014. Evaluating performance of biomedical image retrieval systems—An overview of the medical image retrieval task at ImageCLEF 2004-2013. Computerized Medical Imaging and Graphics 39 (2014), 55–61.
[73]
K. S. Kalyan and S. Sangeetha. 2019. SECNLP: A survey of embeddings in clinical natural language processing. arXiv:1903.01039.
[74]
Katikapalli Subramanyam Kalyan and S. Sangeetha. 2020. SECNLP: A survey of embeddings in clinical natural language processing. Journal of Biomedical Informatics 101 (2020), 103323.
[75]
Evangelos Kanoulas, Dan Li, Leif Azzopardi, and Rene Spijker. 2017. CLEF 2017 technologically assisted reviews in empirical medicine overview. In Proceedings of CLEF 2017.
[76]
Diane Kelly. 2009. Methods for evaluating interactive information retrieval systems with users. Foundations and Trends in Information Retrieval 3, 1–2 (2009), 1–224.
[77]
Liadh Kelly, Lorraine Goeuriot, Hanna Suominen, Aurélie Névéol, Joao Palotti, and Guido Zuccon. 2016. Overview of the CLEF eHealth Evaluation Lab 2016. In Proceedings of CLEF 2016.
[78]
Liadh Kelly, Lorraine Goeuriot, Hanna Suominen, Tobias Schreck, Gondy Leroy, Danielle L. Mowery, Sumithra Velupillai, Wendy W. Chapman, Guido Zuccon, and Joao Palotti. 2014. Overview of the ShARe/CLEF eHealth Evaluation Lab 2014. In Proceedings of CLEF 2014.
[79]
Benjamin King, Lijun Wang, Ivan Provalov, and Jerry Zhou. 2011. Cengage Learning at TREC 2011 Medical track. In Proceedings of TREC 2011.
[80]
Marijn Koolen, Jaap Kamps, Toine Bogers, Nicholas J. Belkin, Diane Kelly, and Emine Yilmaz. 2017. Report on the second workshop on supporting complex search tasks. SIGIR Forum 51, 1 (2017), 58–66.
[81]
Bevan Koopman and Guido Zuccon. 2014. Why assessing relevance in medical IR is demanding. In Proceedings of SIGIR 2014.
[82]
Bevan Koopman, Guido Zuccon, Peter Bruza, Laurianne Sitbon, and Michael Lawley. 2016. Information retrieval as semantic inference: A graph inference model applied to medical search. Information Retrieval Journal 19, 1–2 (2016), 6–37.
[83]
Victor Lavrenko and W. Bruce Croft. 2001. Relevance based language models. In Proceedings of SIGIR 2001. 120–127.
[84]
Quoc V. Le and Tomas Mikolov. 2014. Distributed representations of sentences and documents. In Proceedings of ICML 2014. 1188–1196.
[85]
Jinhyuk Lee, Wonjin Yoon, Sungdong Kim, Donghyeon Kim, Sunkyu Kim, Chan Ho So, and Jaewoo Kang. 2019. BioBERT: A pre-trained biomedical language representation model for biomedical text mining. Bioinformatics 36, 4 (2019), 1234–1240.
[86]
Jinhyuk Lee, Wonjin Yoon, Sungdong Kim, Donghyeon Kim, Sunkyu Kim, Chan Ho So, and Jaewoo Kang. 2020. BioBERT: A pre-trained biomedical language representation model for biomedical text mining. Bioinformatics 36, 4 (2020), 1234–1240.
[87]
Geoffrey Leech. 2005. Adding linguistic annotation. In Developing Linguistic Corpora: A Guide to Good Practice. Oxbow Books, Oxford, UK, 17–29.
[88]
Fei Li, Yonghao Jin, Weisong Liu, Bhanu Rawat, Pengshan Cai, and Hong Yu. 2019. Fine-tuning bidirectional encoder representations from transformers (BERT)-based models on large-scale electronic health record notes: An empirical study. JMIR Medical Informatics 7 (2019), e14830.
[89]
Hang Li and Jun Xu. 2014. Semantic Matching in Search. Now Publishers, Hanover, MA.
[90]
Nut Limsopatham, Craig Macdonald, and Iadh Ounis. 2013. Inferring conceptual relationships to improve medical records search. In Proceedings of OAIR 2013. 1–8.
[91]
Nut Limsopatham, Craig Macdonald, and Iadh Ounis. 2013. Learning to handle negated language in medical records search. In Proceedings of CIKM 2013. 1431–1440.
[92]
Nut Limsopatham, Craig Macdonald, and Iadh Ounis. 2013. Learning to selectively rank patients’ medical history. In Proceedings of CIKM 2013. 1833–1836.
[93]
Tie-Yan Liu. 2009. Learning to rank for information retrieval. Foundations and Trends in Information Retrieval 3, 3 (2009), 225–331.
[94]
Xiaojie Liu, Jian-Yun Nie, and Alessandro Sordoni. 2016. Constraining word embeddings by prior knowledge–application to medical information retrieval. In Information Retrieval Technology. Springer, 155–167.
[95]
Henry J. Lowe, Todd A. Ferris, Penni M. Hernandez, and Susan C. Weber. 2009. STRIDE—An integrated standards-based translational research informatics platform. AMIA Annual Symposium Proceedings 2009 (2009), 391–395.
[96]
Francisco Lupiáñez-Villanueva, George Gaskell, Pietro Tornese, José Vila, Yolanda Gómez, Anthony Allen, Giuseppe Veltri, and Cristiano Codagnone. 2018. Behavioural Study on the Transparency of Online Platforms. Retrieved June 10, 2021 from https://ec.europa.eu/info/publications/behavioural-study-transparency-online-platforms-2018_en.
[97]
Fenglong Ma, Jing Gao, Qiuling Suo, Quanzeng You, Jing Zhou, and Aidong Zhang. 2018. Risk prediction on electronic health records with prior medical knowledge. In Proceedings of KDD 2018.
[98]
Christopher D. Manning, Prabhakar Raghavan, and Hinrich Schütze. 2008. Introduction to Information Retrieval. Cambridge University Press, New York, NY.
[99]
Kornél Markó, Robert Baud, Pierre Zweigenbaum, Lars Borin, Magnus Merkel, and Stefan Schulz. 2006. Towards a multilingual medical lexicon. AMIA Annual Symposium Proceedings 2006 (2006), 534–538.
[100]
Melvin Earl Maron and John Larry Kuhns. 1960. On relevance, probabilistic indexing and information retrieval. Journal of the ACM 7, 3 (1960), 216–244.
[101]
David Martinez, Arantxa Otegi, Aitor Soroa, and Eneko Agirre. 2014. Improving search over electronic health records using UMLS-based query expansion through random walks. Journal of Biomedical Informatics 51 (2014), 100–106.
[102]
Eneldo Loza Mencia, Gerard De Melo, and Jinseok Nam. 2016. Medical concept embeddings via labeled background corpora. In Proceedings of LREC 2016. 4629–4636.
[103]
Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Efficient estimation of word representations in vector space. arXiv:1301.3781.
[104]
Riccardo Miotto, Li Li, Brian A. Kidd, and Joel T. Dudley. 2016. Deep Patient: An unsupervised representation to predict the future of patients from the electronic health records. Scientific Reports 6 (2016), 26094.
[105]
Jeff Mitchell and Mirella Lapata. 2008. Vector-based models of semantic composition. In Proceedings of ACL 2008. 236–244.
[106]
Bhaskar Mitra and Nick Craswell. 2018. An introduction to neural information retrieval. Foundations and Trends in Information Retrieval 13, 1 (2018), 1–126.
[107]
H. Moen, F. Ginter, E. Marsi, L.-M. Peltonen, T. Salakoski, and S. Salantera. 2015. Care episode retrieval: Distributional semantic models for information retrieval in the clinical domain. BMC Medical Informatics and Decision Making 15 (2015), S2.
[108]
Robert Moskovitch, Fei Wang, Jian Pei, and Carol Friedman. 2017. JASIST special issue on biomedical information retrieval. Journal of the Association for Information Science and Technology 68, 11 (2017), 2525–2528.
[109]
Henning Mueller, Paul Clough, Thomas Deselaers, and Barbara Caputo. 2010. ImageCLEF—Experimental Evaluation of Visual Information Retrieval. Springer.
[110]
Aurélie Névéol, Julien Grosjean, Stéfan Jacques Darmoni, and Pierre Zweigenbaum. 2014. Language resources for French in the biomedical domain. In Proceedings of LREC 2014. 2146–2151.
[111]
Gia-Hung Nguyen, Lynda Tamine, Laure Soulier, and Nathalie Souf. 2017. Learning concept-driven document embeddings for medical information search. In Proceedings of AIME 2017.
[112]
Gia-Hung Nguyen, Lynda Tamine, Laure Soulier, and Nathalie Souf. 2018. A tri-partite neural document language model for semantic information retrieval. In Proceedings of ESWC 2018, Vol. 10843. 445–461.
[113]
Phuoc Nguyen, Truyen Tran, Nilmini Wickramasinghe, and Svetha Venkatesh. 2017. A convolutional net for medical records. IEEE Journal of Biomedical and Health Informatics 2 (2017), 22–30.
[114]
Jiazhi Ni, Jie Liu, Chenxin Zhang, Dan Ye, and Zhirou Ma. 2017. Fine-grained patient similarity measuring using deep metric learning. In Proceedings of CIKM 2017. 1189–1198.
[115]
Azadeh Nikfarjam, Abeed Sarker, Karen O’Connor, Rachel Ginn, and Graciela Gonzalez. 2015. Pharmacovigilance from social media: Mining adverse drug reaction mentions using sequence labeling with word embedding cluster features. Journal of the American Medical Informatics Association 22, 3 (2015), 671–681.
[116]
Heung-Seon Oh and Yuchul Jung. 2015. Cluster-based query expansion using external collections in medical information retrieval. Journal of Biomedical Informatics 58 (2015), 70–79.
[117]
Kezban Dilek Onal, Ye Zhang, Ismail Sengor Altingovde, Md Mustafizur Rahman, Pinar Karagoz, Alex Braylan, Brandon Dang, et al. 2018. Neural information retrieval: At the end of the early years. Information Retrieval Journal 21, 2 (2018), 111–182.
[118]
Christopher Ormandy, Zina M. Ibrahim, and Richard J. B. Dobson. 2017. Learning patient similarity using joint distributed embeddings of treatment and diagnoses. In Proceedings of IJCAI 2017. 30–35.
[119]
Serguei Pakhomov, Bridget McInnes, Terrence Adam, Ying Liu, Ted Pedersen, and Genevieve B. Melton. 2010. Semantic similarity and relatedness between clinical terms: An experimental study. AMIA Annual Symposium Proceedings 2010 (2010), 572–576.
[120]
Joao Palotti, Allan Hanbury, Henning Müller, and Charles E. Kahn Jr.2016. How users search and what they search for in the medical domain. Information Retrieval 19, 1-2 (2016), 189–224.
[121]
Min Pan, Yue Zhang, Qiang Zhu, Bo Sun, Tingting He, and Xingpeng Jiang. 2019. An adaptive term proximity based Rocchio’s model for clinical decision support retrieval. BMC Medical Informatics and Decision Making 19-S, 9 (2019), 251.
[122]
Ted Pedersen, Serguei V. S. Pakhomov, Siddharth Patwardhan, and Christopher G. Chute. 2007. Measures of semantic similarity and relatedness in the biomedical domain. Journal of Biomedical Informatics 40, 3 (2007), 288–299.
[123]
Xueping Peng, Guodong Long, Shirui Pan, Jing Jiang, and Zhendong Niu. 2019. Attentive dual embedding for understanding medical concepts in electronic health records. In Proceedings of IJCNN 2019. 1–8.
[124]
Yifan Peng, Shankai Yan, and Zhiyong Lu. 2019. Transfer learning in biomedical natural language processing: An evaluation of BERT and ELMo on ten benchmarking datasets. In Proceedings of BioNLP 2019. 58–65.
[125]
Sampo Pyysalo, Filip Ginter, Hans Moen, Tapio Salakoski, and Sophia Ananiadou. 2013. Distributional semantics resources for biomedical text processing. In Proceedings of LBM 2013. 39–44.
[126]
Jiaming Qu, Jaime Arguello, and Yue Wang. 2020. Towards explainable retrieval models for precision medicine literature search. In Proceedings of SIGIR 2020.1593–1596.
[127]
Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, and Percy Liang. 2016. SQuAD: 100,000+ questions for machine comprehension of text. In Proceedings of EMNLP 2016.
[128]
Philip Resnik. 1995. Using information content to evaluate semantic similarity in a taxonomy. In Proceedings of IJCAI 1995. 448–453.
[129]
Kirk Roberts, Tasmeer Alam, Steven Bedrick, Dina Demner-Fushman, Kyle Lo, Ian Soboroff, Ellen Voorhees, Lucy Lu Wang, and William R. Hersh. 2020. TREC-COVID: Rationale and structure of an information retrieval shared task for COVID-19. Journal of the American Medical Informatics Association 27, 9 (2020), 1431–1436.
[130]
Kirk Roberts, Tasmeer Alam, Steven Bedrick, Dina Demner-Fushman, Kyle Lo, Ian Soboroff, Ellen Voorhees, Lucy Lu Wang, and William R. Hersh. 2020. TREC-COVID: Rationale and structure of an information retrieval shared task for COVID-19. Journal of the American Medical Informatics Association 27, 9 (2020), 1431–1436.
[131]
Kirk Roberts, Dina Demner-Fushman, Ellen M. Voorhees, and William R. Hersh. 2016. Overview of the TREC 2016 Clinical Decision Support track. In Proceedings of TREC 2016.
[132]
Kirk Roberts, Dina Demner-Fushman, Ellen M. Voorhees, William R. Hersh, Steven Bedrick, Alexander J. Lazar, and Shubham Pant. 2017. Overview of the TREC 2017 Precision Medicine track. In Proceedings of TREC 2017.
[133]
Kirk Roberts, Dina Demner-Fushman, Ellen M. Voorhees, William R. Hersh, Steven Bedrick, Alexander J. Lazar, and Shubham Pant. 2018. Overview of the TREC 2018 Precision Medicine track. In Proceedings of TREC 2018.
[134]
Kirk Roberts, Matthew S. Simpson, Ellen Voorhees, and William R. Hersh. 2015. Overview of the TREC 2015 Clinical Decision Support track. In Proceedings of TREC 2015.
[135]
Stephen Robertson and David A. Hull. 2000. The TREC-9 filtering track final report. In Proceedings of TREC 2000, Vol. 10.
[136]
Stephen Robertson, Cornelis J. van Rijsbergen, and Martin F. Porter. 1981. Probabilistic models of indexing and searching. In Proceedings of SIGIR 1980. 35–56.
[137]
Cynthia Rudin. 2019. Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature Machine Intelligence 1, 5 (2019), 206–215.
[138]
Tony Russell-Rose, Jon Chamberlain, and Leif Azzopardi. 2018. Information retrieval in the workplace: A comparison of professional search practices. Information Processing & Management 54, 6 (2018), 1042–1057.
[139]
Gerard Salton, Edward A. Fox, and Harry Wu. 1983. Extended Boolean information retrieval. Communications of the ACM 26, 11 (1983), 1022–1036.
[140]
Gerard Salton and Michael J. McGill. 1986. Introduction to Modern Information Retrieval. McGraw-Hill, New York, NY.
[141]
Guergana K. Savova, James J. Masanz, Philip V. Ogren, Jiaping Zheng, Sunghwan Sohn, Karin C. Kipper-Schuler, and Christopher G. Chute. 2010. Mayo clinical text analysis and knowledge extraction system (cTAKES): Architecture, component evaluation and applications. Journal of the American Informatics Association 17, 5 (2010), 507–513.
[142]
Hinrich Schutze and Jan O. Pedersen. 1995. Information retrieval based on word senses. Computational Linguistics 24, 3 (1995), 97–123.
[143]
Miftahutdinov Z. Sh, E. V. Tutubalina, and A. E. Tropsha. 2017. Identifying disease-related expressions in reviews using conditional random fields. Computational Linguistics and Intellectual Technologies 1, 16 (2017), 155–166.
[144]
Wei Shen, Jian-Yun Nie, Xiaohua Liu, and Xiaojie Liui. 2014. An investigation of the effectiveness of concept-based approach in medical information retrieval GRIUM@ CLEF2014eHealthTask 3. In Proceedings of CLEF 2014.
[145]
Matthew S. Simpson and Dina Demner-Fushman. 2012. Biomedical text mining: A survey of recent progress. In Mining Text Data. Springer, 465–517.
[146]
Matthew S. Simpson, Ellen M. Voorhees, and William Hersh. 2014. Overview of the TREC 2014 Clinical Decision Support track. In Proceedings of TREC 2014.
[147]
Jaspreet Singh and Avishek Anand. 2018. Posthoc interpretability of learning to rank models using secondary training data. arXiv:1806.11330.
[148]
Kacper Sokol and Peter Flach. 2020. Explainability fact sheets: A framework for systematic assessment of explainable approaches. In Proceedings of FAT* 2020. 56–67.
[149]
Luca Soldaini and Nazli Goharian. 2016. QuickUMLS: A fast, unsupervised approach for medical concept extraction. In Proceedings of the MedIR 2016 Workshop.
[150]
Luca Soldaini and Nazli Goharian. 2017. Learning to rank for consumer health search: A semantic approach. In Advances in Information Retrieval. Lecture Notes in Computer Science, Vol. 10193. Springer, 640–646.
[151]
Luca Soldaini, Andrew Yates, and Nazli Goharian. 2017. Denoising clinical notes for medical literature retrieval with convolutional neural model. In Proceedings of CIKM 2017. 2307–2310.
[152]
Luca Soldaini, Andrew Yates, and Nazli Goharian. 2017. Learning to reformulate long queries for clinical decision support. Journal of the Association for Information Science and Technology 68, 11 (2017), 2602–2619.
[153]
Luca Soldaini, Andrew Yates, Elad Yom-Tov, Ophir Frieder, and Nazli Goharian. 2016. Enhancing web search in the medical domain via query clarification. Information Retrieval 19, 1–2 (2016), 149–173.
[154]
P. Sondhi, J Sun, C. Zhai, R. Sorrentino, and M. S. Kohn. 2012. Leveraging medical thesauri and physician feedback for improving medical literature retrieval for case queries. Journal of the American Medical Informatics Association 19, 5 (2012), 851–858.
[155]
Lihong Song, Chin Wang Cheong, Kejing Yin, William K. Cheung, Benjamin C. M. Fung, and Jonathan Poon. 2019. Medical concept embedding with multiple ontological representations. In Proceedings of IJCAI 2019. 4613–4619.
[156]
Yang Song, Yun He, Qinmin Hu, Liang He, and E. Mark Haacke. 2015. ECNU at 2015 eHealth task 2: User-centred health information retrieval. In Proceedings of CLEF 2015.
[157]
Jelena Stojanovic, Djordje Gligorijevic, Vladan Radosavljevic, Nemanja Djuric, Mihajlo Grbovic, and Zoran Obradovic. 2017. Modeling healthcare quality via compact representations of electronic health records. IEEE/ACM Transactions on Computational Biology and Bioinformatics 14, 3 (2017), 545–554.
[158]
Nicola Stokes, Yi Li, Lawrence Cavedon, and Justin Zobel. 2009. Exploring criteria for successful query expansion in the genomic domain. Information Retrieval 12, 1 (2009), 17–50.
[159]
Madhumita Sushil, Simon Uster, Kim Luyckx, and Walter Daelemans. 2018. Patient representation learning and interpretable evaluation using clinical notes. Journal of Biomedical Informatics 84 (2018), 103–113.
[160]
Lynda Tamine and Cecile Chouquet. 2017. On the impact of domain expertise on query formulation, relevance assessment and retrieval performance in clinical settings. Information Processing & Management 53, 2 (2017), 332–350.
[161]
Lynda Tamine, Cecile Chouquet, and Thomas Palmer. 2015. Analysis of biomedical and health queries: Lessons learned from TREC and CLEF evaluation benchmarks. Journal of the Association for Information Science and Technology 66, 12 (2015), 2626–2642.
[162]
Lynda Tamine, Laure Soulier, Gia-Hung Nguyen, and Nathalie Souf. 2019. Offline versus online representation learning of documents using external knowledge. ACM Transactions on Information Systems 37, 4 (2019), Article 42, 34 pages.
[163]
Harsh Thakkar, Ganesh Iyer, Kesha Shah, and Prasenjit Majumder. 2014. Team IRLabDAIICT at ShARe/CLEF eHealth 2014 task 3: User-centered information retrieval system for clinical documents. In Proceedings of CLEF 2014. 248–259.
[164]
Truyen Tran, Tu Dinh Nguyen, Dinh Phung, and Svetha Venkatesh. 2015. Learning vector representation of medical objects via EMR-driven nonnegative restricted Boltzmann machines (eNRBM). Journal of Biomedical Informatics 54 (2015), 96–105.
[165]
George Tsatsaronis, Georgios Balikas, Prodromos Malakasiotis, Ioannis Partalas, Matthias Zschunke, Michael R. Alvers, Dirk Weissenborn, et al. 2015. An overview of the BIOASQ large-scale biomedical semantic indexing and question answering competition. BMC Bioinformatics 16, 1 (2015), 138.
[166]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in Neural Information Processing Systems. 5998–6008.
[167]
Federica Vezzani and Giorgio Maria Di Nunzio. 2020. On the formal standardization of terminology resources: The case study of TriMED. In Proceedings of the 12th Language Resources and Evaluation Conference. 4903–4910.
[168]
Elen Voorhees. 1998. Variations in relevance judgments and the measurement of retrieval effectiveness. In Proceedings of SIGIR 1998. 315–323.
[169]
E. M. Voorhees and W. Hersh. 2012. Overview of the TREC 2012 Medical Records track. In Proceedings of TREC 2012.
[170]
Ivan Vulić and Marie-Francine Moens. 2015. Monolingual and cross-lingual information retrieval models based on (bilingual) word embeddings. In Proceedings of SIGIR 2015. ACM, New York, NY, 363–372.
[171]
Chunye Wang and Ramakrishna Akella. 2015. Concept-based relevance models for medical and semantic information retrieval. In Proceedings of CIKM 2015. 173–182.
[172]
Chunye Wang and Ramakrishna Akella. 2015. Concept-based relevance models for medical and semantic information retrieval. In Proceedings of CIKM 2015. ACM, New York, NY, 173–182.
[173]
Lucy Lu Wang, Kyle Lo, Yoganand Chandrasekhar, Russell Reas, Jiangjiang Yang, Darrin Eide, Kathryn Funk, et al. 2020. CORD-19: The COVID-19 open research dataset. arXiv:2004.10706.
[174]
Shenghui Wang and Rob Koopman. 2017. Semantic embedding for information retrieval. In Proceedings of BIR@ECIR 2017.
[175]
Joan L. Warren, Carrie N. Klabunde, Deborah Schrag, Peter B. Bach, and Gerald F. Riley. 2002. Overview of the SEER-Medicare data: Content, research applications, and generalizability to the United States elderly population. Medical Care 40 (2002), IV-3–IV-18.
[176]
Gesa Weske-Heck, Albrecht Zaiss, Matthias Zabel, Stefan Schulz, Wolfgang Giere, Michael Schopen, and Rudiger Klar. 2002. The German specialist lexicon. In Proceedings of the AMIA 2002 Symposium. 884.
[177]
Ryen W. White, Susan T. Dumais, and Jaime Teevan. 2009. Characterizing the influence of domain expertise on web search behavior. In Proceedings of WSDM 2009. 132–141.
[178]
Ryen W. White and Eric Horvitz. 2009. Cyberchondria: Studies of the escalation of medical concerns in web search. ACM Transactions on Information Systems 27, 4 (2009), Article 23, 37 pages.
[179]
Ryen W. White and Eric Horvitz. 2012. Studies of the onset and persistence of medical concerns in search logs. In Proceedings of SIGIR 2012. 265–274.
[180]
Ryen W. White and Eric Horvitz. 2013. Captions and biases in diagnostic search. ACM Transactions on the Web 7, 4 (2013), Article 23, 28 pages.
[181]
Cao Xiao, Edward Choi, and Jimeng Sun. 2018. Opportunities and challenges in developing deep learning models using electronic health records data: A systematic review. Journal of the American Medical Informatics Association 25, 10 (2018), 1419–1428.
[182]
Chenyan Xiong and Jamie Callan. 2015. EsdRank: Connecting query and documents through external semi-structured data. In Proceedings of CIKM 2015. 951–960.
[183]
Bo Xu, Hongfei Lin, and Yuan Lin. 2019. Learning to refine expansion terms for biomedical information retrieval using semantic resources. IEEE/ACM Transactions on Computational Biology and Bioinformatics 16, 3 (2019), 954–966.
[184]
Pranjul Yadav, Michael Steinbach, Vipin Kumar, and Gyorgy Simon. 2018. Mining electronic health records (EHRs): A survey. ACM Computing Surveys 50, 6 (2018), Article 85, 40 pages.
[185]
Xin Yan, Raymond Y. K. Lau, Dawei Song, Xue Li, and Jian Ma. 2011. Toward a semantic granularity model for domain-specific information retrieval. ACM Transactions on Information Systems 29, 3 (2011), Article 15, 46 pages.
[186]
Wei Yang, Kuang Lu, Peilin Yang, and Jimmy Lin. 2019. Critically examining the “neural hype”: Weak baselines and the additivity of effectiveness gains from neural ranking models. In Proceedings of SIGIR 2019. 1129–1132.
[187]
Zhiguo Yu, Byron C. Wallace, Todd Johnson, and Trevor Cohen. 2017. Retrofitting concept vector representations of medical concepts to improve estimates of semantic similarity and relatedness. Studies in Health Technology and Informatics 245 (2017), 657–661.
[188]
Hamed Zamani and W. Bruce Croft. 2016. Estimating embedding vectors for queries. In Proceedings of ICTIR 2016. ACM, New York, NY, 123–132.
[189]
Qing T. Zeng, Sandra Kogan, Robert M. Plovnick, Jonathan Crowell, Eve-Marie Lacroix, and Robert A. Greenes. 2004. Positive attitudes and failed queries: An exploration of the conundrums of consumer health information retrieval. International Journal of Medical Informatics 73, 1 (2004), 45–55.
[190]
Yan Zhang. 2010. Contextualizing consumer health information searching: An analysis of questions in a social Q&A community. In Proceedings of IHI 2010. 210–219.
[191]
Y. Zhang. 2013. Searching for specific health-related information in MedlinePlus: Behavioral patterns and user experience. Journal of the Association for Information Science and Technology 65, 1 (2013), 53–68.
[192]
Yijia Zhang, Qingyu Chen, Zhihao Yang, Hongfei Lin, and Zhiyong Lu. 2019. BioWordVec, improving biomedical word embeddings with subword information and MeSH. Scientific Data 6, 1 (2019), 1–9.
[193]
Yijia Zhang, Qingyu Chen, Zhihao Yang, Hongfei Lin, and Zhiyong Lu. 2019. Improving biomedical word embeddings with subword information and MeSH. Scientific Data 6 (2019), Article 52.
[194]
Ye Zhang, Md Mustafizur Rahman, Alex Braylan, Brandon Dang, Heng-Lu Chang, Henna Kim, Quinten McNamara, et al. 2016. Neural information retrieval: A literature review. arXiv:1611.06792.
[195]
Yinglong Zhang, Jin Zhang, Matthew Lease, and Jacek Gwizdka. 2014. Multidimensional relevance modeling via psychometrics and crowdsourcing. In Proceedings of SIGIR 2014. 435–444.
[196]
Yongfeng Zhang, Yi Zhang, and Min Zhang. 2018. SIGIR 2018 workshop on explainable recommendation and search (EARS 2018). In Proceedings of SIGIR 2018. ACM, New York, NY, 1411–1413.
[197]
Yongfeng Zhang, Yi Zhang, Min Zhang, and Chirag Shah. 2019. EARS 2019: The 2nd international workshop on explainable recommendation and search. In Proceedings of SIGIR 2019. 1438–1440.
[198]
Wei Zhou, T. Yu Clement, Vetle I. Torvik, and Neil R. Smalheiser. 2006. A concept-based framework for passage retrieval at genomics. In Proceedings of TREC 2006, Vol. 8.
[199]
Xuezhong Zhou, Zhaohui Wu, Aining Yin, Lancheng Wu, Weiyu Fan, and Ruen Zhang. 2004. Ontology development for unified traditional Chinese medical language system. Artificial Intelligence in Medicine 32, 1 (2004), 15–27.
[200]
Donqqing Zhu and Ben Carterette. 2012. Improving health records search using multiple query expansion collections. In Proceedings of BIBM 2012. 1–7.
[201]
Dongqing Zhu, Stephen T. Wu, James J. Masanz, Ben Carterette, and Hongfang Liu. 2013. Using discharge summaries to improve information retrieval in clinical domain. In Proceedings of CLEF 2013.
[202]
Zihao Zhu, Changchang Yin, Buyue Qian, Yu Cheng, Jishang Wei, and Fei Wang. 2016. Measuring patient similarities via a deep architecture with medical concept embedding. In Proceedings of ICDM 2016. 749–758.
[203]
Eya Znaidi, Lynda Tamine, and Chiraz Latiri. 2016. Aggregating semantic information nuggets for answering clinical queries. In Proceedings of SAC 2016. 1041–1047.
[204]
Guido Zuccon. 2016. Understandability biased evaluation for information retrieval. In Proceedings of ECIR 2016. 280–292.
[205]
Guido Zuccon and Bevan Koopman. 2018. Choices in knowledge-base retrieval for consumer health search. In Proceedings of ECIR 2018.
[206]
Pierre Zweigenbaum, Robert Baud, Anita Burgun, Fiammetta Namer, Éric Jarrousse, Natalia Grabar, Patrick Ruch, et al. 2005. UMLF: A unified medical lexicon for French. International Journal of Medical Informatics 74, 2–4 (2005), 119–124.

Cited By

View all
  • (2024)Enriching Simple Keyword Queries for Domain-Aware Narrative RetrievalProceedings of the 2023 ACM/IEEE Joint Conference on Digital Libraries10.1109/JCDL57899.2023.00029(143-154)Online publication date: 26-Jun-2024
  • (2024)OLR-Net: Object Label Retrieval Network for principal diagnosis extractionComputers in Biology and Medicine10.1016/j.compbiomed.2024.109130182(109130)Online publication date: Nov-2024
  • (2024)Clinical Information Retrieval: A Literature ReviewJournal of Healthcare Informatics Research10.1007/s41666-024-00159-48:2(313-352)Online publication date: 23-Jan-2024
  • Show More Cited By

Index Terms

  1. Semantic Information Retrieval on Medical Texts: Research Challenges, Survey, and Open Issues

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Computing Surveys
    ACM Computing Surveys  Volume 54, Issue 7
    September 2022
    778 pages
    ISSN:0360-0300
    EISSN:1557-7341
    DOI:10.1145/3476825
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 17 September 2021
    Accepted: 01 April 2021
    Revised: 01 March 2021
    Received: 01 February 2020
    Published in CSUR Volume 54, Issue 7

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Information retrieval
    2. evaluation
    3. knowledge resources
    4. medical texts
    5. relevance

    Qualifiers

    • Research-article
    • Research
    • Refereed

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)273
    • Downloads (Last 6 weeks)34
    Reflects downloads up to 16 Oct 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Enriching Simple Keyword Queries for Domain-Aware Narrative RetrievalProceedings of the 2023 ACM/IEEE Joint Conference on Digital Libraries10.1109/JCDL57899.2023.00029(143-154)Online publication date: 26-Jun-2024
    • (2024)OLR-Net: Object Label Retrieval Network for principal diagnosis extractionComputers in Biology and Medicine10.1016/j.compbiomed.2024.109130182(109130)Online publication date: Nov-2024
    • (2024)Clinical Information Retrieval: A Literature ReviewJournal of Healthcare Informatics Research10.1007/s41666-024-00159-48:2(313-352)Online publication date: 23-Jan-2024
    • (2023)Detection of Depression-Related Tweets in Mexico Using Crosslingual Schemes and Knowledge DistillationHealthcare10.3390/healthcare1107105711:7(1057)Online publication date: 6-Apr-2023
    • (2023)Heuristic Search for Rank Aggregation with Application to Label RankingINFORMS Journal on Computing10.1287/ijoc.2022.001936:2(308-326)Online publication date: 14-Dec-2023
    • (2023)Re2Dan: Retrieval of Medical Documents for e-Health in DanishProceedings of the 17th ACM Conference on Recommender Systems10.1145/3604915.3610655(1208-1211)Online publication date: 14-Sep-2023
    • (2023)A Study of Chinese Medicine Entity Recognition Method by Fusing Multi-Features and Pointer Networks2023 IEEE International Conference on Systems, Man, and Cybernetics (SMC)10.1109/SMC53992.2023.10394643(2087-2092)Online publication date: 1-Oct-2023
    • (2023)CardioBERTpt: Transformer-based Models for Cardiology Language Representation in Portuguese2023 IEEE 36th International Symposium on Computer-Based Medical Systems (CBMS)10.1109/CBMS58004.2023.00247(378-381)Online publication date: Jun-2023
    • (2022)Software Development for Educational Information Services Using Multilayering Semantics AdaptationInternational Journal of Service Science, Management, Engineering, and Technology10.4018/IJSSMET.30715313:1(1-27)Online publication date: 16-Sep-2022
    • (2022)BIoMT Modular InfrastructureWireless Communications & Mobile Computing10.1155/2022/38138412022Online publication date: 1-Jan-2022
    • Show More Cited By

    View Options

    Get Access

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media