Cited By
View all- Ding WChen JE LLi JQu Y(2023)Time expression as update operationsKnowledge-Based Systems10.1016/j.knosys.2023.110870278:COnline publication date: 25-Oct-2023
Time expression recognition and normalization: a survey
Pages 9115 - 9140
Abstract
Time information plays an important role in the areas of data mining, information retrieval, and natural language processing. Among the linguistic tasks related to time expressions, time expression recognition and normalization (TERN) is fundamental for other downstream tasks. Researchers from these areas have devoted considerable effort in the last two decades to define the problem of time expression analysis, design the standards for time expression annotation, build annotated corpora for time expressions, and develop methods to identify time expressions from free text. While there are some surveys concerned with the development of time information extraction, retrieval, and reasoning, to the best of our knowledge, there is no survey focusing on the TERN development. We fill in this blank. In this survey, we review previous researches, aiming to draw an overview of the development of time expression analysis and discuss the role that time expressions play in different areas. We focus on the task of recognizing and normalizing time expressions from free text and investigate three kinds of methods that researchers develop for TERN, namely rule-based methods, traditional machine-learning methods, and deep-learning methods. We will also discuss some factors about TERN development, including TIMEX type factor, language factor, and domain and textual factors. After that, we list some useful datasets and softwares for both tasks of TER and TEN as well as TERN and finally outline some potential directions of future research. We hope that this survey can help those researchers who are interested in TERN quickly gain a comprehensive understanding of the development of TERN and its potential research directions.
References
[1]
Alam T, Zarcone A, Pado S (2021) New domain, major effort? How much data is necessary to adapt a temporal tagger to the voice assistant domain. In: International Conference on Computational Semantics, pp 144–154
[2]
Almasian S, Aumiller D, Gertz M (2021) Bert got a date: introducing transformers to temporal tagging. In: arXiv
[3]
Almasian S, Aumiller D, Gertz M (2022) Time for some german? pre-training a transformer-based temporal tagger for german. In: Proceedings of the Text2Story’22 Workshop, pp 83–90
[4]
Alonso O, Strotgen J, Baeza-Yates R, Gertz M (2011) Temporal information retrieval: challenges and opportunities. In: Proceedings of 1st International Temporal Web Analytics Workshop, pp 1–8
[5]
Altuna B, Aranzabe MJ, and de Ilarraza AD Eusheideltime: time expression extraction and normalisation for basque Proces Lenguaje Nat 2017 59 15-22
[6]
Angeli G, Manning CD, Jurafsky D (2012) Parsing time: learning to interpret time expressions. In: Proceedings of 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp 446–455
[7]
Aumiller D, Almasian S, Pohl D, Gertz M (2022) Online dateing: a web interface for temporal annotations. In: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp 3289–3294
[8]
Baldwin JA (2002) Learning temporal annotation of french news. Master’s thesis, Graduate School of Arts and Sciences, Georgetown University
[9]
Berglund A (2004) Extracting temporal information and ordering events for swedish. Master’s thesis
[10]
Bethard S (2013) Cleartk-timeml: a minimalist approach to tempeval 2013. In: Proceedings of the 7th International Workshop on Semantic Evaluation, pp 10–14
[11]
Bethard S, Derczynski L, Savova G, Pustejovsky J, Verhagen M (2015) Semeval-2015 task 6: clinical tempeval. In: Proceedings of the 9th International Workshop on Semantic Evaluation, pp 806–814
[12]
Bethard S, Savova G, Chen WT, Derczynski L, Pustejovsky J, Verhagen M (2016) Semeval-2016 task 12: clinical tempeval. In: Proceedings of SemEval-2016, pp 1052–1062
[13]
Bethard S, Savova G, Palmer M, Pustejovsky J (2017) Semeval-2017 task 12: clinical tempeval. In: Proceedings of the 11th International Workshop on Semantic Evaluation, pp 565–572
[14]
Bittar A, Amsili P, Denis P, Danlos L (2011) French timebank: an iso-timeml annotated reference corpus. In: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics, pp 130–134
[15]
Boguraev B, Pustejovsky J, Ando R, and Verhagen M Timebank evolution as a community resource for timeml parsing Lang Resour Eval 2007 41 1 91-115
[16]
Boudaa T, Marouani ME, Enneya N (2018) Arabic temporal expression tagging and normalization. In: Proceedings of International Conference on Big Data, Cloud and Applications, pp 546–557
[17]
Breitfeller L, Naik A, Rose C (2021) Stage: tool for automated extraction of semantic time cues to enrich neural temporal ordering models. In: arXiv
[18]
Campos R, Dias G, Jorge AM, and Jatowt A Survey of temporal information retrieval and related applications ACM Comput Surv 2014 47 2 1-41
[19]
Cao Y, Groves W, Saha TK, Tetreault JR, Jaimes A, Peng H, Yu PS (2022) Xltime: a cross-lingual knowledge transfer framework for temporal expression extraction. In: NAACL, pp 1931–1942
[20]
Caselli T, Lenzi VB, Sprugnoli R, Pianta E, Prodanof I (2011) Annotating events, temporal expressions and relations in italian: the it-timeml experience for the ita-timebank. In: Proceedings of the 5th Linguistic Annotation Workshop, pp 143–151
[21]
Chambers N, Wang S, Jurafsky D (2007) Classifying temporal relations between events. In: Proceedings of the 45th Annual Meeting of the ACL on Interactive Poster and Demonstration Sessions, pp 173–176
[22]
Chang AX, Manning CD (2012) Sutime: a library for recognizing and normalizing time expressions. In: Proceedings of 8th International Conference on Language Resources and Evaluation, pp 3735–3740
[23]
Chang AX, Manning CD (2013) Sutime: evaluation in tempeval-3. In: Proceedings of the Second Joint Conference on Lexical and Computational Semantics (SEM), pp 78–82
[24]
Chang AX, Manning CD (2014) Tokensregex: defining cascaded regular expressions over tokens. Stanford University, Tech rep, Department of Computer Science
[25]
Chen S, Wang G, Karlsson B (2019) Exploring word representations on time expression recognition. Microsoft Research Asia, Tech rep
[26]
Cheng F and Miyao Y Inducing temporal relations from time anchor annotation Proc NAACL-HLT 2018 2018 1833-1843
[27]
Chinchor NA (1998a) Muc-7 named entity task definition. In: Proceedings of the 7th Message Understanding Conference, vol 29
[28]
Chinchor NA (1998b) Overview of muc-7/met-2. In: Proceedings of the 7th Message Understanding Conference
[29]
Chomsky N Syntactic structures 1957 Berlin Mouton Publishers
[30]
Conneau A, Khandelwal K, Goyal N, Chaudhary V, Wenzek G, Guzman F, Grave E, Ott M, Zettlemoyer L, Stoyanov V (2020) Unsupervised cross-lingual representation learning at scale. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp 8440–8451
[31]
Costa F, Branco A (2012) Timebankpt: a timeml annotated corpus of portuguese. In: Proceedings of the 8th International Conference on Language Resources and Evaluation, pp 3727–3734
[32]
de Azevedo RF, Joao Pedro Santos Rodrigues MRdSR, Moro CMC (2018a) Temporal tagging of noisy clinical texts in brazilian. In: Proceedings of International Conference on Computational Processing of the Portuguese Language, pp 231–241
[33]
de Azevedo RF, Rodrigues JPS, da Silva Reis MR, Moro CMC, Paraiso EC (2018b) Temporal tagging of noisy clinical texts in brazilian portuguese. In: Proceedings of PROPOR, pp 231–241
[34]
de-la Cuadra AR, López-Cuadrado JL, González-Carrasco I, Ruiz-Mezcua B (2019) Sequence time expression recognition in the spanish clinical narrative. In: 2019 IEEE 32nd International Symposium on Computer-Based Medical Systems, pp 331–336
[35]
Degaetano-Ortlieb S, Strötgen J (2017) Diachronic variation of temporal expressions in scientific writing through the lens of relative entropy. In: Proceedings of International Conference of the German Society for Computational Linguistics and Language Technology, pp 259–275
[36]
Devlin J, Chang MW, Lee K, Kristina T (2019) Bert: pre-training of deep bidirectional transformers for language understanding. In: Proceedings of NAACL-HLT, pp 4171–4186
[37]
Ding W, Gao G, Shi L, and Qu Y A pattern-based approach to recognizing time expressions Proc AAAI Conf Artif Intell 2019 33 6335-6342
[38]
Ding W, Chen J, Li J, Qu Y (2021) Automatic rule generation for time expression normalization. In: ACL, pp 3135–3144
[39]
Do QX, Lu W, Roth D (2012) Joint inference for event timeline construction. In: Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, pp 677–687
[40]
Duchi J, Hazan E, and Singer Y Adaptive subgradient methods for online learning and stochastic optimization J Mach Learn Res 2011 12 2121-2159
[41]
Dupuis L, Bergou N, Tissot H, Velupillai S (2020) Relative and incomplete time expression anchoring for clinical text. In: Proceedings of the 3rd Clinical Natural Language Processing Workshop, pp 117–129
[42]
Emirali E, Karslıgil ME (2022) Using word embeddings in detection of temporal expressions in turkish texts. In: IEEE 2022 30th Signal Processing and Communications Applications Conference, pp 1–4
[43]
Enc M Towards a referential analysis of temporal expressions Linguist Philos 1986 9 4 405-426
[44]
Etcheverry M, Wonsever D (2017) Time expressions recognition with word vectors and neural networks. In: Proceedings of the 24th International Symposium on Temporal Representation and Reasoning, pp 1–12
[45]
Ferro L (2001) Tides instruction manual for the annotation of temporal expressions. MITRE, Tech rep
[46]
Ferro L, Mani I, Sundheim B, Wilson G (2001) Tides temporal annotation guidelines—version 1.0.2. MITRE, Tech rep
[47]
Ferro L, Gerber L, Mani I, Sundheim B, Wilson G (2005) Tides 2005 standard for the annotation of temporal expressions. MITRE, Tech rep
[48]
Filannino M, Brown G, Nenadic G (2013) Mantime: temporal expression identification and normalization in the tempeval-3 challenge. In: Proceedings of the 7th International Workshop on Semantic Evaluation, pp 53–57
[49]
Forascu C, Tufis D (2012) Romanian timebank: an annotated parallel corpus for temporal information. In: LREC, pp 3762–3766
[50]
Fu Y, Dhonnchadha EU (2020) A pattern-mining driven study on differences of newspapers in expressing temporal information. http://arXiv.org/2011.12265
[51]
Fu JT, Sholle E, Krichevsky S, Scandura J, and Campion TR Extracting and classifying diagnosis dates from clinical notes: a case study J Biomed Inform 2020 110 103 569
[52]
Funkner AA, Kovalchuk SV (2020) Time expressions identification without human-labeled corpus for clinical text mining in russian. In: International Conference on Computational Science, pp 591–602
[53]
Grabar N, Hamon T (2018) Automatic detection of temporal information in Ukrainian general-language texts. CNRS University Lille and LIMSI University Paris-Saclay, Tech rep
[54]
Grabar N, Hamon T (2019) Wikiwars-ua: Ukrainian corpus annotated with temporal expressions. In: Proceedings of the 3d International Conference Computational Linguistics And Intelligent Systems, pp 22–31
[55]
Grishman R, Sundheim B (1996) Message understanding conference—6: a brief history. In: Proceedings of the 16th International Conference on Computational Linguistics
[56]
Guillou L, Vroe SBD, Hosseini MJ, Johnson M, Steedman M (2020) Incorporating temporal information in entailment graph mining. In: Proceedings of the Graph-based Methods for Natural Language Processing, pp 60–71
[57]
Hao T, Pan X, Gu Z, Qu Y, and Weng H A pattern learning-based method for temporal expression extraction and normalization from multi-lingual heterogeneous clinical texts BMC Med Inform Decis Mak 2018 18 16-25
[58]
Hasanuzzaman M, Dias G, Ferrari S, Mathet Y (2014) Propagation strategies for building temporal ontologies. In: Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics, pp 6–11
[59]
He RF, Qin B, Liu T, Pan YQ, and Li S Recognizing the extent of Chinese time expressions based on the dependency parsing and error-driven learning J Chin Inf Process 2007 21 5 36-40
[60]
He R, Qin B, Liu T, Pan Y, and Li S A novel heuristic error-driven learning for recognizing Chinese time expression J Chin Lang Comput 2008 18 4 139-159
[61]
Hinrichs EW (1987) A compositional semantics of temporal expressions in English. In: Proceedings of the 25th Annual Meeting on Association for Computational Linguistics, pp 8–15
[62]
Hobbs JR, Appelt DE, Bear J, Israel D, Kameyama M, Stickel M, Tyson M (1997) Fastus: a cascaded finite-state transducer for extracting information from natrual-language text. In: Finite State Devices for Natural Language Processing, pp 383–406
[63]
Hossain T, Rahman MM, and Islam SM Temporal information extraction from textual data using long short-term memory recurrent neural network J Comput Technol Appl 2018 9 2 1-6
[64]
Im S, You H, Jang H, Nam S, Shin H (2009) Ktimeml: specification of temporal and event expressions in Korean text. In: Proceedings of the 7th Workshop on Asian Language Resources, ACL-IJCNLP 2009, pp 115–122
[65]
Jang SB, Baldwin J, and Mani I Automatic timex2 tagging of Korean news ACM Trans Asian Lang Inf Process 2004 3 1 51-65
[66]
Jeong YS, Joo WT, Do HW, Lim CG, Choi KS, Choi HJ (2016) Korean timeml and Korean timebank. In: Proceedings of LREC, pp 356–359
[67]
Jia Z, Abujabal A, Roy RS, Strotgen J, Weikum G (2018) Tempquestions: a benchmark for temporal question answering. In: Proceedings of the 2018 World Wide Web Conference Companion, pp 1057–1062
[68]
Jia Z, Pramanik S, Roy RS, Weikum G (2021) Complex temporal question answering on knowledge graphs. In: Proceedings of the 30th ACM international conference on information and knowledge management, pp 792–802
[69]
Jindal P and Roth D Extraction of events and temporal expressions from clinical narratives J Biomed Inform 2013 46 S13-S19
[70]
Jung H, Stent A (2013) Att1: temporal annotation using big windows and rich syntactic and semantic features. In: Proceedings of the 7th International Workshop on Semantic Evaluation, pp 20–24
[71]
Kamila S, Hasanuzzaman M, Ekbal A, and Bhattacharyya P Tempo-hindiwordnet: a lexical knowledge-base for temporal information processing ACM Trans Asian Low-Resour Lang Inf Process 2018 18 2 1-22
[72]
Khan SUR, Islam MA, Aleem M, and Iqbal MA Temporal specificity-based text classification for information retrieval Turk J Electr Eng Comput Sci 2018 26 2915-2926
[73]
Kim A, Pethe C, Skiena S (2020) What time is it? Temporal analysis of novels. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, pp 9076–9086
[74]
Kim ZM, Jeong YS (2016) Timex3 and event extraction using recurrent neural networks. In: Proceedings of the 2016 IEEE International Conference on Big Data and Smart Computing, pp 450–453
[75]
Kolomiyets O, Moens MF (2009) Meeting tempeval-2: shallow approach for temporal tagger. In: Proceedings of the NAACL HLT Workshop on Semantic Evaluation: Recent Achievements and Future Directions, pp 52–57
[76]
Kuzey E, Setty V, Strotgen J, Weikum G (2016) As time goes by: comprehensive tagging of textual phrases with temporal scopes. In: Proceedings of the 2016 World Wide Web Conference, pp 915–925
[77]
Lange L, Iurshina A, Adel H, Strötgen J (2020) Adversarial alignment of multilingual models for extracting temporal expressions from text. In: Proceedings of the 5th Workshop on Representation Learning for NLP, pp 103–109
[78]
Lange L, Strötgen J, Adel H, Klakow D (2022) Multilingual normalization of temporal expressions with masked language models. In: arXiv
[79]
Laparra E, Xu D, and Bethard S From characters to time intervals: new paradigms for evaluation and neural parsing of time normalizations Trans Assoc Computat Linguist 2018 6 343-356
[80]
Laparra E, Xu D, Bethard S, Elsayed AS, Palmer M (2018b) Semeval 2018 task 6: Parsing time normalizations. In: Proceedings of the 12th International Workshop on Semantic Evaluation, pp 88–96
[81]
Lavelli A, Magnini B, Negri M, Pianta E, Speranza M, Sprugnoli R (2005) Italian content annotation bank (i-cab): temporal expressions (v. 1.0). ITC-irst, Centro per la Ricerca Scientifica e Technologica Povo, Tech rep
[82]
Lee K, Artzi Y, Dodge J, Zettlemoyer L (2014) Context-dependent semantic parsing for time expressions. In: Proceedings of the 52th Annual Meeting of the Association for Computational Linguistics, pp 1437–1447
[83]
Lee HJ, Zhang Y, Jiang M, Xu J, Tao C, and Xu H Identifying direct temporal relations between time and events from clinical notes BMC Med Inform Decis Mak 2018 18 2 49
[84]
Leeuwenberg A and Moens MF A survey on temporal reasoning for temporal information extraction from text J Artif Intell Res 2019 66 341-380
[85]
Li J, Cardie C (2014) Timeline generation: tracking individuals on twitter. In: Proceedings of the 23rd International Conference on World Wide Web, pp 643–652
[86]
Li H, Strötgen J, Zell J, Gertz M (2014) Chinese temporal tagging with heideltime. In: Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics, pp 133–137
[87]
Lim CG, Choi HJ (2017) Efficient temporal information extraction from korean documents. In: Proceedings of IEEE 18th International Conference on Mobile Data Management, p 366370
[88]
Lim CG, Choi HJ (2019) Korean time information analysis of hierarchical annotation rules from natural language text. In: 2019 IEEE International Conference on Big Data and Smart Computing (BigComp), pp 1–4
[89]
Lim CG, Jeong YS, and Choi HJ Survey of temporal information extraction J Inf Process Syst 2019 15 4 931-956
[90]
Lin YK, Chen H, and Brown RA Medtime: a temporal information extraction system for clinical narratives J Biomed Inform 2013 46 S20-S28
[91]
Lin S, Jin P, Zhao X, and Yue L Exploiting temporal information in web search Expert Syst Appl 2014 41 2 331-341
[92]
Lin C, Miller T, Dligach D, Bethard S, Savova G (2017) Representations of time expressions for temporal relation extraction with convolutional neural networks. In: Proceedings of the 16th BioNLP Workshop, pp 322–327
[93]
Liu Y, Ott M, Goyal N, Du J, Joshi M, Chen D, Levy O, Lewis M, Zettlemoyer L, Stoyanov V (2019) Roberta: a robustly optimized bert pretraining approach. http://arxiv.org/1907.11692
[94]
Liu J, Xu J, Chen Y, Zhang Y (2021) Discourse-level event temporal ordering with uncertainty-guided graph completion. In: Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, pp 3871–3877
[95]
Llorens H, Saquete E, Navarro B (2010) Tipsem (english and spanish): evaluating crfs and semantic roles in tempeval-2. In: Proceedings of the 5th International Workshop on Semantic Evaluation, pp 284–291
[96]
Llorens H, Derczynski L, Gaizauskas R, Saquete E (2012) Timen: an open temporal expression normalisation resource. In: Proceedings of the 8th International Conference on Language Resources and Evaluation, pp 3044–3051
[97]
Loro MN (2021) Processing, identification and representation of temporal expressions and events in legal documents. PhD thesis, Escuela Tecnica Superior de Ingenieros Informatica
[98]
MacAvaney S, Desmet B, Cohan A, Soldaini L, Yates A, Zirikly A, Goharian N (2018) Rsdd-time: temporal annotation of self-reported mental health diagnoses. In: Proceedings of the Fifth Workshop on Computational Linguistics and Clinical Psychology: From Keyboard to Clinic, pp 168–173
[99]
Manfredi G, Strötgen J, Zell J, Gertz M (2014) Heideltime at eventi: tuning italian resources and addressing timeml’s empty tags. In: Proceedings of the 4th International Workshop EVALITA, pp 39–43
[100]
Mani I (2003) Recent developments in temporal information. In: Proceedings of the International Conference on Recent Advances in Natural Language Processing, pp 45–60
[101]
Mani I, Wilson G (2000) Robust temporal processing of news. In: Proceedings of the 38th annual meeting on Association for Computational Linguistics, pp 69–76
[102]
Mani I, Wilson G, Ferro L, Sundheim B (2001) Guidelines for annotation temporal information. In: Proceedings of the first International Conference on Human Language Technology Research, pp 1–3
[103]
Mani I, Verhagen M, Wellner B, Lee CM, Pustejovsky J (2006) Machine learning of temporal relations. In: Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics, pp 753–760
[104]
Mansouri B, Zahedi MS, Campos R, Farhoodi M, Rahgozar M (2018) Parstime: Rule-based extraction and normalization of persian temporal expressions. In: European Conference on Information Retrieval, pp 715–721
[105]
Mazur P, Dale R (2010) Wikiwars: a new corpus for research on temporal expressions. In: Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, pp 913–922
[106]
Miller T, Bethard S, Dligach D, Lin C, Savova G (2015) Extracting time expressions from clinical text. In: Proceedings of the 2015 Workshop on Biomedical Natural Language Processing, pp 81–91
[107]
Minard AL, Speranza M, Agirre E, Aldabe I, van Erp M, Magnini B, Rigau G, Urizar R (2015) Semeval-2015 task 4: timeline: Cross-document event ordering. In: 9th International Workshop on Semantic Evaluation (SemEval 2015), pp 778–786
[108]
Moriceau V, Tannier X (2014) French resources for extraction and normalizationg of temporal expressions with heideltime. In: Proceedings of the 9th International Conference on Language Resources and Evaluation, pp 3239–3243
[109]
Murat A, Yusup A, Iskandar Z, Yusup A, and Abaydulla Y Applying lexical semantics to automatic extraction of temporal expressions in Uyghur J Inf Process Syst 2018 14 4 824
[110]
Naik A, Breitfeller L, Rose C (2019) Tddiscourse: a dataset for discourse-level temporal ordering of events. In: Proceedings of the SIGDial 2019 Conference, pp 239–249
[111]
Najafabadipour M, Zanin M, Rodríguez-González A, Gonzalo-Martín C, García BN, Calvo V, Bermudez JLC, Provencio M, Menasalvas E (2019) Recognition of time expressions in spanish electronic health records. In: IEEE International Symposium on Computer-Based Medical Systems, pp 69–74
[112]
Navas-Loro M and Rodríguez-Doncel V Annotador: a temporal tagger for Spanish J Intell Fuzzy Syst 2020 39 2 1979-1991
[113]
Navas-Loro M, Filtz E, Rodríguez-Doncel V, Polleres A, and Kirrane S Tempcourt: evaluation of temporal taggers on a new corpus of court decisions Knowl Eng Rev 2019 34 1-25
[114]
Negri M, Marseglia L (2004) Recognition and normalization of time expressions: Itc-irst at tern 2004. ITC-irst, Tech rep
[115]
Negri M, Saquete E, Martinez-Barco P, Munoz R (2006) Evaluating knowledge-based approaches to the multilingual extension of a temporal expression normalizer. In: Proceedings of the Workshop on Annotating and Reasoning about Time and Events, pp 30–37
[116]
Ning Q, Zhou B, Feng Z, Peng H, Roth D (2018) Cogcomptime: a tool for understanding time in natural language. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pp 72–77
[117]
Niu J, Ng V, Penn G, Rees EE (2020) Temporal histories of epidemic events (thee): a case study in temporal annotation for public health. In: LREC, pp 2223–2230
[118]
Nzali MDT, Tannier X, Neveol A (2015) Automatic extraction of time expressions across domains in french narratives. In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pp 492–498
[119]
Ocal M, Perez A, Radas A, Finlayson MA (2022a) Holistic evaluation of automatic timeml annotators. In: Proceedings of the 13th Conference on Language Resources and Evaluation, pp 1444–1453
[120]
Ocal M, Radas A, Hummer J, Megerdoomian K (2022b) A comprehensive evaluation and correction of the timebank corpus. In: Proceedings of the 13th Conference on Language Resources and Evaluation, pp 2919–2927
[121]
Olex AL, Maffey LG, Morton N, McInnes BT (2018) Chrono at semeval-2018 task 6: a system for normalizing temporal expressions. In: Proceedings of the 12th International Workshop on Semantic Evaluation (SemEval-2018), pp 97–101
[122]
Olex AL, Maffey LG, and McInnes BT Nlp whack-a-mole: challenges in cross-domain temporal expression extraction Proc NAACL-HLT 2019 2019 3682-3692
[123]
Pan X, Chen B, Weng H, Gong Y, and Qu Y Temporal expression classification and normalization from Chinese narrative clinical texts: pattern learning approach JMIR Med Inform 2020 8 7 e17-652
[124]
Parker R, Graff D, Kong J, Chen K, Maeda K (2011) Engilish gigaword, fifth edn
[125]
Patra B, Fufa C, Bhattacharya P, Lee CC (2020) To schedule or not to schedule: extracting task specific temporal entities and associated negation constraints. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, pp 8445–8455
[126]
Pustejovsky J, Castano J, Ingria R, Sauri R, Gaizauskas R, Setzer A, Katz G, and Radev D Timeml: robust specification of event and temporal expressions in text New Dir Quest Answering 2003 3 28-34
[127]
Pustejovsky J, Hanks P, Sauri R, See A, Gaizauskas R, Setzer A, Sundheim B, Radev D, Day D, Ferro L, and Lazo M The timebank corpus Corpus Linguist 2003 2003 647-656
[128]
Pustejovsky J, Lee K, Bunt H, Romary L (2010) Iso-timeml: an international standard for semantic annotation. In: Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC’10), pp 394–397
[129]
Qin L, Gupta A, Upadhyay S, He L, Choi Y, Faruqui M (2021) Timedial: temporal commonsense reasoning in dialog. In: ACL/IJCNLP, pp 7066–7076
[130]
Rahoman MM and Ichise R A proposal of a temporal semantics aware linked data information retrieval framework J Intell Inf Syst 2018 50 3 573-95
[131]
Reichenbach H (1947) Elements of Symbolic Logic. University of California Berkeley Press
[132]
Roberts K, Rink B, and Harabagiu SM A flexible framework for recognizing events, temporal expressions, and temporal relations in clinical text J Am Med Inform Assoc 2013 20 5 867-875
[133]
Sakaguchi T, Kawahara D, Kurohashi S (2018) Comprehensive annotation of various types of temporal information on the time axis. In: Proceedings of the 11th Conference on Language Resources and Evaluation
[134]
Saquete E, Martinez-Barco P, Munoz R (2002) Recognizing and tagging temporal expressions in spanish. In: In Proceedings of LREC Workshop on Annotation Standards for Temporal Information in Natural Language, pp 44–51
[135]
Saquete E, Martinez-Barco P, Munoz R (2004) Evaluation of the automatic multilinguality for time expression resolution. In: Proceedings of the 15th International Workshop on Database and Expert Systems Applications, pp 25–30
[136]
Sauri R, Saquete E, Pustejovsky J (2010) Annotating time expressions in Spanish. timeml annotation guidelines (version tempeval-2010). Barcelona Media—Innovation Center, Tech rep
[137]
Setzer A, Gaizauskas R (2000) Annotating events and temporal information in newswire texts. In: Proceedings of LREC, pp 1287–1294
[138]
Shim H, Lowet D, Luca S, Vanrumste B (2021) Synthetic data generation and multi-task learning for extracting temporal information from health-related narrative text. In: Proceedings of the 2021 EMNLP Workshop W-NUT: the Seventh Workshop on Noisy User-generated Text, pp 260–273
[139]
Shokouhi M, Radinsky K (2012) Time-sensitive query auto-completion. In: Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp 601–610
[140]
Skukan L, Glavas G, Snajder J (2014) Heideltime.hr: extracting and normalizing temporal expressions in Croatian. In: Proceedings of the 9th Slovenian Language Technologies Conference, pp 99–103
[141]
Smith CS The syntax and interpretation of temporal expressions in English Linguist Philos 1978 2 1 43-99
[142]
Sohn S, Wagholikar KB, Li D, Jonnalagadda SR, Tao C, Elayavilli RK, and Liu H Comprehensive temporal information detection from clinical text: medical events, time, and tlink identification J Am Med Inform Assoc 2013 20 5 836-842
[143]
Starý M, Nevěřilová Z, Valčík J (2020) Multilingual recognition of temporal expressions. In: Proceedings of Recent Advances in Slavonic Natural Language Processing, pp 67–78
[144]
Steedman M Surface Structure and Interpretation 1996 Cambridge The MIT Press
[145]
Strotgen J (2015) Domain-sensitive temporal tagging for event-centric information retrieval. PhD thesis, Heidelberg University, Germany
[146]
Strötgen J, Gertz M (2010) Heideltime: high quality rule-based extraction and normalization of temporal expressions. In: Proceedings of the 5th International Workshop on Semantic Evaluation (SemEval’10), Association for Computational Linguistics, Stroudsburg, PA, pp 321–324
[147]
Strötgen J, Gertz M (2011) Wikiwarsde: A german corpus of narratives annotated with temporal expressions. In: Proceedings of German Society for Computational Linguistics and Language Technology, pp 129–134
[148]
Strötgen J, Gertz M (2012) Temporal tagging on different domains: challenges, strategies, and gold standards. In: Proceedings of 8th International Conference on Language Resources and Evaluation, pp 3746–3753
[149]
Strotgen J and Gertz M Multilingual and cross-domain temporal tagging Lang Resour Eval 2013 47 2 269-298
[150]
Strotgen J, Gertz M (2015) A baseline temporal tagger for all languages. In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pp 541–547
[151]
Strötgen J, Zell J, Gertz M (2013) Heideltime: tuning English and developing Spanish resources. In: Proceedings of the Second Joint Conference on Lexical and Computational Semantics (SEM), pp 15–19
[152]
Strötgen J, Armiti A, Canh TV, Zell J, and Gertz M Time for more languages: temporal tagging of Arabic, Italian, Spanish, and Vietnamese ACM Trans Asian Lang Inf Process 2014 13 1 1-21
[153]
Wfs IV, Bethard S, Finan S, Palmer M, Pradhan S, de Groen PC, Erickson B, Miller T, Lin C, Savova G, and Pustejovsky J Temporal annotation in the clinical domain Trans Assoc Computat Linguist 2014 2 143-154
[154]
Su BY, Hsu SL, Lai KY, jen Hsu JY (2021) Context-dependent semantic parsing for temporal relation extraction. In: arXiv
[155]
Sun W, Rumshisky A, and Uzuner O Normalization of relative and incomplete temporal expressions in clinical narratives J Am Med Inform Assoc 2015 22 5 1001-1008
[156]
Tabassum J, Ritter A, Xu W (2016) Tweetime: a minimally supervised method for recognizing and normalizing time expressions in twitter. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pp 307–318
[157]
Taule M, Marti T, Recasens M (2008) Ancora: Multilevel annotated corpora for Catalan and Spanish. In: Proceedings of the 6th International Conference on Language Resources and Evaluation
[158]
Tissot H, Fabro MDD, Derczynski L, and Roberts A Normalisation of imprecise temporal expressions extracted from text Knowl Inf Syst 2019 61 1361-1394
[159]
UzZaman N, Allen JF (2010) Trips and trios system for tempeval-2: extracting temporal information from text. In: Proceedings of the 5th International Workshop on Semantic Evaluation, pp 276–283
[160]
UzZaman N, Llorens H, Derczynski L, Verhagen M, Allen J, Pustejovsky J (2013) Semeval-2013 task 1: Tempeval-3: evaluating time expressions, events, and temporal relations. In: Proceedings of the 7th International Workshop on Semantic Evaluation, pp 1–9
[161]
van de Camp M, Christiansen H (2012) Resolving relative time expressions in dutch text with constraint handling rules. In: Proceedings of the 7th International Workshop on Constraint Solving and Language Processing, pp 74–85
[162]
Vashishth S, Dasgupta SS, Ray SN, Talukdar P (2018) Dating documents using graph convolution networks. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, pp 1605–1615
[163]
Vazov N (2001) A system for extraction of temporal expressions from French texts based on syntactic and semantic constraints. In: Proceedings of the Workshop on Temporal and Spatial Information Processing, pp 14–21
[164]
Verhagen M, Mani I, Sauri R, Knippen R, Jang SB, Littman J, Rumshisky A, Phillips J, Pustejovsky J (2005) Automating temporal annotation with Tarqi. In: Proceedings of the ACL Interactive Poster and Demonstration Sessions., pp 81–84
[165]
Verhagen M, Gaizauskas R, Schilder F, Hepple M, Katz G, Pustejovsky J (2007) Semeval-2007 task 15: tempeval temporal relation identification. In: Proceedings of the 4th International Workshop on Semantic Evaluation, pp 75–80
[166]
Verhagen M, Sauri R, Caselli T, Pustejovsky J (2010) Semeval-2010 task 13: tempeval-2. In: Proceedings of the 5th International Workshop on Semantic Evaluation, pp 57–62
[167]
Viani N, Yin L, Kam J, Alawi A, Bittar AL, Dutta R, Patel R, Stewart RJ, Velupillai S (2018) Time expressions in mental health records for symptom onset extraction. In: Proceedings of the 9th International Workshop on Health Text Mining and Information Analysis
[168]
Viani N, Kam J, Yin L, Bittar A, Dutta R, Patel R, Stewart R, and Velupillai S Temporal information extraction from mental health records to identify duration of untreated psychosis J Biomed Seman 2020 11 2 1-11
[169]
Wilson G, Mani I, Sundheim B, Ferro L (2001) A multilingual approach to annotating and extracting temporal information. In: Proceedings of the Workshop on Temporal and Spatial Information Processing, p 12
[170]
Wong KF, Xia Y, Li W, and Yuan C An overview of temporal information extraction Int J Comput Process Oriental Lang 2005 18 2 137-152
[171]
Wu M, Li W, Chen Q, Lu Q (2005a) Normalizing Chinese temporal expressions with multi-label classification. In: Proceedings of the 2th International Conference on Natural Language Processing and Knowledge Engineering, pp 318–323
[172]
Wu M, Li W, Lu Q, Li B (2005b) Ctemp: a Chinese temporal parser for extracting and normalizing temporal information. In: Proceedings of Natural Language Processing-IJCNLP, pp 694–706
[173]
Wu T, Zhou Y, Huang X, and Wu L Chinese time expression recognition based on automatically generated basic-time-unit rules J Chin Inf Process 2010 24 4 3-10
[174]
Yin B, Jin B (2017) A multi-label classification method on Chinese temporal expressions based on character embedding. In: Proceedings of the 4th International Conference on Information Science and Control Engineering, pp 51–54
[175]
Zarcone A, Alam T, Kolagar Z (2020) Pâté: a corpus of temporal expressions for the in-car voice assistant domain. In: LREC, pp 523–530
[176]
Zavarella V, Tanev H (2013) Fss-timex for tempeval-3: extracting temporal information from text. In: SemEval, pp 58–63
[177]
Zhao X, Jin P, and Yue L Automatic temporal expression normalization with reference time dynamic-choosing COLING 2010 2010 1498-1506
[178]
Zhong X (2020) Time expression and named entity analysis and recognition. PhD thesis, Nanyang Technological University, Singapore
[179]
Zhong X, Cambria E (2018) Time expression recognition using a constituent-based tagging scheme. In: Proceedings of the World Wide Web Conference, pp 983–992
[180]
Zhong X and Cambria E Time expression and named entity recognition 2021 Berlin Springer
[181]
Zhong X, Sun A, Cambria E (2017) Time expression analysis and recognition using syntactic token types and general heuristic rules. In: ACL, pp 420–429
[182]
Zhong X, Kaalia R, and Rajapakse JC Go2vec: transforming go terms and proteins to vector representations via graph embeddings BMC Genomics 2019 20 9 1-10
[183]
Zhong X, Cambria E, and Hussain A Extracting time expressions and named entities with constituent-based tagging schemes Cogn Comput 2020 12 4 844-862
[184]
Zhong X, Cambria E, and Hussain A Does semantics aid syntax? An empirical study on named entity recognition and classification Neural Comput Appl 2022 34 11 8373-8384
[185]
Zhou R, Li X, He R, Bing L, Cambria E, Si L, Miao C (2022) MELM: data augmentation with masked entity language modeling for low-resource NER. In: ACL, pp 2251–2262
Recommendations
Pathway recognition and augmentation by computational analysis of microarray expression data
Motivation: We present a system, QPACA (Quantitative Pathway Analysis in Cancer) for analysis of biological data in the context of pathways. QPACA supports data visualization and both fine- and coarse-grained specifications, but, more importantly, ...
Identifying time-lagged gene clusters using gene expression data
Motivation: Analysis of gene expression data can provide insights into the time-lagged co-regulation of genes/gene clusters. However, existing methods such as the Event Method and the Edge Detection Method are inefficient as they compare only two ...
Comments
Information & Contributors
Information
Published In
© The Author(s), under exclusive licence to Springer Nature B.V. 2023. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
Publisher
Kluwer Academic Publishers
United States
Publication History
Published: 24 January 2023
Author Tags
Qualifiers
- Research-article
Funding Sources
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 09 Nov 2024
Other Metrics
Citations
Cited By
View all- Ding WChen JE LLi JQu Y(2023)Time expression as update operationsKnowledge-Based Systems10.1016/j.knosys.2023.110870278:COnline publication date: 25-Oct-2023
View Options
View options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in