Cited By
View all- Zhou BYang GShi ZMa S(2024)Natural Language Processing for Smart HealthcareIEEE Reviews in Biomedical Engineering10.1109/RBME.2022.321027017(4-18)Online publication date: 2024
A new visual question answering system for medical images characterization
Authors: 
Bghiel Afrae, Dahdouh Yousra, Allaouzi Imane, 
Ben Ahmed Mohamed, Anouar Boudhir AbdelhakimAuthors Info & Claims
Bghiel Afrae, Dahdouh Yousra, Allaouzi Imane, Ben Ahmed Mohamed, Anouar Boudhir AbdelhakimAuthors Info & ClaimsArticle No.: 106, Pages 1 - 7
Abstract
This article presents our proposed system combining a Recurrent Neural Network (RNN) and Convolutional Neural Network (CNN) for the visual question answering applied in the medical images characterization.
In our proposed Encoder-Decoder Model we have used a pre-trained convolutional neural network to extract image features, a pre-trained word embedding for questions-answers representation.
References
[1]
Peter Hall and Paul McKevitt. 1995. Integrating vision processing and natural language processing with a clinical application. In Proceedings 1995 2nd New Zealand International Two-Stream Conference on Artificial Neural Networks and Expert Systems, pages 373--376, Dunedin, New Zealand.
[2]
Sonit Singh: Pushing the Limits of Radiology with Joint Modeling of Visual and Textual Information (P18-3005).
[3]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, Jian Sun: Deep Residual Learning for Image Recognition: arXiv:1512.03385v1 [cs.CV] 10 Dec 2015.
[4]
Krizhevsky, A., Sutskever, I., Hinton, G. E., ImageNet classification with deep convolutional neural networks. In NIPS (2012).
[5]
Sutskever, I., Vinyals, O., V Le, Q.: Sequence to Sequence Learning with Neural Networks, In: the 27th International Conference on Neural Information Processing Systems, Vol. 2, pp. 3104--3112 (2014).
[6]
Vinyals, O., Toshev, A., Bengio, S., Erhan, D.: Show and tell: A neural image caption generator. In CVPR (2015).
[7]
Yang, Z., He, X., Gao, J., Deng, L., Smola, A.: Stacked attention networks for image question answering. In CVPR (2016).
[8]
Zhou, B., Tian, Y., Sukhbaatar, S., Szlam, A., Fergus, R., Simple baseline for visual question answering. arXiv preprint arXiv:1512.02167 (2015).
[9]
Imane Allaouzi, Badr Benamrou, Mohamed Benamrou and Mohamed Ben Ahmed: Deep Neural Networks and Decision Tree classifier for Visual Question Answering in the medical domain.
[10]
ImageNet. http://www.image-net.org.
[11]
https://skymind.ai/wiki/word2vec.
[12]
https://towardsdatascience.com/understanding-and-coding-a-resnet-in-keras-446d7ff84d33.
[13]
Yuelei Xiao and Yang Yin, Hybrid LSTM Neural Network for Short-Term Traffic Flow Prediction.; Published: 8 March 2019.
[14]
https://home.cse.ust.hk/~dekai/271/notes/L14/L14.pdf.
[15]
Kishore Papineni; Salim Roukos; Todd Ward; Wei-Jing Zhu: Bleu: A Method for Automatic Evaluation of Machine Translation (September 17, 2001).
[16]
Sebastian Ruder, An overview of gradient descent optimization algorithms*, arXiv:1609.04747v2 [cs. LG] 15 Jun 2017.
[17]
https://medium.com/@lessw/new-state-of-the-art-ai-optimizer-rectified-adam-radam-5d854730807b.
[18]
Yangyang Zhou; Xin Kang; and Fuji Ren: Employing Inception-Resnet-v2 and Bi-LSTM for Medical Domain Visual Question Answering; CEUR-WS.org\vol-2125\paper_107.pdf.
[19]
Yalei Peng, Feifan Liu, and Max P. Rosen : UMass at ImageCLEF Medical Visual Question Answering(Med-VQA) 2018 Task
Recommendations
Automatic Caption Generation for Medical Images
SCA '18: Proceedings of the 3rd International Conference on Smart City ApplicationsWith the increasing availability of medical images coming from different modalities (X-Ray, CT, PET, MRI, ultrasound, etc.), and the huge advances in the development of incredibly fast, accurate and enhanced computing power with the current graphics ...
Deep visual tracking
The first comprehensive survey on deep-learning-based trackers.Review existing deep visual trackers from three different perspectives.Large-scale benchmark evaluations of deep visual trackers.Summarize cutting-edge research works and discuss future ...
Depth estimation from single monocular images using deep hybrid network
Depth estimation is a significant task in the robotics vision. In this paper, we address the depth estimation from a single monocular image, which is a challenging problem in automated vision systems since a single image alone does not carry any ...
Comments
Information & Contributors
Information
Published In
October 2019
788 pages
ISBN:9781450362894
DOI:10.1145/3368756
Copyright © 2019 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 02 October 2019
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
SCA2019
SCA2019: The Fourth International Conference on Smart City Applications
October 2 - 4, 2019
Casablanca, Morocco
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 110Total Downloads
- Downloads (Last 12 months)3
- Downloads (Last 6 weeks)0
Reflects downloads up to 27 Jul 2024
Other Metrics
Citations
Cited By
View all- Zhou BYang GShi ZMa S(2024)Natural Language Processing for Smart HealthcareIEEE Reviews in Biomedical Engineering10.1109/RBME.2022.321027017(4-18)Online publication date: 2024
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in