This document discusses deep learning and its applications. It provides an overview of deep learning, including how it is used for tasks like speech recognition, machine translation, and image classification. It then discusses deep learning applications at NAVER, including using convolutional neural networks for image classification and recurrent neural networks for language modeling. The document also covers important aspects of deep learning like new algorithms, large datasets, and specialized hardware.
Report
Share
Report
Share
1 of 79
Download to read offline
More Related Content
[2A4]DeepLearningAtNAVER
1. Deep
Learning
at
NAVER
DEVIEW
2014
NAVER
LABS
김 정 희 수석연구원
2014. 09. 30
2. Contents
2
1. Deep learning overview
2. Deep learning at NAVER
3. Deep learning?
56. Prior
Know-‐
ledge
Afer
–
Big
Data
56
Real
World
Data
Small
Leaning
Data
ERROR
!!!
Big
Learning
Data
57. Big
Data
57
• Neural
networks
§ Supervised
learning
§ 무작정 data
만 많이 있어서는 안된다
§ 정답이 있는 data가 많이 있어야 한다
58. Big
Data
58
• 정답이 있는 DB를 대량으로 구축하기 힘들다면…
§ Semi-‐supervised
learning
§ Supervised
Learning
+
Unsupervised
Learning
59. Big
Data
59
• Big
Data
를 구축하기 힘들다면…
§ 서비스 개발 진입 장벽
60. Big
Data
60
• Big
Data
를 구축하기 힘들다면…
§ 일단 만들고 beta
서비스 하자 !
61. Transfer
Learning
61
• Deep
learning
!
RepresentaNon
learning
§ 유사 Domain
에서 학습된 내용을 다른 도메인으로
§ 한국어 음성인식 ! 일본어 음성인식
§ 중국어 OCR
!
일본어 OCR
§ 이미지 feature
extractor
62. Transfer
Learning
–
Image
62
FFNN
CNN
Supervised
Trained
Feature
Extractor
Alex
Krizhevsky
et
al.
2012
NIPSNN