Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
SlideShare a Scribd company logo

Poetic Dream - Deep Learning Maker Portfolio (Harvard REA Version)

•
•
K
Kevin (Yu-Teng) Li

Poetic Dream is a poetry visualization project that uses deep learning techniques like natural language processing, image captioning APIs, and neural style transfer to analyze a poem and generate a corresponding artwork. It involves preprocessing the text with NLP, searching image databases for relevant content, applying the content image to a style image using neural style transfer, and designing a graphical user interface to display the generated artworks along with the original poem. The project aims to explore how text can inspire visual art but faces limitations from computational costs and data availability.

Related slideshows

Chaos Engineering on Microservices - 윤석찬, AWS 테크에반젤리스트
Chaos Engineering on Microservices - 윤석찬, AWS 테크에반젤리스트 Chaos Engineering on Microservices - 윤석찬, AWS 테크에반젤리스트
Chaos Engineering on Microservices - 윤석찬, AWS 테크에반젤리스트
 
Edge trends mizuno-template
Edge trends mizuno-templateEdge trends mizuno-template
Edge trends mizuno-template
 
Safe Reinforcement Learning
Safe Reinforcement LearningSafe Reinforcement Learning
Safe Reinforcement Learning
 
1 of 28
Download to read offline
Harvard College Supplement Material Computer Science & Literature Yu-Teng Li
Poetry Imagery Visualizer Poetic Dream 12th grade self-directed project ML Code: https://github.com/Curiouskid0423/Poetic_Dream
What is Poetic Dream Poetic Dream is a poetry imagery visualizer project based on Deep Learning, analyzing a poem and composing corresponding artistically-styled image PROJECT ONE
Motivation . 22 - - 8 2 2 1 2 - 2 8 2 8 8 8 2 . 8 0 8 8 88 8 . - . 8 8 “How Images Inspire Poems” Can text inspire artworks? PROJECT ONE
Poetic Dream - Deep Learning Maker Portfolio (Harvard REA Version)
Paper Research : : A A A -AE: 2 GF ) J )D N F - C F 3 JJAB JA & A : ( : -AE: - : A 0K JBF 0GAF GF )D N F )D AB 2B . B . B C A : : A E C A ) E AC 2BFDB K 2B F 0B F ( A A A A A A - 7GE 3BCGDGL 1 B A F G G 0 , F A A EC DA A 5G -F D , E GMD 8 PROJECT ONE A
KG BA L 19AFBE BJ L CK L CK L 9E F99C 9 EA A E 9JBE F ( BA BEG 19E -9 BEK 1- 9D F9D L ( B 9 L 9E G L BE 9 G E A 9 EB 9FF A ( ( ( (( CE9 GE A9 B 9 9 E GK 9 1E AF 9E 2AFC F )) 9 9 E A A9 (BB 9 B BE GBEKB ( 2 1E A A F L BBGFGE C L I F E CG2F9E )AG9E 9 9F A J9 C 9 Framework Tools PROJECT ONE )
Flow Chart PART ONE
Procedure Overview Natural Language Processing . ( (- ( . .( 3) 3 . - 1 1 (1 (1 9 (( 3) 9 9 1 1 9 A ) Image Captioning / API Search . . - ) . , (- .3 - ) ( 3 3 . , ( - 3) . , - ( Neural Style Transfer ) 3 ( 3 3 3) . , .3, 9 9 9 (1 (1 9 (( 3) .3 ) ) Graphics Interface / Webpage , - . ( . 3 .3 , 3) ( 3 3. 3 (( PROJECT ONE )91 1
Step 1 - NLP )/AB / / B/ / , / ) B / ,A / / A / . / A / / E A A >B , >B ( / / B A /A A B A/ / / A A A / B / A A A / A A / B / A A / A A / A B A A / )) / , ( )) / )) / A/ A A A A /A B / G , ( / B / A A B A A / A / A A EA / A/ A A /A B /A /A Γu A /A Γf / BA BA /A Γo , ( B A / / ML Code: https://github.com/Curiouskid0423/Poetic_Dream PROJECT ONE
- - - - - / - - / - B - - / -/ . - - - - B - -. -/ - - - - .- . - - - / / / - -B D / / . / - PROJECT ONE &
- E E . CC: / ( : - E / I 0 C ) : 1 C : CE : : : : CE : : C C : :5 : C C:5 : C AE L EC: : 5: :5E G 5C ,I 5 : C CE 5 C : : GC C : 5 5 C : 5 C 5 C PROJECT ONE
A ) A> - A A - .A A A A / >A A : A A> A A >A >E A E I> A E A> ( > A I > > > A I > >A > A A I > > E ’ A > A E > > : “ ( ) ” G A A E A A > >A K > > A ) A A A I > ) > > A A A > E > > G A > , ( >A > PROJECT ONE
,1 C 1 1 C1 ( 1 . 1 , C 1 . F / 1 1 ( 1 0 1 / 1 1 F 1 1: 1 ./ 1 C 1 1 1 1 F ( E 1 1 1 F 1 1 1 C 1 F 1 1 1 ) 1 E 1 1 PROJECT ONE
/ / / (/ / / ( / ) / / / / / / / / / / / / / / / / / PROJECT ONE
Step 2 – IMG Search D DA D . G D C AE! D C D D D D G E - C - EH C E AE D E D C C C G E AE D E E D E C B C D E E A E E E H E G DD E ! ) H G C D E C A CEI C CI DE C E D AE C D ED E’D H I E D A CE E ! ! C - E C , .C DD / C - C /EI C D C (C A E C A PROJECT ONE
Step 3 - NST ( / / / / / . . / ) , , / . / . / , , . / , / / / , . / / , / / . ML Code: https://github.com/Curiouskid0423/Poetic_Dream PROJECT ONE
E 9E 9 5 CC 9 9 . 5 9 E . / C ) 5 5 2 9 E 5 I 9 C 6 5 5E Jcontent & Jstyle 5 5E C (E 5 G 9 6 66 / C5 E I 6 6 6 1)) C 6 ) C’ 6 / C G G F 9 C 6 C ) 9 E6 ) 0 F 5 5 5 6 C 9 Jcontent & Jstyle PROJECT ONE
/ / / / / / / / J. >> Style Image Credit: MYSTERIOUS RAIN PRINCESS —By Leonid Afremov PROJECT ONE /
Step 4 - GUI Design / -/ / / - / / / / - / -/ / / / / / ./ --/ / / / /. / / -- - / / - / - / . . . / / ./ / / . / / PROJECT ONE
Page 2 Page 1 ( . (., , , , ( , . ( , , , , , , , , . , (., A , , , , , ( ( ( , , ( ( , , , , ( ( , . , , ( ( ( ( , , , , , ), , ( , , , ( ( ( , ) ( ,
Page 4 Page 3 . . . ( . . ( . . . , . . . ., . . . ., . ., . . , . .. . ( . . . , . . . ) . . . . . . , . . . . . . . ., . . , , . , .
2 + 0 2 ) 0 1 0 40 . 0 . 0 . 0 1 40 . 0 0 . 0 (02 0 + 0 . 0 0 Other artworks displayed in my Creative Writing Portfolio PROJECT ONE
+ . 5 1 0 .5 0 5 1 0 0 5 .35 . 5 0 . 4 0 ) 5 5 + +4 . -. (. . 5 Other artworks displayed in my Creative Writing Portfolio PROJECT ONE
A ) A B B B B A ( A A + A B B B B A , ) C A Other artworks displayed in my Creative Writing Portfolio PROJECT ONE
E A E A A A A AE A A A A A E A A A E AE A - . ! ) A A , ) A AE! , ( ) E A E A ( , A A A A E A E A E C ! , E A A C A A A A A A A C A A A A A A A A C E “ ” A A A ! PROJECT ONE ML Code: https://github.com/Curiouskid0423/Poetic_Dream
E8D )J 8D 8A 8 1IB A DB 8 8 DB 8 8A E A A: 8D 8 G A: IB 8D8A :BD E DB E’s A ,B AEBA’E 8D D8E 8 8 DB 8 8 .01 B 8 I BD8 8J 5 5G E BI8D B G BA AG 8E BA B D8A 8D J D IBD 8 8 E 88 B .01 E B 58 8A A 8 BD 58 8D GE8D 8J 8D 8A 8 D8 E BA B .- 1 8 D8 E8A8EE B E 8 8A 8 & EB 8 8E EG 8DE DB 8 BI B G BA BI8D BD EG 8A D A A: A E8 E 8 8EE B EB B A 8D D8 B8 EG D L BA BD 8 IBD 8J D BA E DB5 5 D DB 8 58E EB G BA I BA AG8 D8E8 D BA 8E8 EEG8E A B 8:8 Data Limitation Computational cost A D8 8 IB A DB5 8 E B .- A .01 EG 8DE DB 8 B G BA 8J 8AE8 5G E8 EEG8E 8 .- 8 8A BD8 8A: A: 8 BG E8 B 8 8 B A 8D 8J 8AE 8 E8 D 8E 8D D D A A: E8 .- A 8D GD8 D8E8 D E : : A 8 8 E E A E :8 A GE A B B L8 8 DB:D I BIA 58 8 8D GD8 E8 A 8 G GD8 BD BD8 E E BD D8EG E ) D A GD8 B (88 -8 DA A: E E A E :8 B D8E8 D A B 8 B G5 E B 8 G5 B DB B 8 8 8 B 8 AB B: A: 8 A 8 B G A 8E 8 EG 8DE DB 8 : 8 D A GD8 B 88 8 DA A: EB 8 A: 58 8 8 A 58 D8EB 8 5 8 DA A: DB A GD8 BI 5 B B: A AE D8 :BD D 8 GD8 A D8 A 8A B D8E8 D A B 8:8 PROJECT ONE ML Code: https://github.com/Curiouskid0423/Poetic_Dream
Poetry Imagery Visualizer Poetic Dream 12th grade self-directed project ML Code: https://github.com/Curiouskid0423/Poetic_Dream

More Related Content

Poetic Dream - Deep Learning Maker Portfolio (Harvard REA Version)

  • 1. Harvard College Supplement Material Computer Science & Literature Yu-Teng Li
  • 2. Poetry Imagery Visualizer Poetic Dream 12th grade self-directed project ML Code: https://github.com/Curiouskid0423/Poetic_Dream
  • 3. What is Poetic Dream Poetic Dream is a poetry imagery visualizer project based on Deep Learning, analyzing a poem and composing corresponding artistically-styled image PROJECT ONE
  • 4. Motivation . 22 - - 8 2 2 1 2 - 2 8 2 8 8 8 2 . 8 0 8 8 88 8 . - . 8 8 “How Images Inspire Poems” Can text inspire artworks? PROJECT ONE
  • 6. Paper Research : : A A A -AE: 2 GF ) J )D N F - C F 3 JJAB JA & A : ( : -AE: - : A 0K JBF 0GAF GF )D N F )D AB 2B . B . B C A : : A E C A ) E AC 2BFDB K 2B F 0B F ( A A A A A A - 7GE 3BCGDGL 1 B A F G G 0 , F A A EC DA A 5G -F D , E GMD 8 PROJECT ONE A
  • 7. KG BA L 19AFBE BJ L CK L CK L 9E F99C 9 EA A E 9JBE F ( BA BEG 19E -9 BEK 1- 9D F9D L ( B 9 L 9E G L BE 9 G E A 9 EB 9FF A ( ( ( (( CE9 GE A9 B 9 9 E GK 9 1E AF 9E 2AFC F )) 9 9 E A A9 (BB 9 B BE GBEKB ( 2 1E A A F L BBGFGE C L I F E CG2F9E )AG9E 9 9F A J9 C 9 Framework Tools PROJECT ONE )
  • 9. Procedure Overview Natural Language Processing . ( (- ( . .( 3) 3 . - 1 1 (1 (1 9 (( 3) 9 9 1 1 9 A ) Image Captioning / API Search . . - ) . , (- .3 - ) ( 3 3 . , ( - 3) . , - ( Neural Style Transfer ) 3 ( 3 3 3) . , .3, 9 9 9 (1 (1 9 (( 3) .3 ) ) Graphics Interface / Webpage , - . ( . 3 .3 , 3) ( 3 3. 3 (( PROJECT ONE )91 1
  • 10. Step 1 - NLP )/AB / / B/ / , / ) B / ,A / / A / . / A / / E A A >B , >B ( / / B A /A A B A/ / / A A A / B / A A A / A A / B / A A / A A / A B A A / )) / , ( )) / )) / A/ A A A A /A B / G , ( / B / A A B A A / A / A A EA / A/ A A /A B /A /A Γu A /A Γf / BA BA /A Γo , ( B A / / ML Code: https://github.com/Curiouskid0423/Poetic_Dream PROJECT ONE
  • 11. - - - - - / - - / - B - - / -/ . - - - - B - -. -/ - - - - .- . - - - / / / - -B D / / . / - PROJECT ONE &
  • 12. - E E . CC: / ( : - E / I 0 C ) : 1 C : CE : : : : CE : : C C : :5 : C C:5 : C AE L EC: : 5: :5E G 5C ,I 5 : C CE 5 C : : GC C : 5 5 C : 5 C 5 C PROJECT ONE
  • 13. A ) A> - A A - .A A A A / >A A : A A> A A >A >E A E I> A E A> ( > A I > > > A I > >A > A A I > > E ’ A > A E > > : “ ( ) ” G A A E A A > >A K > > A ) A A A I > ) > > A A A > E > > G A > , ( >A > PROJECT ONE
  • 14. ,1 C 1 1 C1 ( 1 . 1 , C 1 . F / 1 1 ( 1 0 1 / 1 1 F 1 1: 1 ./ 1 C 1 1 1 1 F ( E 1 1 1 F 1 1 1 C 1 F 1 1 1 ) 1 E 1 1 PROJECT ONE
  • 15. / / / (/ / / ( / ) / / / / / / / / / / / / / / / / / PROJECT ONE
  • 16. Step 2 – IMG Search D DA D . G D C AE! D C D D D D G E - C - EH C E AE D E D C C C G E AE D E E D E C B C D E E A E E E H E G DD E ! ) H G C D E C A CEI C CI DE C E D AE C D ED E’D H I E D A CE E ! ! C - E C , .C DD / C - C /EI C D C (C A E C A PROJECT ONE
  • 17. Step 3 - NST ( / / / / / . . / ) , , / . / . / , , . / , / / / , . / / , / / . ML Code: https://github.com/Curiouskid0423/Poetic_Dream PROJECT ONE
  • 18. E 9E 9 5 CC 9 9 . 5 9 E . / C ) 5 5 2 9 E 5 I 9 C 6 5 5E Jcontent & Jstyle 5 5E C (E 5 G 9 6 66 / C5 E I 6 6 6 1)) C 6 ) C’ 6 / C G G F 9 C 6 C ) 9 E6 ) 0 F 5 5 5 6 C 9 Jcontent & Jstyle PROJECT ONE
  • 19. / / / / / / / / J. >> Style Image Credit: MYSTERIOUS RAIN PRINCESS —By Leonid Afremov PROJECT ONE /
  • 20. Step 4 - GUI Design / -/ / / - / / / / - / -/ / / / / / ./ --/ / / / /. / / -- - / / - / - / . . . / / ./ / / . / / PROJECT ONE
  • 21. Page 2 Page 1 ( . (., , , , ( , . ( , , , , , , , , . , (., A , , , , , ( ( ( , , ( ( , , , , ( ( , . , , ( ( ( ( , , , , , ), , ( , , , ( ( ( , ) ( ,
  • 22. Page 4 Page 3 . . . ( . . ( . . . , . . . ., . . . ., . ., . . , . .. . ( . . . , . . . ) . . . . . . , . . . . . . . ., . . , , . , .
  • 23. 2 + 0 2 ) 0 1 0 40 . 0 . 0 . 0 1 40 . 0 0 . 0 (02 0 + 0 . 0 0 Other artworks displayed in my Creative Writing Portfolio PROJECT ONE
  • 24. + . 5 1 0 .5 0 5 1 0 0 5 .35 . 5 0 . 4 0 ) 5 5 + +4 . -. (. . 5 Other artworks displayed in my Creative Writing Portfolio PROJECT ONE
  • 25. A ) A B B B B A ( A A + A B B B B A , ) C A Other artworks displayed in my Creative Writing Portfolio PROJECT ONE
  • 26. E A E A A A A AE A A A A A E A A A E AE A - . ! ) A A , ) A AE! , ( ) E A E A ( , A A A A E A E A E C ! , E A A C A A A A A A A C A A A A A A A A C E “ ” A A A ! PROJECT ONE ML Code: https://github.com/Curiouskid0423/Poetic_Dream
  • 27. E8D )J 8D 8A 8 1IB A DB 8 8 DB 8 8A E A A: 8D 8 G A: IB 8D8A :BD E DB E’s A ,B AEBA’E 8D D8E 8 8 DB 8 8 .01 B 8 I BD8 8J 5 5G E BI8D B G BA AG 8E BA B D8A 8D J D IBD 8 8 E 88 B .01 E B 58 8A A 8 BD 58 8D GE8D 8J 8D 8A 8 D8 E BA B .- 1 8 D8 E8A8EE B E 8 8A 8 & EB 8 8E EG 8DE DB 8 BI B G BA BI8D BD EG 8A D A A: A E8 E 8 8EE B EB B A 8D D8 B8 EG D L BA BD 8 IBD 8J D BA E DB5 5 D DB 8 58E EB G BA I BA AG8 D8E8 D BA 8E8 EEG8E A B 8:8 Data Limitation Computational cost A D8 8 IB A DB5 8 E B .- A .01 EG 8DE DB 8 B G BA 8J 8AE8 5G E8 EEG8E 8 .- 8 8A BD8 8A: A: 8 BG E8 B 8 8 B A 8D 8J 8AE 8 E8 D 8E 8D D D A A: E8 .- A 8D GD8 D8E8 D E : : A 8 8 E E A E :8 A GE A B B L8 8 DB:D I BIA 58 8 8D GD8 E8 A 8 G GD8 BD BD8 E E BD D8EG E ) D A GD8 B (88 -8 DA A: E E A E :8 B D8E8 D A B 8 B G5 E B 8 G5 B DB B 8 8 8 B 8 AB B: A: 8 A 8 B G A 8E 8 EG 8DE DB 8 : 8 D A GD8 B 88 8 DA A: EB 8 A: 58 8 8 A 58 D8EB 8 5 8 DA A: DB A GD8 BI 5 B B: A AE D8 :BD D 8 GD8 A D8 A 8A B D8E8 D A B 8:8 PROJECT ONE ML Code: https://github.com/Curiouskid0423/Poetic_Dream
  • 28. Poetry Imagery Visualizer Poetic Dream 12th grade self-directed project ML Code: https://github.com/Curiouskid0423/Poetic_Dream