Tuning GraphQL on Rails

Transcript

1. Tuning GraphQL on Rails - 10.26 ༗໌ίϩγΞϜ ిྲྀരഁσεϚον -

2. ࢁԼ
   ࿨඙
   
   !QZBNB
   (.0ϖύϘ
   ٕज़ج൫νʔϜ
   
   
   γχΞɾϓϦϯγύϧ
   
   
   ɹΩϟϯϓɺཱྀߦɺώϧτϯ८ΓɺεϚϒϥ
   
   
   
   
   
   ػցֶशɺ$*$%

3. Kaigi on Rails 2024 ࠷ߴͰ͢!!1

4. ࠓ೔࿩͢͜ͱ 1. ݱ৔঺հ 2. ൃੜ͍ͯͨ͠՝୊ 3. ͲͷΑ͏ʹղܾ͔ͨ͠ 4. ࣮ફN+1ղফ 5.

   ೔ʑͷӡ༻ 6. զ͕Ոʹ͓͚Δચ୕पظͷ໰୊Λ͍͔ʹղܾ͔ͨ͠

5. ίʔυαϯϓϧʹ͍ͭͯ • ձ৔ͰͷΈ΍͢͞Λ༏ઌͯ͠ɺຊདྷඞཁͳ࣮૷Λ࡟ͬͯίʔυαϯϓϧͱ ͍ͯࣔͯ͠͠ΔՕॴ͕ଟʑ͋Γ·͢ɻ • ͦΕΒ͍͠ίʔυ͸github.com/pyama86/kaigi-on-rails-2024
 Λ֬ೝ͍ͯͩ͘͠͞ɻ

6. ݱ৔Ұے
   ೥

7. minne ϋϯυϝΠυϚʔέοταʔϏε 1. ࡞඼ൢച 2. ࡞Ոࢧԉ 3. ϝσΟΞɾ޿ࠂ

8. minneͷΞϓϦέʔγϣϯߏ੒֓ཁ browser mobile app Web UI Rails Next.js Rails API

   ϞϊϦεߏ੒ͳRails ※ਤ্͸Rails͕̎ͭ͋ΔΑ͏ʹݟ͑·͕͢ɺͦΕ͸࢒૾Ͱ͋Γɺ࣮ࡍ͸1ϦϙδτϦͰಉ͡ίʔυͰ͢ɻ WEB UIͷϨϯμϦϯάͱɺAPIͷෛՙɺτϥϑΟοΫ͕ҟͳΔͨΊɺϦιʔε෼཭͍ͯ͠·͢ɻ

9. minneͷγεςϜߏ੒֓ཁ ΦϯϓϨϛεͱAWSͷϚϧνΫϥ΢υߏ੒ on premises AWS NKE(k8s) OpenStack Web Web API

   API EKS(k8s) EC2 Batch Direct
 Connect RDS Elastic xxx ѹ౗తͳ௿ίετ͕ͩɺ ϓϥοτϑΥʔϜͷ؅ཧίετ͕͋Δ ίετ͸ֻ͔Δ͕ɺσʔλετΞͷ ϚωʔδυɾαʔϏεͳͲӡ༻ෛՙܰݮ Web API

10. ൃੜ͍ͯͨ͠
    ՝୊

11. ૿͑ଓ͚ΔVM ΦϯϓϨϛε: 120VM(16vCPU/32GB Memory) AWS: 20ʙ80VM※(8vCPU/16G Memory) ※AWS͸ϐʔΫλΠϜʹΦϯϓϨϛεͷτϥϑΟοΫΛΦϑϩʔυ͓ͯ͠Γɺ
 ΦʔτεέʔϧʹΑͬͯ୆਺͕૿ݮ͢Δ ෛՙ͕ߴ͍ˠͱΓ͋͑ͣVM૿΍͢ͷ࿈࠯

12. https:// fi nance.yahoo.co.jpΑΓҾ༻ ݮΓଓ͚Δۚ Կ΋ͯ͠ͳ͍ͷʹ རӹݮͬͨΜͰ͚͢Ͳɾɾɾʁ

13. ???????????????????????????

14. !?!?!?!?!?!?!?!?!?!?!?!?!?!?!?!?!?

15. ͍ͭ͜ɺN+5000͡ΌͶ͔͐ʂʂʂ

16. ͲͷΑ͏ʹ
    վળ͔ͨ͠

17. ͲͷΑ͏ʹվળ͔ͨ͠ʁ query { orders { id customer { name }

    } } select * from orders; select * from customers where customers_id = 1; select * from customers where customers_id = 2; select * from customers where customers_id = 3; … select * from customers where customers_id = 5000; GraphQLͰΑ͋͘ΔN+1ͳΫΤϦ

18. ͲͷΑ͏ʹվળ͔ͨ͠ʁ • lookaheadΛར༻͢Δ • όονϩʔυΛར༻͢Δ • Shopify/graphql-batch • GraphQL::Dataloader select

    * from orders; select * from … where customers_id in(1, 2…5000);

19. lookaheadΛར༻ͨ͠ઌಡΈ lookahead͕γϯϓϧʹॻ͚Δ

20. HSBQIRMCBUDI

21. promise.rb RubyͷPromises/A+४ڌͷϥΠϒϥϦ https://github.com/lgierth/promise.rb thenʹ౉͞ΕͨϒϩοΫ͕஗Ԇ࣮ߦ͞ΕΔ

22. select * from orders; select * from customers where customers_id

    = 1; select * from customers where customers_id = 2; select * from customers where customers_id = 3; … select * from customers where customers_id = 5000; Ͳ͜Λ஗Ԇ࣮ߦͤ͞Δ͔ʁ ID͚ͩઌʹूΊͱ͍ͯɺ ΫΤϦ͸͋ͱ͔Β஗Ԇ࣮ߦͯ͠ ·ͱΊͯ౤͍͛ͨ

23. https://github.com/Shopify/graphql-batch/blob/main/examples/association_loader.rb customer_idΛΩϡʔʹ௥Ճͯ͠ɺ PromiseΛฦ٫ queue = [1, 2, 3, 4 …

    5000]

24. Promise.sync=Promiseͷ࣮ߦ query { orders { id customer { name }

    } } ্͔Βॱ൪ʹઙ͍ॱʹPromise.sync͕ίʔϧ͞ΕΔ 1. Ordersͷϓϩϛε͕࣮ߦ͞ΕΔ 2. Customerͷϓϩϛε͕ ࣮ߦ͞ΕΔ

25. Promise.sync 1.recordsʹ͸loadͰ queueʹཷ·͍ͬͯͨ஋͕౉Δɻ ஗Ԇ࣮ߦର৅ͷϨίʔυΛ ·ͱΊͯpreload 2.Ϩίʔυ͝ͱʹ݁ՌΛ ෼ׂͯ͠ຒΊࠐΉ

26. in۟ʹ5000΋Ҿ਺౉͢ͳ͸ॾઆ͋Δ select * from orders; select * from … where

    customers_id in(1, 2…5000); ActiveRecord::Associations::PreloaderͰ in۟ʹ·ͱΊΒΕΔ

27. ࣮ફ/ ղফ

28. Πϯελϯεϝιου query { orders { id customer { name isLoyal

    } } } select 1 As one from sales where customers_id = 1; select 1 As one from sales where customers_id = 2; select 1 As one from sales where customers_id = 3; … ഁ໓ϩυϦήεʂʂʂʂʂ

29. Πϯελϯεϝιου զʑʹ͸஗Ԇ࣮ߦ͕͋Δ͡Όͳ͍͔

30. ଠ٬͕ա͗Δ

31. LoaderΛॻ͘ REST API͔ΒͷҠߦ࣌ͳͲ طଘͷϝιου͸ खΛೖΕͮΒ͍

32. LoaderΛॻ͘ customer_id ͝ͱʹɺsalesͰιʔτͨ݁͠Ռͷ ্͔Βॱʹ1,2,3…ͷΑ͏ʹ൪߸Λ;Δ existsʁͷ൑ఆΛ͍ͨ͠ͷͰɺcustomer_id͋ͨΓ 1͚݅ͩऔΕ͹OK

33. LoaderΛॻ͘ ΫΤϦͷ݁ՌΛPromiseͷ໭Γ஋ʹઃఆ

34. LoaderͷϝϦοτɾσϝϦοτ 1. LoaderͰεοΩϦ͔͚Δ 2. Loaderཚཱ͢ΔͱLoaderʹϏδωε ϩδοΫ͕ຒΊࠐ·ΕͯɺϞσϧͱ
 ࠩҟ͕ੜ·ΕΔ͜ͱ͕͋Γɺ
 όάͷԹচͱͳΓ͑Δ

35. ύϑΥʔϚϯεͷ໰୊ͷ୳͠ํ APMΛ࢖͏ͷ͕͓͢͢Ί

36. ύϑΥʔϚϯεͷ໰୊ͷ୳͠ํ query { orders { id customer { name isLoyal

    } } } ΫΤϦͷਂ͕͞ઙ͍ॱʹΫΤϦ͕࣮ߦ͞ΕΔ

37. ύϑΥʔϚϯεͷ໰୊ͷ୳͠ํ APMͷεύϯΛ෼͚ΔͱɺΑΓ୳͠΍͍͢

38. ࣮੷঺հ ΦϯϓϨϛε: 120VM -> 30VM AWS: 20ʙ80VM -> 20VM(εέʔϧΞ΢τ͕ෆཁʹͳͬͨ) minneʹ͓͍ͯ͸ύϑΥʔϚϯε͕޲্

39. ϝτϦΫε΋େ෯ʹվળ ΤϯυϙΠϯτͷϨΠςϯγɺDBͷCPU࢖༻཰͕վળ

40. ೔ʑͷӡ༻

41. ͳΜͰͳΜʁʁʁ ਆ͕͔ͬͨνϡʔχϯά ೔ʑগͮͭ͠αʔϏε͸஗͘ͳΔ

42. ೔ʑαʔϏε͸ॱௐʹ੒௕ɺ ͓٬ͷসإͰ͞ΒͳΔඈ༂Λ໨ඪ • minne޿ࠂ • ಈըίϯςϯπ • minne PLUS https://tech.pepabo.com/2024/08/05/minne-movie/

    ৽ػೳ͕૿͑Δ=৽͍͠ΫΤϦ͕૿͑Δ

43. SLIͱSLO SLI = Service Level Indicator αʔϏεϨϕϧࢦඪ SLO = Service

    Level Objective αʔϏεϨϕϧ໨ඪ GraphQLͷϨΠςϯγΛSLIʹઃఆ

44. SLIͱSLOͷܾΊํ αʔϏεͷKPI͔ΒϒϨΠΫμ΢ϯܾͯ͠ΊΔ minneʹ͓͚ΔΧʔτΠϯͱϨεϙϯελΠϜͷ૬ؔ ੺͍఺=ΧʔτΠϯ ੨͍఺=཭୤

45. ϞχλϦϯάख๏ • SaaS(Datadog/New Relic/Sentry) • OpenTelemetry with Grafana Stack ͍ΘΏΔAPMͰՄ؍ଌੑΛ্͛Δͷ͕ྑ͍

46. OpenTelemetry چདྷɺ4BB4΍044͝ͱʹ࣮૷͞Ε͍ͯͨςϨϝτϦσʔλͷඪ४Խ IUUQTDMPVEOBUJWFEBZTKQPZ https://opentelemetry.connpass.com/

47. OpenTelemetry https://opentelemetry.io/docs/ ֤ݴޠͷSDK΍ ࣗಈܭ૷ɺखಈܭ૷ ΍ϛυϧ΢ΣΞ͔Β ςϨϝτϦσʔλΛ ग़ྗ

48. OpenTelemetry https://opentelemetry.io/docs/ ඪ४Խ͞Εͨϓϩτίϧʹ ରԠͨ͠ΤʔδΣϯτ

49. OpenTelemetry https://opentelemetry.io/docs/ 4BB4΍
    ϗετ͞Εͨ044
    ࠩ͠ସ͑Մೳ

50. μογϡϘʔυ ͖͍͠஋؂ࢹ & ຖिΈΜͳͰோΊΔ • ϦϦʔεʹىҼͨ͠ϨεϙϯεѱԽ • αʔϏεͷ݈શੑͷ೴಺ಉظ

51. ࠓ೔࿩ͨ͜͠ͱ • N+1ͷ໰୊͸graphql-batchͷAssociation Loader΋͘͠͸ GraphQL::DataLoaderͷͦΕʹ४͡Δ࣮૷Ͱ͍͍ͩͨย෇͘ • ҆қʹઌಡΈ͢ΔͱɺϨίʔυ਺ͷଟ͍ςʔϒϧΛେྔʹϩʔυͯ͠͠· ͏͜ͱ͕͋ΔͷͰͦ͏͍͏έʔεͰ͸ࣗ࡞ͷLoaderΛॻ͘ • LoaderΛཚཱ͢ΔͱɺϞσϧͱͷ࣮૷ࠩҟ͕ੜ·ΕΔ͜ͱ΋͋ΔͷͰɺҰ

    ؏ੑΛ࣮࣋ͭ૷ʹ͢Δ • ೔ʑͷϞχλϦϯάͰύϑΥʔϚϯεͷྼԽʹରॲ͢Δ

52. ਓྨͷΞ΢τϓοτΛ૿΍͠·͠ΐ͏ ࠷৽ͷ࠾༻৘ใΛνΣοΫˠ !QC@SFDSVJU