Data Engineering Study #14 - Modern Data Stackç¹é
ã€ãã³ãå 容
éå»ã® Data Engineering Study ã®ã¢ãŒã«ã€ãã¯ãã¡ããããèŠèŽããã ããŸãã
éå¬å 容
æŠèŠ
æ¬ã€ãã³ãã¯ãInfra Study Meetup ãéå¶ãã Forkwell ãšãåæåºç€åãããŒã¿çµ±åSaaSãtroccoãã®éçºã»éå¶ãè¡ã primeNumber ã«ããå
±å¬ã€ãã³ãã§ããããŒã¿åæã«ç²Ÿéããè¬åž«ããæãããããŒã¿åæåºç€ã®ããããŸã§ããšãããããããåŠã¶ããšãè¶£æšãšããŠéå¬ããããŸãã
ããããæ°ïŒ@yuzutas0ïŒã«ã¢ãã¬ãŒã¿ãŒãäŸé Œããè€æ°åã«ããã£ãŠãååããŒãã«æ²¿ã£ãå
容ã§ååéã§ã掻èºãããŠãããšã³ãžãã¢ïŒç ç©¶è
ã«è¬æŒããã ããŸãã
éå¬èæ¯
Forkwell ããã®ã³ã¡ã³ã
æ¬ã€ãã³ãã¯ãInfra Study Meetup ã«æ³šç®ããŠããã ãã primeNumber ããŸããã®ã声ããã§å®çŸããã€ãã³ãã§ããInfra Study Meetup ãšã¯äž»å¬ããå£äœãæ±ãããŒããç°ãªãããšãããå¥ã·ãªãŒãºãšããŠç«ã¡äžããŸãããInfra Study åå è ãšå ±ã«åŸãã€ãã³ãããŠããŠãç¶æ¿ããããŒã¿åæé åã§ãåŠã³ã®å ŽãäœããŸãã
æ¬å®¶ Infra Study ã«ãåå ããã ããæ¹ã¯ãã¡ãããããŒã¿åæã«é¢å¿ã®ããæ¹ãªãã©ãªãã§ãåå å¯èœã§ãããšã³ãžãã¢ãªã³ã°ãšå¯æ¥ã«é¢ããããŒã¿åæé åã«ã€ããŠæ¥œããåŠãã§ããã ããŸããã幞ãã§ãã
Forkwell äºæ¥è²¬ä»»è èµ€å·
primeNumber ããã®ã³ã¡ã³ã
åŒç€Ÿã¯ããŒã¿åæåºç€åãã®ç·åæ¯æŽãµãŒãã¹ãtroccoããéå¶ããŠããã®ã§ããããã®äžã§ãã©ãããåæåºç€ãäœã£ãŠããã°ããã®ãïŒããšããã質åããã䌺ããŸãããã®ãããªæ¹åãã«äœãæçãªæ å ±ããæäŸã§ããå Žã¯ãªãããšèããæã«ãæ¬ã€ãã³ãã®éå¬ãæãã€ããŸããã
ãããªã¿ã€ãã³ã°ã§ããInfra Study Meetupããšããåé¿ã倧ããã€ãã³ããããã®ãèŠã€ãããããŒã¿åæåºç€ãçãäœããŸããããšã声ããããæããéå¬ã«è³ããŸããã
ããããåæåºç€ãäœãããšãããŠããæ¹ããçŸåšéçšäžã®åºç€ã®æ¹åã¢ã€ãã¢ãæ¢ããŠããæ¹ã«ãæçãªå Žã«åºæ¥ãã°ãšæã£ãŠãããŸãã
primeNumber åç· åœ¹å·è¡åœ¹å¡CPO å°æå¯å
ãããªãšã³ãžãã¢ã«ãããã
- ããŒã¿åæã«é¢ããäºäŸãç¥ãããæ¹
- èªç€Ÿå ã«ããŒã¿åæåºç€ãäœãããšæ€èšäžã®æ¹
- èªç€Ÿã®ããŒã¿åæåºç€ãããå¹ççã«ããããšèããŠããæ¹
- ããŒã¿åæé åã«å¹ ãåºããŠã¿ãããœãããŠã§ã¢ãšã³ãžãã¢ã»ã€ã³ãã©ãšã³ãžãã¢
ããã°ã©ã 第14åãModern Data Stackç¹éã
çæ§ã¯ãModern Data Stackããšããèšèããåç¥ã§ããããïŒ Data Engineering Study第1åã§ã¯ãããŒã¿åæåºç€å šäœã®ã¢ãŒããã¯ãã£ã»ãã¹ããã©ã¯ãã£ã¹ã«ã€ããŠåŠã³ãŸããã ãããã2å¹Žã®ææ¥ãçµã¡ãåšèŸºã®æè¡ãç®ãŸããããå€åããŠããŸãã ãModern Data Stackãã§æå±ãããŠããææ°ãã¬ã³ããããšã«ã2022幎çã®ãã¹ããã©ã¯ãã£ã¹ãåŠãã§ãããŸãããã
åºèª¿è¬æŒãOverview of The Modern Data Stack / ã¢ãã³ããŒã¿ã¹ã¿ãã¯æŠè«ã
ãå»£ç¬æºå²æ°ïŒ@satoshihiroseïŒ
Senior Customer Reliability Engineer, Treasure Data
âçºè¡šå 容
ã¢ãã³ããŒã¿ã¹ã¿ãã¯ã«ã€ããŠããã®æŠèŠãšç¹ã«è©±é¡ã«äžãããããã¯ã«ã€ããŠç޹ä»ããŸãã
座è«äŒ
ã¢ãã¬ãŒã¿ãŒ
ããããã æ°
Data Engineering Study ã¢ãã¬ãŒã¿ãŒ
ãããªã¹ã
ãé·è°·å· äºç€º æ°
æ ªåŒäŒç€Ÿãã£ãŒã»ãšãã»ãšãŒ ããŒã¿ãšã³ãžãã¢
ãå°æ å¯å
æ ªåŒäŒç€ŸprimeNumber åç· åœ¹å·è¡åœ¹å¡CPO
ãå»£ç¬æºå²æ°ïŒ@satoshihiroseïŒ
Senior Customer Reliability Engineer, Treasure Data
ã¿ã€ã ã¹ã±ãžã¥ãŒã«
| æé | å 容 | çºè¡šè |
|---|---|---|
| 15:00ã | åžäŒããæšæ¶ïŒ10åïŒ | primeNumber å°æ å¯å æ° |
| 15:10ã | åºèª¿è¬æŒïŒ30åïŒãOverview of The Modern Data Stack / ã¢ãã³ããŒã¿ã¹ã¿ãã¯æŠè«ã | Senior Customer Reliability Engineer, Treasure Data å»£ç¬ æºå²æ° |
| 15:40ã | 質çå¿çïŒ10åïŒ | |
| 15:45ã | ã¹ãã³ãµãŒã»ãã·ã§ã³ïŒ5åïŒ | Forkwell |
| 15:50ã | äŒæ©ïŒ5åïŒ | |
| 15:55ã | 座è«äŒïŒ30åïŒ | ã¢ãã¬ãŒã¿ãŒïŒããããæ° ãããªã¹ãïŒå»£ç¬ æºå²æ° primeNumber å°æ å¯å æ° æ ªåŒäŒç€Ÿãã£ãŒã»ãšãã»ãšãŒ ããŒã¿ãšã³ãžã㢠é·è°·å· äºç€ºæ° |
| 16:25ã | ã¹ãã³ãµãŒLTïŒ5åïŒ | primeNumber å°æ å¯å æ° |
| 16:30ã | ã¢ãã¿ãŒããŒã¯ïŒ10åïŒ | |
| 16:55 | å®å šçµäº |
â» ã¿ã€ã ã¹ã±ãžã¥ãŒã«ã¯ç®å®ã§ããå®å
šè§£æ£16:55ãŸã§ã®éã§ãããåå è
ã«ãæºè¶³ããã ãã圢ã§åã³ã³ãã³ãæéã調æŽãããå ŽåãããããŸãã
â» ããã°ã©ã ã¯å€æŽãšãªãå¯èœæ§ããããŸããéæãã¡ãã§æŽæ°ããããŸãã
ãããŸã§ã®å匷äŒã§æ±ã£ãããŒããšã¢ãŒã«ã€ãåç»
- 2020/07/15ïŒæ°ŽïŒïœç¬¬1åãã¢ãã³ãªDWH/BIããŒã«ã®éžã³æ¹ãšãå®éã®éçšäºäŸã
- 2020/08/19ïŒæ°ŽïŒïœç¬¬2åãããŒã¿åéåºç€ãšããŒã¿æŽåã®ãããŸã§ãšããããã
- 2020/09/16ïŒæ°ŽïŒïœç¬¬3åãåæåºç€ãããŸãçµç¹ã«æµžéãããæ¹æ³ã
- 2020/11/04ïŒæ°ŽïŒïœç¬¬4åãããŒã¿åæåºç€ã®é害察å¿äºäŸLTç¥ãã
- 2020/12/02ïŒæ°ŽïŒïœç¬¬5åãåã®Snowflake Deep Dive / åœå äºäŸã»ä»DWHãšã®æ¯èŒã
- 2021/02/03ïŒæ°ŽïŒïœç¬¬6åãæ¹ããŠåŠã¶ãBigQuery培åºå ¥éã
- 2021/04/06ïŒç«ïŒïœç¬¬7åãRedshiftææ°ã¢ããããŒããšæŽ»çšäºäŸã
- 2021/06/02ïŒæ°ŽïŒïœç¬¬8åãBIããŒã«ç¹éïŒOSSã»åçšã®äžæã䜿ãåãã
- 2021/08/03ïŒç«ïŒïœç¬¬9åãäŒæ¥èŠæš¡å¥ããŒã¿ãšã³ãžãã¢çµç¹ã®äœãæ¹ã
- 2021/10/06ïŒæ°ŽïŒïœç¬¬10åãçéBIããŒã«ç¹é Tableau / PowerBI / GoogleããŒã¿ããŒã¿ã«ã
- 2021/12/13ïŒæïŒïœç¬¬11åã6瀟ã®ããŒã¿ãšã³ãžãã¢ãæ¯ãè¿ã2021ã
- 2022/02/09ïŒæ°ŽïŒïœç¬¬12åããšã³ãžãã¢ã®ããã®ãããŒã¿å¯èŠåãå ¥éã
- 2022/04/06ïŒæ°ŽïŒïœç¬¬13åãELTã»ããŒã¿ã¢ããªã³ã°ããŒã«ç¹éåã
åå æ¹æ³
ä»åã®ãªã³ã©ã€ã³å匷äŒã¯ YouTube Live ã䜿çšããŠã©ã€ãé
ä¿¡ããããŸãã
ãŸããã³ã¡ã³ããææ³ãè¬æŒå
容ã«é¢ãã質å㯠Twitter ãžãé¡ãããããŸãã
ã©ã€ãé
ä¿¡çµäºåŸãã¢ãŒã«ã€ãåç»ã®å
¬éãäºå®ããŠãããŸãã
åœæ¥ã®é嬿éã«ã©ã€ãåå ã§ããªãæ¹ãããã¡ãã®ããŒãžããåå ç³èŸŒã¿ã®äžãã¢ãŒã«ã€ãåç»ããèŠèŽããã ããŸãã
ãªããTwitterã¿ã€ã ã©ã€ã³ãšé£åãããªã¢ã«ã¿ã€ã ãªã€ãã³ãåå äœéšãéèŠãããããYouTube Liveã®è¿œãããåçã¯ã§ããªãèšå®ãšãªããŸãããšããäºæ¿ãã ãããŸãã é ä¿¡äžã®ããã°ã©ã ããã®èŠèŽããããã¯ã©ã€ãé ä¿¡çµäºæ°æéåŸããåçå¯èœã«ãªãã¢ãŒã«ã€ãåç»ããèŠèŽãã ããã
çæäºé
- ForkwellãprimeNumber ã®å®£äŒããããŠããã ãæéãããããŸããäºããäºæ¿ãã ããã
- ITæè¡è ã®æ¹ã察象ãšããã€ãã³ãã®ãããéãšã³ãžãã¢ã®æ¹ã®ãåå ããªãã³ã«åæ¥ã«å±ããæ¹ã®åœã€ãã³ãå ã§ã®ãªã¯ã«ãŒãã£ã³ã°æŽ»åã«ã€ããŸããŠãé æ ®ããã ããŠãããŸãã
- ã€ãã³ãã®é¢šæ¯ããForkwellã¡ãã£ã¢äžã®èšäºïŒã€ãã³ãã¬ããŒãïŒã«æ²èŒããããšãããããŸããæ²èŒãåžæãããªãæ¹ã¯ãåœæ¥Zoomãã£ãããŸãã¯ã€ãã³ãããŒãžåãåãããã©ãŒã ãããæ²èŒåžæãããªãæšããäŒããã ããã
- ã€ãã³ãåå æã«ãå ¥åããã ããæ å ±ã¯ã次ã®ãã©ã€ãã·ãŒããªã·ãŒã«åºã¥ããprimeNumber ã®ã¿ã§é©åã«æ±ããŸãã https://primenumber.co.jp/privacy/
ãŸãããåå è ã®æ¹ã ãæå€§é楜ããã§é ãããããéå¶ãµã€ãã§åå ã«ãµãããããªããšå€æãããŠé ããæ¹ã«ã€ããŠã¯ãã€ãã³ãäžã§ããããšãéåžããé¡ãããããšãããããŸãã
- ä¿éºã宿ããããã¯ãŒã¯ããžãã¹ã®å§èªãç®çãšèŠãããæ¹
- ãã®ä»éå¶ãµã€ãã§åå ãäžé©åã ãšå€æããæ¹ èª ã«æãå ¥ããŸãããããããããäºæ¿ãã ãããŸãã
äž»å¬ã»åå
äž»å¬ïŒã³ãã¥ããã£æ¯æŽåè³
ãæé·ãç¶ãããšã³ãžãã¢ãæ¯æŽããããµãŒãã¹ãéå¶ãã Forkwell
åæåºç€åãããŒã¿çµ±åSaaSãtroccoãã®éçºã»éå¶ãè¡ã primeNumber
åŸæŽ
å€©ç¥æŸé屿§ã«ã©ã€ãé
信代è¡ãšããŠååããã ããŠãããŸãã
å€©ç¥æŸéå±ã¯ã©ã€ãé
ä¿¡ãåºããããšã§ãæ©äŒæ Œå·®ããªãããããšãããã·ã§ã³ãšããã©ã€ãé
ä¿¡ãŠãããã§ãã
ã³ãã¥ããã£ã€ãã³ããå¢ãç¶ããäžãã³ã³ãã³ããç±æãã人ã«å±ããããã«æŽ»åããŠããŸãã
泚æäºé
â» ãã¡ãã®ã€ãã³ãæ å ±ã¯ãå€éšãµã€ãããååŸããæ å ±ãæ²èŒããŠããŸãã
â» æ²èŒã¿ã€ãã³ã°ãæŽæ°é »åºŠã«ãã£ãŠã¯ãæ å ±æäŸå ããŒãžã®å 容ãšå·®ç°ãçºçããŸãã®ã§äºããäºæ¿ãã ããã
â» ææ°æ å ±ã®ç¢ºèªãåå ç³èŸŒæç¶ããã€ãã³ãã«é¢ãããåãåããçã¯æ å ±æäŸå ããŒãžã«ãŠãé¡ãããŸãã

ãåãåãã
é¢é£ããã€ãã³ã
- TOP
- ã€ãã³ã
- Data Engineering Study #14 - Modern Data Stackç¹é




