Data Engineering Study #16ãããŒã¿ã«ã¿ãã°å ¥éã
ã€ãã³ãå 容
éå»ã® Data Engineering Study ã®ã¢ãŒã«ã€ãã¯ãã¡ããããèŠèŽããã ããŸãã
éå¬å 容
æŠèŠ
æ¬ã€ãã³ãã¯ãInfra Study Meetup ãéå¶ãã Forkwell ãšãåæåºç€åãããŒã¿çµ±åSaaSãtroccoãã®éçºã»éå¶ãè¡ã primeNumber ã«ããå
±å¬ã€ãã³ãã§ããããŒã¿åæã«ç²Ÿéããè¬åž«ããæãããããŒã¿åæåºç€ã®ããããŸã§ããšãããããããåŠã¶ããšãè¶£æšãšããŠéå¬ããããŸãã
ããããæ°ïŒ@yuzutas0ïŒã«ã¢ãã¬ãŒã¿ãŒãäŸé Œããè€æ°åã«ããã£ãŠãååããŒãã«æ²¿ã£ãå
容ã§ååéã§ã掻èºãããŠãããšã³ãžãã¢ïŒç ç©¶è
ã«è¬æŒããã ããŸãã
第16åãããŒã¿ã«ã¿ãã°ç¹éåã
第14åã®Modern Data Stackã§ã¯ãæ§ã ãªææ°ã®æè¡ã¹ã¿ãã¯ã玹ä»ãããŸãããä»åã®å匷äŒã§ã¯ããã®äžã®1ã€ã§ãããããŒã¿ã«ã¿ãã°ãã«ã€ããŠæ·±æãããŠåŠãã§ãããŸãã ããŒã¿ã«ã¿ãã°ãšã¯ãããŒã¿åæåºç€ã«ååšããæ§ã ãªå®ããŒã¿ãã«ã¿ãã°åããæ€çŽ¢ã»åç §ãå¯èœã«ãããã®ã§ãããŸããåçš®ã¡ã¿ããŒã¿ãçŽä»ããããšã«ãã£ãŠããŒã¿ã®çè§£ãä¿é²ããããã®ä»çµã¿ã§ãã å®éã«ããŒã¿ã«ã¿ãã°ãéçšãããŠããäŒæ¥ã®ãæ åœè ããåŒã³ããäºäŸãã話ãããã ããŸãã
è¬æŒãLINEã®Data Platformã«ãããããŒã¿å©æŽ»çšãä¿é²ããããã®Data Catalogã®éçºã
å³¶æ ä¿¡å£ æ°ïŒ@islandshinjiïŒ
LINEæ ªåŒäŒç€Ÿ Data Platform宀 IU DevããŒã ãœãããŠã§ã¢ãšã³ãžãã¢
âçºè¡šå 容
LINE瀟ã¯ã°ããŒãã«ã§çŽ2åMAUãæã€ã³ãã¥ãã±ãŒã·ã§ã³ã¢ããªãã¯ãããšãã倿°ãµãŒãã¹ãå±éããŠããŸãããã®å€æ°ã®ãµãŒãã¹ããçæãããããŒã¿ã«ã¯ã倿§ãªæŽ»çšããŒãºãååšããŸãã ç§ãã¡ã¯ããã®å€æ§ãªããŒãºã«å¿ããããã«ãData Catalogãå 補ããŸããã æ¬çºè¡šã§ã¯ãData Lienageãäžå¿ãšããæäŸæ©èœã§ã©ã®ããã«ãŠãŒã¶ãŒã®ããŒã¿çè§£ãä¿é²ããæ¥åæ¹åãå®çŸãããã玹ä»ããŸãã
è¬æŒãZOZOã®ããŒã¿ã«ã¿ãã°å 補äºäŸãšãããŒã¿ã«ã¿ãã°ãæŽãç¶ããããã®ä»çµã¿ã¥ããã«ã€ããŠã
(https://imgur.com/hxZkP1z)
å±±æ¬ å¥å€ª æ°ïŒ@yamamoto7ïŒ
æ ªåŒäŒç€ŸZOZO ZOZOTOWNéçºæ¬éšã»ããã¯ãšã³ã1ãããã¯
âçºè¡šå 容
ZOZOã§ã¯èšå€§ãªããŒã¿ãä¿æããŠããããããŒã¿ããŒã¹ã«é¢ããè³æãããŸãæŽã£ãŠããŸããã§ãããããã§ãã«ã¿ãã°ã·ã¹ãã ãå 補ããŸãããæ¢åããŒã«ãå©çšããªãã£ãçç±ãã·ã¹ãã ã«çµã¿èŸŒãã ããžãã¯ã掻çšäºäŸãããŒã¿ã«ã¿ãã°ãæŽãç¶ããããã®åãçµã¿ã«ã€ããŠç޹ä»ãããŠããã ããŸãã
è¬æŒãã¡ã¿ããŒã¿ã¯å°å³ã ã圹ã«ç«ã€ã
å
è€ çŽ æ°ïŒ@jonnojunïŒ
atama plusæ ªåŒäŒç€Ÿ ããŒã¿ãµã€ãšã³ãã£ã¹ã
âçºè¡šå 容
atama plusæ ªåŒäŒç€Ÿã§ã¯æè¿ã¡ã¿ããŒã¿ç®¡çåºç€ãæ£åŒã«å°å ¥ããŸãããããŒã¿ãšã³ãžãã¢ãäžåšã®äžã§ãã©ã®ãããªèª²é¡æèããå°å ¥ãæææ±ºå®ããã©ã®ããã«æ®åãããã®ãããŸãçµæãšããŠã©ãã®ãããªå¹æããã£ãã®ãããå ·äœçãªäºäŸãšããŠç޹ä»ããŸãã
ã¿ã€ã ã¹ã±ãžã¥ãŒã«ïŒç®å®ïŒ
| æé | å 容 | çºè¡šè |
|---|---|---|
| 18:00ã | åžäŒããæšæ¶ïŒ10åïŒ | primeNumber å°æ å¯å æ° |
| 18:10ã | è¬æŒïŒ20åïŒ ãLINEã®Data Platformã«ãããããŒã¿å©æŽ»çšãä¿é²ããããã®Data Catalogã®éçºã | LINEæ ªåŒäŒç€Ÿ å³¶æ ä¿¡å£ æ° |
| 18:30ã | ã¹ãã³ãµãŒLTïŒ5åïŒ | Forkwell |
| 18:35ã | äŒæ©ïŒ5åïŒ | |
| 18:40ã | è¬æŒïŒ20åïŒ ãZOZOã®ããŒã¿ã«ã¿ãã°å 補äºäŸãšãããŒã¿ã«ã¿ãã°ãæŽãç¶ããããã®ä»çµã¿ã¥ããã«ã€ããŠã | æ ªåŒäŒç€ŸZOZO å±±æ¬ å¥å€ª æ° |
| 19:00ã | ã¹ãã³ãµãŒLTïŒ5åïŒ | primeNumber å°æ å¯å æ° |
| 19:05ã | äŒæ©ïŒ5åïŒ | |
| 19:10ã | è¬æŒïŒ20åïŒ ãã¡ã¿ããŒã¿ã¯å°å³ã ã圹ã«ç«ã€ã | atama plusæ ªåŒäŒç€Ÿ å è€ çŽ æ° |
| 19:30ã | 質çå¿çïŒ30åïŒ | ãããã æ° / ã»ãç»å£è |
| 20:00ã | ã¢ãã¿ãŒããŒã¯ / ã¯ããŒãžã³ã°ïŒ10åïŒ | |
| 20:15 | å®å šçµäº |
â» ã¿ã€ã ã¹ã±ãžã¥ãŒã«ã¯ç®å®ã§ããå®å
šè§£æ£20:15ãŸã§ã®éã§ãããåå è
ã«ãæºè¶³ããã ãã圢ã§åã³ã³ãã³ãæéã調æŽãããå ŽåãããããŸãã
â» ããã°ã©ã ã¯å€æŽãšãªãå¯èœæ§ããããŸããéæãã¡ãã§æŽæ°ããããŸãã
ð å€§ç€æ¯ãèãïŒãåå è éå®ãå¿åè å šå¡ãã¬ãŒã³ãäŒç»ïŒForkwellïŒ
æå®ã®æ¡ä»¶ãæºãããæ¹ã«ãããªãããããæ°ãå·çããããå®è·µçããŒã¿åºç€ãžã®åŠæ¹ç®ãããã¬ãŒã³ãããããŸãïŒ
ããã£ã³ããŒã³å¿åã®æ¡ä»¶ã
1. Forkwellã«äŒå¡ç»é²ãè¡ã
2. ãè·æŽãã®æ¬ã«ãææ°ã®è·åå
容ã100æå以äžèšå
¥ãã
3. ãããããã»ç®æãããããšãã®æ¬ã«ãããŒã¿åæã»æŽ»çšã®é åã§ææŠãããããšããèšèŒãããâ»æå®æåæ°ãªã / åé ã«ãããŒã¿åæã»æŽ»çšã®é åã§ææŠãããããšãã®æèšãèšå
¥
4. ã¹ã«ãŠãåãåãèšå®ããªã³ã«ãã
5. åœæ¥ããã£ã³ããŒã³ãã©ãŒã ã«å¿åè³æ Œãæºãããã¢ã«ãŠã³ãïŒãŠãŒã¶ãŒåïŒããã®ä»é
ç®ãå
¥åããæåº
æ¢ã«äŒå¡ã®æ¹ã§ã¹ã«ãŠãåãåãèšå®ãªã³ã®æ¹ã¯2.3.5çªã®å¯Ÿå¿ã®ã¿ã§å¿åã§ããŸãïŒ
ïŒã¢ã³ã±ãŒããã©ãŒã URLã¯YouTubeæŠèŠæ¬ã«èšèŒããŸãïŒ

éå¬èæ¯
Forkwell ããã®ã³ã¡ã³ã
æ¬ã€ãã³ãã¯ãInfra Study Meetup ã«æ³šç®ããŠããã ãã primeNumber ããŸããã®ã声ããã§å®çŸããã€ãã³ãã§ããInfra Study Meetup ãšã¯äž»å¬ããå£äœãæ±ãããŒããç°ãªãããšãããå¥ã·ãªãŒãºãšããŠç«ã¡äžããŸãããInfra Study åå è ãšå ±ã«åŸãã€ãã³ãããŠããŠãç¶æ¿ããããŒã¿åæé åã§ãåŠã³ã®å ŽãäœããŸãã
æ¬å®¶ Infra Study ã«ãåå ããã ããæ¹ã¯ãã¡ãããããŒã¿åæã«é¢å¿ã®ããæ¹ãªãã©ãªãã§ãåå å¯èœã§ãããšã³ãžãã¢ãªã³ã°ãšå¯æ¥ã«é¢ããããŒã¿åæé åã«ã€ããŠæ¥œããåŠãã§ããã ããŸããã幞ãã§ãã
Forkwell äºæ¥è²¬ä»»è èµ€å·
primeNumber ããã®ã³ã¡ã³ã
åŒç€Ÿã¯ããŒã¿åæåºç€åãã®ç·åæ¯æŽãµãŒãã¹ãtroccoããéå¶ããŠããã®ã§ããããã®äžã§ãã©ãããåæåºç€ãäœã£ãŠããã°ããã®ãïŒããšããã質åããã䌺ããŸãããã®ãããªæ¹åãã«äœãæçãªæ å ±ããæäŸã§ããå Žã¯ãªãããšèããæã«ãæ¬ã€ãã³ãã®éå¬ãæãã€ããŸããã
ãããªã¿ã€ãã³ã°ã§ããInfra Study Meetupããšããåé¿ã倧ããã€ãã³ããããã®ãèŠã€ãããããŒã¿åæåºç€ãçãäœããŸããããšã声ããããæããéå¬ã«è³ããŸããã
ããããåæåºç€ãäœãããšãããŠããæ¹ããçŸåšéçšäžã®åºç€ã®æ¹åã¢ã€ãã¢ãæ¢ããŠããæ¹ã«ãæçãªå Žã«åºæ¥ãã°ãšæã£ãŠãããŸãã
primeNumber åç· åœ¹å·è¡åœ¹å¡CPO å°æå¯å
ãããªãšã³ãžãã¢ã«ãããã
- ããŒã¿åæã«é¢ããäºäŸãç¥ãããæ¹
- èªç€Ÿå ã«ããŒã¿åæåºç€ãäœãããšæ€èšäžã®æ¹
- èªç€Ÿã®ããŒã¿åæåºç€ãããå¹ççã«ããããšèããŠããæ¹
- ããŒã¿åæé åã«å¹ ãåºããŠã¿ãããœãããŠã§ã¢ãšã³ãžãã¢ã»ã€ã³ãã©ãšã³ãžãã¢
ãããŸã§ã®å匷äŒã§æ±ã£ãããŒããšã¢ãŒã«ã€ãåç»
- 2020/07/15ïŒæ°ŽïŒïœç¬¬1åãã¢ãã³ãªDWH/BIããŒã«ã®éžã³æ¹ãšãå®éã®éçšäºäŸã
- 2020/08/19ïŒæ°ŽïŒïœç¬¬2åãããŒã¿åéåºç€ãšããŒã¿æŽåã®ãããŸã§ãšããããã
- 2020/09/16ïŒæ°ŽïŒïœç¬¬3åãåæåºç€ãããŸãçµç¹ã«æµžéãããæ¹æ³ã
- 2020/11/04ïŒæ°ŽïŒïœç¬¬4åãããŒã¿åæåºç€ã®é害察å¿äºäŸLTç¥ãã
- 2020/12/02ïŒæ°ŽïŒïœç¬¬5åãåã®Snowflake Deep Dive / åœå äºäŸã»ä»DWHãšã®æ¯èŒã
- 2021/02/03ïŒæ°ŽïŒïœç¬¬6åãæ¹ããŠåŠã¶ãBigQuery培åºå ¥éã
- 2021/04/06ïŒç«ïŒïœç¬¬7åãRedshiftææ°ã¢ããããŒããšæŽ»çšäºäŸã
- 2021/06/02ïŒæ°ŽïŒïœç¬¬8åãBIããŒã«ç¹éïŒOSSã»åçšã®äžæã䜿ãåãã
- 2021/08/03ïŒç«ïŒïœç¬¬9åãäŒæ¥èŠæš¡å¥ããŒã¿ãšã³ãžãã¢çµç¹ã®äœãæ¹ã
- 2021/10/06ïŒæ°ŽïŒïœç¬¬10åãçéBIããŒã«ç¹é Tableau / PowerBI / GoogleããŒã¿ããŒã¿ã«ã
- 2021/12/13ïŒæïŒïœç¬¬11åã6瀟ã®ããŒã¿ãšã³ãžãã¢ãæ¯ãè¿ã2021ã
- 2022/02/09ïŒæ°ŽïŒïœç¬¬12åããšã³ãžãã¢ã®ããã®ãããŒã¿å¯èŠåãå ¥éã
- 2022/04/06ïŒæ°ŽïŒïœç¬¬13åãELTã»ããŒã¿ã¢ããªã³ã°ããŒã«ç¹éåã
- 2022/06/08ïŒæ°ŽïŒïœç¬¬14åãModern Data Stackç¹éã
- 2022/08/03ïŒæ°ŽïŒïœç¬¬15åãReverse ETL ç¹éåã
åå æ¹æ³
ä»åã®ãªã³ã©ã€ã³å匷äŒã¯ YouTube Live ã䜿çšããŠã©ã€ãé
ä¿¡ããããŸãã
ãŸããã³ã¡ã³ããææ³ãè¬æŒå
容ã«é¢ãã質å㯠Twitter ãžãé¡ãããããŸãã
ã©ã€ãé
ä¿¡çµäºåŸãã¢ãŒã«ã€ãåç»ã®å
¬éãäºå®ããŠãããŸãã
åœæ¥ã®é嬿éã«ã©ã€ãåå ã§ããªãæ¹ãããã¡ãã®ããŒãžããåå ç³èŸŒã¿ã®äžãã¢ãŒã«ã€ãåç»ããèŠèŽããã ããŸãã
ãªããTwitterã¿ã€ã ã©ã€ã³ãšé£åãããªã¢ã«ã¿ã€ã ãªã€ãã³ãåå äœéšãéèŠãããããYouTube Liveã®è¿œãããåçã¯ã§ããªãèšå®ãšãªããŸãããšããäºæ¿ãã ãããŸãã é ä¿¡äžã®ããã°ã©ã ããã®èŠèŽããããã¯ã©ã€ãé ä¿¡çµäºæ°æéåŸããåçå¯èœã«ãªãã¢ãŒã«ã€ãåç»ããèŠèŽãã ããã
çæäºé
- Data Engineering Study ã³ãã¥ããã£ã¬ã€ãã©ã€ã³ ãäºåã«ã確èªãã ããã
- ã€ãã³ãåå æã«ãå ¥åããã ããæ å ±ã¯ã次ã®ãã©ã€ãã·ãŒããªã·ãŒã«åºã¥ããprimeNumber ã®ã¿ã§é©åã«æ±ããŸãã https://primenumber.co.jp/privacy/
äž»å¬ã»åå
äž»å¬ïŒã³ãã¥ããã£æ¯æŽåè³
ãæé·ãç¶ãããšã³ãžãã¢ãæ¯æŽããããµãŒãã¹ãéå¶ãã Forkwell
åæåºç€åãããŒã¿çµ±åSaaSãtroccoãã®éçºã»éå¶ãè¡ã primeNumber
åŸæŽ
å€©ç¥æŸé屿§ã«ã©ã€ãé
信代è¡ãšããŠååããã ããŠãããŸãã
å€©ç¥æŸéå±ã¯ã©ã€ãé
ä¿¡ãåºããããšã§ãæ©äŒæ Œå·®ããªãããããšãããã·ã§ã³ãšããã©ã€ãé
ä¿¡ãŠãããã§ãã
ã³ãã¥ããã£ã€ãã³ããå¢ãç¶ããäžãã³ã³ãã³ããç±æãã人ã«å±ããããã«æŽ»åããŠããŸãã
泚æäºé
â» ãã¡ãã®ã€ãã³ãæ å ±ã¯ãå€éšãµã€ãããååŸããæ å ±ãæ²èŒããŠããŸãã
â» æ²èŒã¿ã€ãã³ã°ãæŽæ°é »åºŠã«ãã£ãŠã¯ãæ å ±æäŸå ããŒãžã®å 容ãšå·®ç°ãçºçããŸãã®ã§äºããäºæ¿ãã ããã
â» ææ°æ å ±ã®ç¢ºèªãåå ç³èŸŒæç¶ããã€ãã³ãã«é¢ãããåãåããçã¯æ å ±æäŸå ããŒãžã«ãŠãé¡ãããŸãã

ãåãåãã
- TOP
- ã€ãã³ã
- Data Engineering Study #16ãããŒã¿ã«ã¿ãã°å ¥éã


