Data Engineering Study #17ã6瀟ã®ããŒã¿ãšã³ãžãã¢ãæ¯ãè¿ã2022ã
ã€ãã³ãå 容
éå»ã® Data Engineering Study ã®ã¢ãŒã«ã€ãã¯ãã¡ããããèŠèŽããã ããŸãã
éå¬å 容
æŠèŠ
æ¬ã€ãã³ãã¯ãInfra Study Meetup ãéå¶ãã Forkwell ãšãåæåºç€åãããŒã¿çµ±åSaaSãtroccoãã®éçºã»éå¶ãè¡ã primeNumber ã«ããå
±å¬ã€ãã³ãã§ããããŒã¿åæã«ç²Ÿéããè¬åž«ããæãããããŒã¿åæåºç€ã®ããããŸã§ããšãããããããåŠã¶ããšãè¶£æšãšããŠéå¬ããããŸãã
ããããæ°ïŒ@yuzutas0ïŒã«ã¢ãã¬ãŒã¿ãŒãäŸé Œããè€æ°åã«ããã£ãŠãååããŒãã«æ²¿ã£ãå
容ã§ååéã§ã掻èºãããŠãããšã³ãžãã¢ïŒç ç©¶è
ã«è¬æŒããã ããŸãã
ããã°ã©ã 第17åã6瀟ã®ããŒã¿ãšã³ãžãã¢ãæ¯ãè¿ã2022ã
Data Engineering Study第17åã§ã¯ã6瀟ã®ããŒã¿ãšã³ãžãã¢ãæ¯ãè¿ã2022ããšããã¿ã€ãã«ã§ãæšå¹Žã®å¹Žæ«åãšåæ§ãä»å¹Žäžå¹Žã®æ¯ãè¿ããããŠãããããšæããŸãã
ããŒã¿ãšã³ãžãã¢ãªã³ã°ã»ããŒã¿åæåºç€ã«é¢ãããè¯ãã£ãããšã»åé¡ã ã£ãããšã»æ¥å¹Žãã©ã€ãããããšããªã©ãLT圢åŒã§ãçºè¡šããŠããã ããŸãã
ããã®çŸå Žã§æŽ»èºãããŠããããŒã¿ãšã³ãžãã¢ã®çæ§ã®çã®å£°ãèããå Žãšãªã£ãŠãããŸãã
ãŸããç»å£è
ã®æ¹ã¯æ±ºãŸã次第éæåæ ããŠåããŸãã
LT1ãData Product Manager / ããŒã¿ãããã¯ããããŒãžã£ãŒãšã¯ã
å»£ç¬æºå² æ°ïŒ@satoshihiroseïŒ
Senior Product Manager, Treasure Data
âçºè¡šå 容
ããŒã¿ãšã³ãžãã¢ãªã©ãçµãŠæè¿ã«ãããã¯ããããŒãžã£ã«è»¢èº«ããçºè¡šè ãããŒã¿ãããã¯ããšãããã¯ããããžã¡ã³ãã®è©±ãããŸãã
LT2ãããŒã¿ã®"å®ã"ãåºãã2022ã
ãæ²³éå ç æ°ïŒ@matako1124ïŒ
æ ªåŒäŒç€ŸLuup Data Strategyéš Data Engineer
âçºè¡šå 容
LUUPã¯é»åããã¯ããŒããé»åã¢ã·ã¹ãèªè»¢è»ãã¢ããªããè§£é ã»æœé ãä¹è»ã§ããã·ã§ã¢ãªã³ã°ãµãŒãã¹ãå±éããŠããŸããæ±äº¬ã倧éªã暪æµã京éœãšå±éãšãªã¢ãæ¡å€§ããå©çšå¯èœãªããŒãæ°ã¯2000ãè¶ ããŠããŸããã
ããŒã¿ãå¢ãç¶ããŠããäžã§ãæ§ã ãªçš®é¡ã®ããŒã¿ã«å¯Ÿå¿ã§ãããããªããŒã¿åºç€ãæ±ããããããã«ãªããŸããã
1幎ãããŠã©ã®ããã«ããŒã¿åºç€ãé²åããããã玹ä»ãããŠããã ããŸãã
LT3ãdbtæ¥æ¬ã³ãã¥ããã£ã®ç«ã¡äžããš10Xã§dbtã®å®è·µãè¡ã£ã2022ã
ãç§æ¬æä¹ æ°ïŒ@takimoïŒ
æ ªåŒäŒç€Ÿ10X ããŒã¿ãããã¯ããšã³ãžãã¢
âçºè¡šå 容
æšå¹Žãšæ¯ã¹ããšå§åçã«æ³šç®ãããå®éã«å°å ¥ããŠããäŒç€Ÿãå¢ããŠããŠããdbtïŒdata build toolïŒãšããããŒã«ããããŸããdbt Tokyo Meetupã®ãªãŒã¬ãã€ã¶ãŒãæ åœããŠãã1幎ãã³ãã¥ããã£ã§ã®åãçµã¿äºäŸãä»åŸã®èŠéãã«é¢ããŠã玹ä»ããããå®éã«10Xã®äºæ¥ã§ã©ã®ããã«äœ¿ãããŠããã®ãã®æ¯ãè¿ããåºæ¥ãããªãšæããŸãã
LT4ãdbtã§ã¢ããªãã¥ãŒã·ã§ã³åæã
ãå°æ å¯å æ°ïŒ@hiro_koba_jpïŒ
æ ªåŒäŒç€ŸprimeNumber åç· åœ¹å·è¡åœ¹å¡CPO
âçºè¡šå 容
coming soon...
LT5ã2022ã®LINE Data Platform宀ã
å°éåçŽ æ°
LINEæ ªåŒäŒç€Ÿ Data Platform宀 IU Hadoop ããŒã Engineering Manager
âçºè¡šå 容
LINEã§ã¯DataPlatformãå 補ããŠããŸãããããŸã§ã¯DataPlatformããŠãŒã¶ãŒã«å®å®ããŠå©çšããŠãããããã®éçºã«æ³šåããŠããŸããããä»å¹Žã¯DataPlatformã®æé©åãããŒããšããŠæ§ã ãªãããžã§ã¯ãã«åãçµãã§ããŸãããå ·äœçã«ã¯ãSpark3ãžã®ã¢ããã°ã¬ãŒããå©çšç¶æ³ã®å¯èŠåã«åãçµã¿ãŸããããŸãããã®ããã«åãçµãããŒããå€ãã£ãããšã«ãã£ãŠã掻èºãã人æåã«ãå€åãåºãŠããŸãããããããLINEã«ãããDataPlatformã®å€§ããªæµãã玹ä»ããããšæããŸãã
LT6ãããšã³ã¿ãŒãã©ã€ãºããšããèšèã®éã ãData Vault 2.0ãããã2022幎å¬ãã
æ± ç°å°å£« æ°ïŒ@mashiikeïŒ
é¢çœæ³äººã«ã€ã㯠ãã®ä»äºæ¥éš SRE ããŒã ããŒã¿ãšã³ãžãã¢
âçºè¡šå 容
ã¹ã±ãŒã©ãã«ãªãšã³ã¿ãŒãã©ã€ãºã»ããŒã¿ãŠã§ã¢ããŠã¹ãç¯ãã¢ããªã³ã°ææ³ã®äžã€ãšããŠãDataVault2.0ããããŸãã ã«ã€ãã¯ã®éå¶ããTonamelã§ã¯ãRedshiftã§DataVault2.0ãå®è·µã2幎ã»ã©çµéã
ãããŠãä»å¹Žã®å¬DataVault2.0ããããŸããããªããªãã°ãããšã³ã¿ãŒãã©ã€ãºããšããèšèã®éã¿ãçæããããã§ãã æ¬LTã§ã¯ãçæãããŸã§ã®éã®ããå ±æããŸãã
ã¿ã€ã ã¹ã±ãžã¥ãŒã«ïŒç®å®ïŒ
| æé | å 容 |
|---|---|
| 18:00ã | åžäŒããæšæ¶ïŒ10åïŒ |
| 18:10ã | LT1ïŒ10åïŒ ãData Product Manager / ããŒã¿ãããã¯ããããŒãžã£ãŒãšã¯ãTreasure Data å»£ç¬æºå² æ° |
| 18:20ã | LT2ïŒ10åïŒ ãããŒã¿ã®"å®ã"ãåºãã2022ãæ ªåŒäŒç€ŸLuup æ²³éå ç æ° |
| 18:30ã | 質çå¿çïŒ10åïŒ |
| 18:40ã | ã¹ãã³ãµãŒLT1ïŒ5åïŒ Forkwell |
| 18:45ã | äŒæ©ïŒ5åïŒ |
| 18:50ã | LT3ïŒ10åïŒ ãdbtæ¥æ¬ã³ãã¥ããã£ã®ç«ã¡äžããš10Xã§dbtã®å®è·µãè¡ã£ã2022ãæ ªåŒäŒç€Ÿ10X ç§æ¬æä¹ æ° |
| 19:00ã | LT4ïŒ10åïŒ ãdbtã§ã¢ããªãã¥ãŒã·ã§ã³åæãæ ªåŒäŒç€ŸprimeNumber å°æ å¯å |
| 19:10ã | 質çå¿çïŒ10åïŒ |
| 19:20ã | ã¹ãã³ãµãŒLT2ïŒ5åïŒ æ ªåŒäŒç€ŸprimeNumber åå éŠå¥ |
| 19:25ã | äŒæ©ïŒ5åïŒ |
| 19:30ã | LT5ïŒ10åïŒ ã2022ã®LINE Data Platform宀ãLINEæ ªåŒäŒç€Ÿ å°éåçŽ æ° |
| 19:40ã | LT6ïŒ10åïŒ ãããšã³ã¿ãŒãã©ã€ãºããšããèšèã®éã ãData Vault 2.0ãããã2022幎å¬ããé¢çœæ³äººã«ã€ãã¯ æ± ç°å°å£« æ° |
| 19:50ã | 質çå¿çïŒ10åïŒ |
| 20:00ã | ã¢ãã¿ãŒããŒã¯ïŒ15å~ïŒ |
| 20:15 | å®å šçµäº |
â» ã¿ã€ã ã¹ã±ãžã¥ãŒã«ã¯ç®å®ã§ããå®å
šè§£æ£20:15ãŸã§ã®éã§ãããåå è
ã«ãæºè¶³ããã ãã圢ã§åã³ã³ãã³ãæéã調æŽãããå ŽåãããããŸãã
â» ããã°ã©ã ã¯å€æŽãšãªãå¯èœæ§ããããŸããéæãã¡ãã§æŽæ°ããããŸãã
ð åå è éå®ãæžç±ãã¬ãŒã³ãäŒç»
Forkwellã«äŒå¡ç»é²ãè¡ããæ¡ä»¶ãæºãããæ¹ã«äžéšãæœéžã«ãŠããããæ°ãå·çããããå®è·µçããŒã¿åºç€ãžã®åŠæ¹ç®ãããã¬ãŒã³ãããããŸãïŒ
- æ°èŠã«Forkwellã«äŒå¡ç»é²ãè¡ãªã£ãæ¹ â ãããªãæžç±ãã¬ãŒã³ã
- 以åããForkwelläŒå¡ã ã£ãæ¹ â äŒå¡å¿åã®äžããæœéžã§15åããŸã«æžç±ãã¬ãŒã³ãïŒ
ããã£ã³ããŒã³å¿åã®æ¡ä»¶ã
1. Forkwellã«äŒå¡ç»é²ãè¡ã
2. èªå·±ç޹ä»ãšææ°ïŒçŸè·ïŒã®è·åå
容ããããã100æå以äžèšå
¥ãã
4. ã¹ã«ãŠãåãåãèšå®ããªã³ã«ãã
5. åœæ¥ã®YouTubeæŠèŠæ¬ã«èšèŒã®ã¢ã³ã±ãŒããã©ãŒã ã§å¿åè³æ Œãæºãããã¢ã«ãŠã³ãïŒãŠãŒã¶ãŒåïŒã®æåº
â»æ¬ãã£ã³ããŒã³ã¯ããžãã¹è·ïŒå¶æ¥ã»ããŒã±ã¿ãŒçïŒã®æ¹ã¯å¯Ÿè±¡å€ãšãããŠããã ããŸãã
â»æ¡ä»¶éæè
ã«åŸæ¥ãæžç±çºéæç¶ããã©ãŒã ãéä»ãããŸãã®ã§å¿ããã«ãæç¶ããé¡ãããŸãã
â»ãã£ã³ããŒã³ã«é¢ããåå¥ã®ãåãåããã¯ãã¡ããããé¡ãããŸãã
éå¬èæ¯
Forkwell ããã®ã³ã¡ã³ã
æ¬ã€ãã³ãã¯ãInfra Study Meetup ã«æ³šç®ããŠããã ãã primeNumber ããŸããã®ã声ããã§å®çŸããã€ãã³ãã§ããInfra Study Meetup ãšã¯äž»å¬ããå£äœãæ±ãããŒããç°ãªãããšãããå¥ã·ãªãŒãºãšããŠç«ã¡äžããŸãããInfra Study åå è ãšå ±ã«åŸãã€ãã³ãããŠããŠãç¶æ¿ããããŒã¿åæé åã§ãåŠã³ã®å ŽãäœããŸãã
æ¬å®¶ Infra Study ã«ãåå ããã ããæ¹ã¯ãã¡ãããããŒã¿åæã«é¢å¿ã®ããæ¹ãªãã©ãªãã§ãåå å¯èœã§ãããšã³ãžãã¢ãªã³ã°ãšå¯æ¥ã«é¢ããããŒã¿åæé åã«ã€ããŠæ¥œããåŠãã§ããã ããŸããã幞ãã§ãã
Forkwell äºæ¥è²¬ä»»è èµ€å·
primeNumber ããã®ã³ã¡ã³ã
åŒç€Ÿã¯ããŒã¿åæåºç€åãã®ç·åæ¯æŽãµãŒãã¹ãtroccoããéå¶ããŠããã®ã§ããããã®äžã§ãã©ãããåæåºç€ãäœã£ãŠããã°ããã®ãïŒããšããã質åããã䌺ããŸãããã®ãããªæ¹åãã«äœãæçãªæ å ±ããæäŸã§ããå Žã¯ãªãããšèããæã«ãæ¬ã€ãã³ãã®éå¬ãæãã€ããŸããã
ãããªã¿ã€ãã³ã°ã§ããInfra Study Meetupããšããåé¿ã倧ããã€ãã³ããããã®ãèŠã€ãããããŒã¿åæåºç€ãçãäœããŸããããšã声ããããæããéå¬ã«è³ããŸããã
ããããåæåºç€ãäœãããšãããŠããæ¹ããçŸåšéçšäžã®åºç€ã®æ¹åã¢ã€ãã¢ãæ¢ããŠããæ¹ã«ãæçãªå Žã«åºæ¥ãã°ãšæã£ãŠãããŸãã
primeNumber åç· åœ¹å·è¡åœ¹å¡CPO å°æå¯å
ãããªãšã³ãžãã¢ã«ãããã
- ããŒã¿åæã«é¢ããäºäŸãç¥ãããæ¹
- èªç€Ÿå ã«ããŒã¿åæåºç€ãäœãããšæ€èšäžã®æ¹
- èªç€Ÿã®ããŒã¿åæåºç€ãããå¹ççã«ããããšèããŠããæ¹
- ããŒã¿åæé åã«å¹ ãåºããŠã¿ãããœãããŠã§ã¢ãšã³ãžãã¢ã»ã€ã³ãã©ãšã³ãžãã¢
ãããŸã§ã®å匷äŒã§æ±ã£ãããŒããšã¢ãŒã«ã€ãåç»
- 2020/07/15ïŒæ°ŽïŒïœç¬¬1åãã¢ãã³ãªDWH/BIããŒã«ã®éžã³æ¹ãšãå®éã®éçšäºäŸã
- 2020/08/19ïŒæ°ŽïŒïœç¬¬2åãããŒã¿åéåºç€ãšããŒã¿æŽåã®ãããŸã§ãšããããã
- 2020/09/16ïŒæ°ŽïŒïœç¬¬3åãåæåºç€ãããŸãçµç¹ã«æµžéãããæ¹æ³ã
- 2020/11/04ïŒæ°ŽïŒïœç¬¬4åãããŒã¿åæåºç€ã®é害察å¿äºäŸLTç¥ãã
- 2020/12/02ïŒæ°ŽïŒïœç¬¬5åãåã®Snowflake Deep Dive / åœå äºäŸã»ä»DWHãšã®æ¯èŒã
- 2021/02/03ïŒæ°ŽïŒïœç¬¬6åãæ¹ããŠåŠã¶ãBigQuery培åºå ¥éã
- 2021/04/06ïŒç«ïŒïœç¬¬7åãRedshiftææ°ã¢ããããŒããšæŽ»çšäºäŸã
- 2021/06/02ïŒæ°ŽïŒïœç¬¬8åãBIããŒã«ç¹éïŒOSSã»åçšã®äžæã䜿ãåãã
- 2021/08/03ïŒç«ïŒïœç¬¬9åãäŒæ¥èŠæš¡å¥ããŒã¿ãšã³ãžãã¢çµç¹ã®äœãæ¹ã
- 2021/10/06ïŒæ°ŽïŒïœç¬¬10åãçéBIããŒã«ç¹é Tableau / PowerBI / GoogleããŒã¿ããŒã¿ã«ã
- 2021/12/13ïŒæïŒïœç¬¬11åã6瀟ã®ããŒã¿ãšã³ãžãã¢ãæ¯ãè¿ã2021ã
- 2022/02/09ïŒæ°ŽïŒïœç¬¬12åããšã³ãžãã¢ã®ããã®ãããŒã¿å¯èŠåãå ¥éã
- 2022/04/06ïŒæ°ŽïŒïœç¬¬13åãELTã»ããŒã¿ã¢ããªã³ã°ããŒã«ç¹éåã
- 2022/06/08ïŒæ°ŽïŒïœç¬¬14åãModern Data Stackç¹éã
- 2022/08/03ïŒæ°ŽïŒïœç¬¬15åãReverse ETL ç¹éåã
- 2022/10/19ïŒæ°ŽïŒïœç¬¬16åãããŒã¿ã«ã¿ãã°å ¥éã
åå æ¹æ³
ä»åã®ãªã³ã©ã€ã³å匷äŒã¯ YouTube Live ã䜿çšããŠã©ã€ãé
ä¿¡ããããŸãã
ãŸããã³ã¡ã³ããææ³ãè¬æŒå
容ã«é¢ãã質å㯠Twitter ãžãé¡ãããããŸãã
ã©ã€ãé
ä¿¡çµäºåŸãã¢ãŒã«ã€ãåç»ã®å
¬éãäºå®ããŠãããŸãã
åœæ¥ã®é嬿éã«ã©ã€ãåå ã§ããªãæ¹ãããã¡ãã®ããŒãžããåå ç³èŸŒã¿ã®äžãã¢ãŒã«ã€ãåç»ããèŠèŽããã ããŸãã
ãªããTwitterã¿ã€ã ã©ã€ã³ãšé£åãããªã¢ã«ã¿ã€ã ãªã€ãã³ãåå äœéšãéèŠãããããYouTube Liveã®è¿œãããåçã¯ã§ããªãèšå®ãšãªããŸãããšããäºæ¿ãã ãããŸãã é ä¿¡äžã®ããã°ã©ã ããã®èŠèŽããããã¯ã©ã€ãé ä¿¡çµäºæ°æéåŸããåçå¯èœã«ãªãã¢ãŒã«ã€ãåç»ããèŠèŽãã ããã
çæäºé
- Data Engineering Study ã³ãã¥ããã£ã¬ã€ãã©ã€ã³ ãäºåã«ã確èªãã ããã
- ã€ãã³ãåå æã«ãå ¥åããã ããæ å ±ã¯ã次ã®ãã©ã€ãã·ãŒããªã·ãŒã«åºã¥ããprimeNumber ã®ã¿ã§é©åã«æ±ããŸãã https://primenumber.co.jp/privacy/
äž»å¬ã»åå
äž»å¬ïŒã³ãã¥ããã£æ¯æŽåè³
ãæé·ãç¶ãããšã³ãžãã¢ãæ¯æŽããããµãŒãã¹ãéå¶ãã Forkwell
åæåºç€åãããŒã¿çµ±åSaaSãtroccoãã®éçºã»éå¶ãè¡ã primeNumber
åŸæŽ
å€©ç¥æŸé屿§ã«ã©ã€ãé
信代è¡ãšããŠååããã ããŠãããŸãã
å€©ç¥æŸéå±ã¯ã©ã€ãé
ä¿¡ãåºããããšã§ãæ©äŒæ Œå·®ããªãããããšãããã·ã§ã³ãšããã©ã€ãé
ä¿¡ãŠãããã§ãã
ã³ãã¥ããã£ã€ãã³ããå¢ãç¶ããäžãã³ã³ãã³ããç±æãã人ã«å±ããããã«æŽ»åããŠããŸãã
泚æäºé
â» ãã¡ãã®ã€ãã³ãæ å ±ã¯ãå€éšãµã€ãããååŸããæ å ±ãæ²èŒããŠããŸãã
â» æ²èŒã¿ã€ãã³ã°ãæŽæ°é »åºŠã«ãã£ãŠã¯ãæ å ±æäŸå ããŒãžã®å 容ãšå·®ç°ãçºçããŸãã®ã§äºããäºæ¿ãã ããã
â» ææ°æ å ±ã®ç¢ºèªãåå ç³èŸŒæç¶ããã€ãã³ãã«é¢ãããåãåããçã¯æ å ±æäŸå ããŒãžã«ãŠãé¡ãããŸãã

ãåãåãã
é¢é£ããã€ãã³ã

åœé女æ§ããŒç¹å¥ã€ãã³ã-Give to Gain-ãšã³ãžãã¢ã®ç§ãã¡ã次ã®äžä»£ãžéå ã§ããããš
2026/04/18(å) éå¬
ã¯ã©ãŠã MySQL 8.0 EOLãã¢ããã°ã¬ãŒãã«ã©ãåããã¹ããïœ IT責任è ã»ç®¡çè ãæŒããããéäºææ§ã»æ§èœæªåã»ç§»è¡ãªã¹ã¯ ïœ
2026/04/23(æš) éå¬
ã¯ã©ãŠãå€é©ã§åºããFPTã®ãã£ãªã¢ïœ ææ¡ããã°ããŒãã«ããªããªãŒãŸã§ãçŸå Žã§ç£šãå®è·µåãšæé·æ©äŒïŒ
2026/04/17(é) éå¬
4æå®äŸäŒã幎霢ã®å£ãè¶ããŠãã¹ããÃAIãã§æ¥åžžãè±ãã«/ æ ç»å¶äœã§å°ååµç 倱æããªãäŒæ¥ã®å¯æ¥è¡ã
2026/04/14(ç«) éå¬
ãããã¯ãŒã¯ãã³ãºãªã³ïŒCCNAå®ç¿ãAWSæ¥ç¶ã»L3ã¹ã€ããã»ãã¡ã€ã¢ãŠã©ãŒã«å®ç¿ïŒ
2026/04/09(æš) éå¬- TOP
- ã€ãã³ã
- Data Engineering Study #17ã6瀟ã®ããŒã¿ãšã³ãžãã¢ãæ¯ãè¿ã2022ã


