Data Engineering Study #18ãããŒã¿æåã¢ããªã±ãŒã·ã§ã³ãã¶ã€ã³ã
ã€ãã³ãå 容
éå»ã® Data Engineering Study ã®ã¢ãŒã«ã€ãã¯ãã¡ããããèŠèŽããã ããŸãã
éå¬å 容
æŠèŠ
æ¬ã€ãã³ãã¯ãInfra Study Meetup ãéå¶ãã Forkwell ãšãåæåºç€åãããŒã¿çµ±åSaaSãtroccoãã®éçºã»éå¶ãè¡ã primeNumber ã«ããå
±å¬ã€ãã³ãã§ããããŒã¿åæã«ç²Ÿéããè¬åž«ããæãããããŒã¿åæåºç€ã®ããããŸã§ããšãããããããåŠã¶ããšãè¶£æšãšããŠéå¬ããããŸãã
è€æ°åã«ããã£ãŠãååããŒãã«æ²¿ã£ãå
容ã§ååéã§ã掻èºãããŠãããšã³ãžãã¢ïŒç ç©¶è
ã«è¬æŒããã ããŸãã
質çå¿çã®æéã«ã¯ãããããæ°ïŒ@yuzutas0ïŒã«ããåå ããã ããŸãã
ããã°ã©ã 第18åãããŒã¿æåã¢ããªã±ãŒã·ã§ã³ãã¶ã€ã³ã
ãããªãšã³ãžãã¢ã«ãããã
- ããŒã¿æåã¢ããªã±ãŒã·ã§ã³ãã¶ã€ã³ãèªãã§ããã»èªãããšæã£ãŠããæ¹
- ãœãããŠã§ã¢ãšã³ãžãã¢ã»ã¢ãŒããã¯ãã®æ¹
- ããããããŒã¿ãšã³ãžãã¢ãç®æãæ¹
åºèª¿è¬æŒã30åã§ãããããŒã¿æåã¢ããªã±ãŒã·ã§ã³ãã¶ã€ã³ã
æè€ å€ªéæ° ãTwitterïŒ@taroleo / GithubïŒ@xerial
Principal Software Engineer , Treasure Data
æ±äº¬å€§åŠçåŠéšæ
å ±ç§åŠç§åãæ
å ±çå·¥åŠ Ph.DãããŒã¿ããŒã¹ãå€§èŠæš¡ã²ãã ããŒã¿åŠçã®ç ç©¶ã«åŸäºããã®åŸãã¹ã¿ãŒãã¢ããã§ããTreasure Dataã«å ãããã¢ã¡ãªã«ãã·ãªã³ã³ãã¬ãŒãæ ç¹ã«æŽ»åäžãæ¥æ¬ããŒã¿ããŒã¹åŠäŒäžæå¥šå±è³åè³ãOSSãäžå¿ã«ããã°ã©ãã³ã°ãããŒã¿åŠçãç°¡åã«ããããã®ãããã¯ããäœæããŠããã
âçºè¡šå 容
600ããŒãžãè¶ ãã倧èã§ãããããŒã¿æåã¢ããªã±ãŒã·ã§ã³ãã¶ã€ã³ããã30åã§ããããããåã¿ç ããŠè§£èª¬ããŸãã
Talk Session
ãããªã¹ã
ç°ç± è¡æ° ãTwitterïŒ@tagomoris / GithubïŒ@tagomoris
ããªãŒã©ã³ã¹ã»æè¡é¡§å
æ±äº¬å€§åŠå·¥åŠéšèšæ°å·¥åŠç§åãLINEãTreasure Dataãªã©ã§åããã®ã¡ç¬ç«ãWebã¢ããªã±ãŒã·ã§ã³ãITã€ã³ãã©ããã³ããŒã¿åæåºç€ã®èšèšã»å®è£
ãªã©ãå°éãšãããISUCONã®çºæ¡ãšéå§ãFluentdãmsgpack-rubyãNorikraãªã©OSSã®ã¡ã³ãããªã©ããè¿èã«ãFluentdå®è·µå
¥éã(æè¡è©è«ç€Ÿ)ã
æè€ å€ªéæ° ãTwitterïŒ@taroleo / GithubïŒ@xerial
Principal Software Engineer , Treasure Data
ã¢ãã¬ãŒã¿ãŒ
ãå°æ å¯å æ°ïŒ@hiro_koba_jpïŒ
æ ªåŒäŒç€ŸprimeNumber ããŒããããã¯ããªãã£ãµãŒ(CPO)
æ
¶æçŸ©å¡Ÿå€§åŠåæ¥åŸãæ ªåŒäŒç€Ÿãªãã»ã³ã¹ã«ãŠããŒã¿ãšã³ãžãã¢ãšããŠå瀟åæåºç€ç«ã¡äžãããªãŒããããprimeNumberãžã¯2017幎ã«åç»ãã2018幎10æã«ããŒã¿åæåºç€ã®ç·åæ¯æŽãµãŒãã¹ãtroccoããç«ã¡äžããã以éãåãããã¯ãã®å
šè¬ãçµ±æ¬ãããã®éå¶ãæ
ãã
ã¿ã€ã ã¹ã±ãžã¥ãŒã«ïŒç®å®ïŒ
| æé | å 容 | çºè¡šè |
|---|---|---|
| 14:00ã | ãªãŒããã³ã°ïŒ10åïŒ | |
| 14:10ã | åºèª¿è¬æŒã30åã§ãããããŒã¿æåã¢ããªã±ãŒã·ã§ã³ãã¶ã€ã³ãïŒ30åïŒ | Principal Software Engineer , Treasure Data æè€ å€ªé æ° |
| 14:40ã | äŒæ© / ã¹ãã³ãµãŒLTïŒ5åïŒ | Forkwell |
| 14:45ã | 質çå¿çïŒ20åïŒ | |
| 15:05ã | ã¹ãã³ãµãŒLTãtroccoããªãŒãã©ã³ã¯ãããŠã¿ããïŒ5åïŒ | primeNumber å°æ å¯å æ° |
| 15:10ã | ããŒã¯ã»ãã·ã§ã³ïŒ50åïŒ â»å匷äŒã®ããŒãäžãããŒã¿åæåºç€åšãã®è©±ãäžå¿ã«ããŸã - æ¬æžç±ãæŽã«æ·±ãåŠã¶æ¹æ³ - æ¬æžç±ããã®æè¡é²æ©ã«é¢ããã¢ããããŒãã«ã€ã㊠- æ¬æžç±ã®æè¡ã®å¿çšã«ã€ã㊠- æ¬æžç±ãç¹ã«èªãã¹ã人ã»ã¿ã€ãã³ã°ãªã© | ãããªã¹ã: ç°ç± è¡ æ° / æè€ å€ªé æ° ã¢ãã¬ãŒã¿ãŒ: primeNumber å°æ å¯å æ° |
| 16:00ã | ã¢ãã¿ãŒããŒã¯ïŒ10åïŒ | |
| 16:30 | å®å šçµäº |
â» ã¿ã€ã ã¹ã±ãžã¥ãŒã«ã¯ç®å®ã§ããå®å
šè§£æ£16:30ãŸã§ã®éã§ãããåå è
ã«ãæºè¶³ããã ãã圢ã§åã³ã³ãã³ãæéã調æŽãããå ŽåãããããŸãã
â» ããã°ã©ã ã¯å€æŽãšãªãå¯èœæ§ããããŸããéæãã¡ãã§æŽæ°ããããŸãã
ð æžç±ãã¬ãŒã³ããã£ã³ããŒã³ïŒForkwellïŒ
Forkwellã«äŒå¡ç»é²ããã ããã¢ã³ã±ãŒãã«åçããã ããæ¹ã«äžéšãæœéžã«ãŠã€ãã³ãããŒãæžç±ã§ãããããŒã¿æåã¢ããªã±ãŒã·ã§ã³ãã¶ã€ã³ãããã¬ãŒã³ãããŸãã
- æ°èŠã§Forkwellã«äŒå¡ç»é²ãè¡ãªã£ãæ¹â ãããªãæžç±ãã¬ãŒã³ãïŒ
- 以åããForkwelläŒå¡ã ã£ãæ¹â äŒå¡å¿åã®äžããæœéžã§20åããŸã«æžç±ãã¬ãŒã³ãïŒ
ããã£ã³ããŒã³å¿åã®æ¡ä»¶ã
1. Forkwellã«äŒå¡ç»é²ãè¡ã
2. èªå·±ç޹ä»ãšææ°ïŒçŸè·ïŒã®è·åå
容ããããã100æå以äžèšå
¥ãã
4. ã¹ã«ãŠãåãåãèšå®ããªã³ã«ãã
5. åœæ¥ã®YouTubeæŠèŠæ¬ã«èšèŒã®ã¢ã³ã±ãŒããã©ãŒã ã§å¿åè³æ Œãæºãããã¢ã«ãŠã³ãïŒãŠãŒã¶ãŒåïŒã®æåº
â»æ¬ãã£ã³ããŒã³ã¯ããžãã¹è·ïŒå¶æ¥ã»ããŒã±ã¿ãŒçïŒã®æ¹ã¯å¯Ÿè±¡å€ãšãããŠããã ããŸãã
â»åœéžè
ã«åŸæ¥ãæžç±çºéæç¶ããã©ãŒã ãéä»ãããŸãã®ã§å¿ããã«ãæç¶ããé¡ãããŸãã
â»ãã£ã³ããŒã³ã«é¢ããåå¥ã®ãåãåããã¯ãã¡ããããé¡ãããŸãã
éå¬èæ¯
Forkwell ããã®ã³ã¡ã³ã
æ¬ã€ãã³ãã¯ãInfra Study Meetup ã«æ³šç®ããŠããã ãã primeNumber ããŸããã®ã声ããã§å®çŸããã€ãã³ãã§ããInfra Study Meetup ãšã¯äž»å¬ããå£äœãæ±ãããŒããç°ãªãããšãããå¥ã·ãªãŒãºãšããŠç«ã¡äžããŸãããInfra Study åå è ãšå ±ã«åŸãã€ãã³ãããŠããŠãç¶æ¿ããããŒã¿åæé åã§ãåŠã³ã®å ŽãäœããŸãã
æ¬å®¶ Infra Study ã«ãåå ããã ããæ¹ã¯ãã¡ãããããŒã¿åæã«é¢å¿ã®ããæ¹ãªãã©ãªãã§ãåå å¯èœã§ãããšã³ãžãã¢ãªã³ã°ãšå¯æ¥ã«é¢ããããŒã¿åæé åã«ã€ããŠæ¥œããåŠãã§ããã ããŸããã幞ãã§ãã
Forkwell äºæ¥è²¬ä»»è èµ€å·
primeNumber ããã®ã³ã¡ã³ã
åŒç€Ÿã¯ããŒã¿åæåºç€åãã®ç·åæ¯æŽãµãŒãã¹ãtroccoããéå¶ããŠããã®ã§ããããã®äžã§ãã©ãããåæåºç€ãäœã£ãŠããã°ããã®ãïŒããšããã質åããã䌺ããŸãããã®ãããªæ¹åãã«äœãæçãªæ å ±ããæäŸã§ããå Žã¯ãªãããšèããæã«ãæ¬ã€ãã³ãã®éå¬ãæãã€ããŸããã
ãããªã¿ã€ãã³ã°ã§ããInfra Study Meetupããšããåé¿ã倧ããã€ãã³ããããã®ãèŠã€ãããããŒã¿åæåºç€ãçãäœããŸããããšã声ããããæããéå¬ã«è³ããŸããã
ããããåæåºç€ãäœãããšãããŠããæ¹ããçŸåšéçšäžã®åºç€ã®æ¹åã¢ã€ãã¢ãæ¢ããŠããæ¹ã«ãæçãªå Žã«åºæ¥ãã°ãšæã£ãŠãããŸãã
primeNumber åç· åœ¹å·è¡åœ¹å¡CPO å°æå¯å
ãããŸã§ã®å匷äŒã§æ±ã£ãããŒããšã¢ãŒã«ã€ãåç»
- 2020/07/15ïŒæ°ŽïŒïœç¬¬1åãã¢ãã³ãªDWH/BIããŒã«ã®éžã³æ¹ãšãå®éã®éçšäºäŸã
- 2020/08/19ïŒæ°ŽïŒïœç¬¬2åãããŒã¿åéåºç€ãšããŒã¿æŽåã®ãããŸã§ãšããããã
- 2020/09/16ïŒæ°ŽïŒïœç¬¬3åãåæåºç€ãããŸãçµç¹ã«æµžéãããæ¹æ³ã
- 2020/11/04ïŒæ°ŽïŒïœç¬¬4åãããŒã¿åæåºç€ã®é害察å¿äºäŸLTç¥ãã
- 2020/12/02ïŒæ°ŽïŒïœç¬¬5åãåã®Snowflake Deep Dive / åœå äºäŸã»ä»DWHãšã®æ¯èŒã
- 2021/02/03ïŒæ°ŽïŒïœç¬¬6åãæ¹ããŠåŠã¶ãBigQuery培åºå ¥éã
- 2021/04/06ïŒç«ïŒïœç¬¬7åãRedshiftææ°ã¢ããããŒããšæŽ»çšäºäŸã
- 2021/06/02ïŒæ°ŽïŒïœç¬¬8åãBIããŒã«ç¹éïŒOSSã»åçšã®äžæã䜿ãåãã
- 2021/08/03ïŒç«ïŒïœç¬¬9åãäŒæ¥èŠæš¡å¥ããŒã¿ãšã³ãžãã¢çµç¹ã®äœãæ¹ã
- 2021/10/06ïŒæ°ŽïŒïœç¬¬10åãçéBIããŒã«ç¹é Tableau / PowerBI / GoogleããŒã¿ããŒã¿ã«ã
- 2021/12/13ïŒæïŒïœç¬¬11åã6瀟ã®ããŒã¿ãšã³ãžãã¢ãæ¯ãè¿ã2021ã
- 2022/02/09ïŒæ°ŽïŒïœç¬¬12åããšã³ãžãã¢ã®ããã®ãããŒã¿å¯èŠåãå ¥éã
- 2022/04/06ïŒæ°ŽïŒïœç¬¬13åãELTã»ããŒã¿ã¢ããªã³ã°ããŒã«ç¹éåã
- 2022/06/08ïŒæ°ŽïŒïœç¬¬14åãModern Data Stackç¹éã
- 2022/08/03ïŒæ°ŽïŒïœç¬¬15åãReverse ETL ç¹éåã
- 2022/10/19ïŒæ°ŽïŒïœç¬¬16åãããŒã¿ã«ã¿ãã°å ¥éã
- 2022/12/14ïŒæ°ŽïŒïœç¬¬17åã6瀟ã®ããŒã¿ãšã³ãžãã¢ãæ¯ãè¿ã2022ã
åå æ¹æ³
ä»åã®ãªã³ã©ã€ã³å匷äŒã¯ YouTube Live ã䜿çšããŠã©ã€ãé
ä¿¡ããããŸãã
ãŸããã³ã¡ã³ããææ³ãè¬æŒå
容ã«é¢ãã質å㯠Twitter ãžãé¡ãããããŸãã
ã©ã€ãé
ä¿¡çµäºåŸãã¢ãŒã«ã€ãåç»ã®å
¬éãäºå®ããŠãããŸãã
åœæ¥ã®é嬿éã«ã©ã€ãåå ã§ããªãæ¹ãããã¡ãã®ããŒãžããåå ç³èŸŒã¿ã®äžãã¢ãŒã«ã€ãåç»ããèŠèŽããã ããŸãã
ãªããTwitterã¿ã€ã ã©ã€ã³ãšé£åãããªã¢ã«ã¿ã€ã ãªã€ãã³ãåå äœéšãéèŠãããããYouTube Liveã®è¿œãããåçã¯ã§ããªãèšå®ãšãªããŸãããšããäºæ¿ãã ãããŸãã é ä¿¡äžã®ããã°ã©ã ããã®èŠèŽããããã¯ã©ã€ãé ä¿¡çµäºæ°æéåŸããåçå¯èœã«ãªãã¢ãŒã«ã€ãåç»ããèŠèŽãã ããã
çæäºé
- Data Engineering Study ã³ãã¥ããã£ã¬ã€ãã©ã€ã³ ãäºåã«ã確èªãã ããã
- ã€ãã³ãåå æã«ãå ¥åããã ããæ å ±ã¯ã次ã®ãã©ã€ãã·ãŒããªã·ãŒã«åºã¥ããprimeNumber ã®ã¿ã§é©åã«æ±ããŸãã https://primenumber.co.jp/privacy/
äž»å¬ã»åå
äž»å¬ïŒã³ãã¥ããã£æ¯æŽåè³
åæåºç€åãããŒã¿çµ±åSaaSãtroccoãã®éçºã»éå¶ãè¡ã primeNumber
ãæé·ãç¶ãããšã³ãžãã¢ãæ¯æŽããããµãŒãã¹ãéå¶ãã Forkwell
Forkwellå²äžæå€§çŽã®å匷äŒãéå¬ ð
ãªãã©ã€ã³ã»ãªã³ã©ã€ã³åæéå¬ãITãšã³ãžãã¢ã ãã®è¶
豪è¯ãªæåç¥ã§ãïŒ
ååéããªãŒãããè¶
豪è¯ã²ã¹ãã®ã»ãã·ã§ã³ã1æ¥ã§èŽããã®ã¯ãã®æ¥ã ããªã®ã§ããèŠéããªãâŠïŒ
詳现ã¯ãããŒãã¯ãªãã¯ã
泚æäºé
â» ãã¡ãã®ã€ãã³ãæ å ±ã¯ãå€éšãµã€ãããååŸããæ å ±ãæ²èŒããŠããŸãã
â» æ²èŒã¿ã€ãã³ã°ãæŽæ°é »åºŠã«ãã£ãŠã¯ãæ å ±æäŸå ããŒãžã®å 容ãšå·®ç°ãçºçããŸãã®ã§äºããäºæ¿ãã ããã
â» ææ°æ å ±ã®ç¢ºèªãåå ç³èŸŒæç¶ããã€ãã³ãã«é¢ãããåãåããçã¯æ å ±æäŸå ããŒãžã«ãŠãé¡ãããŸãã

ãåãåãã
- TOP
- ã€ãã³ã
- Data Engineering Study #18ãããŒã¿æåã¢ããªã±ãŒã·ã§ã³ãã¶ã€ã³ã


