- TOP
- ã¿ã°äžèЧ
- Java
Java
ã€ãã³ã
ãã¬ãžã³
æè¡ããã°
2024幎床ã«AWSèªå®è³æ Œããã¹ãŠååŸãã 2025 ALL AWS Certifications Engineers ãšããŠè¡šåœ°ããŠããã ããŸããïŒ æ¯ãè¿ã£ãŠã¿ããšãåœåã®äºå®ã倧å¹
ã«ååããã è³æ ŒååŸRTA ã®ãããªææ¶ã®ã¹ã±ãžã¥ãŒã«ã§ããã ä»åã¯ããªãå®åçµéšãæççã ã£ãç§ãå
šå ãç®æããã®ãããããŠã©ããã£ãŠé§ãæããã®ãããã®èšé²ãå
¬éããŸãã ææŠåã®ã¹ããã¯ïŒAWSçµéšã¯ãç¹ãã§ãã ãå
šå ããšèããšãããããAWSã䜿ãããªããŠããäººãæ³åããããããããŸããããåœæã®ç§ã®ç¶æ³ã¯ãããªæãã§ããã ä»äºïŒã¯ã©ãŠããã€ãã£ããªéçºåºç€æ§ç¯ããŒã ã§ããããããäœã§ãå±ããããŠãããšã³ãžã㢠䞻æŠå ŽïŒ AzureãGoogleCloudïŒä»äºã®æ¯çã¯ãã¡ããé«ãïŒ AWSå®åçµéšïŒ ç¹å®ãµãŒãã¹ã®ã¢ããªéšåã1ã€äœæãããšã¯ãçäžãããžã§ã¯ãã§ã®æè¡æ¯æŽïŒç«æ¶ãïŒã«ã¹ãããåæŠ åŸæãªããšïŒ ããã°ã©ãã³ã°ãDevOpsé¢é£æè¡ãã¢ããªéçºåšã ä¿æè³æ ŒïŒ é«åºŠæ
å ±ïŒã·ã¹ãã ã¢ãŒããã¯ããããŒã¿ããŒã¹ã¹ãã·ã£ãªã¹ãïŒãJavaè³æ Œãªã© AWSã«é¢ããŠã¯ãåºãæµ
ããã©ããããç¹å®ã®ã¹ãããã ãæ¿ããè§Šã£ãããšããããšãããéåžžã«åã£ãç¥èç¶æ
ããã®ã¹ã¿ãŒãã§ããã ååŸåæ©ïŒããµããAWSãžã®æ³ãã圢ã«ãããã£ã çç±ã¯ã·ã³ãã«ã§ããAWSã奜ãã ããã ããããäžã®äžã¯AWSãšã³ãžãã¢æŠåœæä»£ã人æ°ãããŠç«¶äºçãé«ããã€ã³ãã©å°ä»»ã§ã¯ãªãç§ã«ã¯ããªããªãAWSã¡ã€ã³ã®æ¡ä»¶ãåã£ãŠããŸããã§ããã ã奜ããªã®ã«ãè§ŠããªãâŠâŠããã®ç±æãã©ãã«ãããŠèšŒæãããïŒã ããæãç«ã£ãçµæãããè³æ Œã§å¯èŠåããããšãã§ãããåœåã¯ã幎2åããããã€ããã£ããåããããªããšèããŠããã®ã§ãããããå§ãããšç«ãã€ããŠããŸããŸããã åŸæãªDevOpsåéãæå€ãšã¹ã«ã¹ã«åããããšã§åŒŸã¿ãã€ãã1è³æ Œ2é±éïŒ1ã»2æã¯æ3åããŒã¹ïŒãšããææ¶ã®çæéäžã¢ãŒãã«çªå
¥ããŠããŸã£ãã®ã§ãã ïŒâ»ããåã®çããã¯ãç¡çã®ãªãã¹ã±ãžã¥ãŒã«ãç«ãŠãŠãã ãããïŒïŒ æ»ç¥ã«ãŒãïŒåŸæãåºããŠãããå°éé åãã«æã äžè¬çã«ã¯SAAïŒAssociateïŒããSAPïŒProfessionalïŒãžé²ãã®ãçéã§ããã ç§ã¯ç¥èã®ãªãŒããŒã©ãããæèããŠãåŸæãªé åããã°ã«ãŒãã³ã°ããŠæ»ç¥ããŸããã å®éã«é²ãã é çª 1. åºç€ã»éçºç³»ïŒè¶³å ŽåºãïŒ CLF â SAA â DVA â DOP â SOA ãŸãã¯åŸæãªDevOpsåšããåºããå¢ããã€ããŸããã 2. ãã¬ã³ãã»ããŒã¿ç³»ïŒæ»ãã®å§¿å¢ïŒ DEA â AIF â MLS â MLA æ°èšãããããŒã¿ã»AIç³»è³æ Œãäžæ°ã«æ»ç¥ã 3. ã€ã³ãã©ã»å°éç³»ïŒæé£é¢ã®å£ïŒ ANS â SCS â SAP æé£é¢ã®ãããã¯ãŒã¯ïŒANSïŒããããŠåŸåã«ã æåŸã¯é倧æãšããŠã©ã¹ãã¹çååšã®SAPã§ç· ããŸããã å®éã«é§ãæããããŒãããã ã³ãŒã æ£åŒåç§° ã¬ãã« ååååŸæ¥ ã³ã¡ã³ã CLF-C01 AWS Certified Cloud Practitioner Foundational 2023-01-28 AWSã¯ãã SAA-C03 AWS Certified Solutions Architect Associate 2024-02-12 ç©ããã«ååŸ DVA-C02 AWS Certified Developer Associate 2024-06-26 ãŠã©ãŒãã³ã°ã¢ããæé DOP-C02 AWS Certified DevOps Engineer Professional 2024-12-20 èŠé SOA-C02 AWS Certified SysOps Administrator Associate 2025-01-10 ããããRTAã¹ã¿ãŒã DEA-C01 AWS Certified Data Engineer Associate 2025-01-25 ãâ AIF-C01 AWS Certified AI Practitioner Foundational 2025-01-29 ãâ MLS-C01 AWS Certified Machine Learning Specialty 2025-02-06 ãâ MLA-C01 AWS Certified Machine Learning Engineer Associate 2025-02-13 ãâ ANS-C01 AWS Certified Advanced Networking Specialty 2025-02-26 ãâ SCS-C02 AWS Certified Security Specialty 2025-03-05 ãâ SAP-C02 AWS Certified Solutions Architect Professional 2025-03-17 ãŽãŒã«ïŒïŒ ååŒ·æ¹æ³ïŒäžçš®ã®ç¥åš çæéäžãæåãããããã«ãå¹çãæåªå
ããŸããã 1. AWS Black Belt (åç»/è³æ) ç¥ããªããµãŒãã¹ã¯ããŸããããå
¬åŒã®ãæ£è§£ããè³ã«å©ã蟌ã¿ãŸãã 2. Udemy (åç»ææ) ç¹ã«æªç¥ã®é åïŒAIããããã¯ãŒã¯ïŒã¯ããã³ãºãªã³ä»ãã®ææã§ãè§Šã£ãæè§Šããæ¬äŒŒäœéšããŸããã 3. ãªã³ã©ã€ã³åé¡é ã詊éšã®åããé€ãããã«ãä»äžããšããŠæ°åšãééããéšåã¯å
¬åŒããã¥ã¡ã³ãã«æ»ã£ãŠåŸ¹åºçã«æœ°ããŸããã ææŠäžã«æãããå
ãšåœ±ã èŠããã£ãããšïŒæé£é¢ãããã¯ãŒã¯ã®å£ äžçªããã©ãã£ãã®ã¯ããã¯ãANSïŒãããã¯ãŒã¯ïŒã§ãã éçºãããŠãããšäžå
·åã®åå ãšããŠç«ã¡ã¯ã ããããšããããããã¯ãŒã¯ã§ãããå®åã§äœ¿ã£ãããšã®ãªã现ãããµãŒãã¹ä»æ§ã«ã¯æ¬åœã«èŠæŠããŸããã ãŸããMLAïŒæ©æ¢°åŠç¿ãšã³ãžãã¢ïŒãæ®æ®µã®æ¥åãšè·é¢ããã£ããããæ ¹æ°åŒ·ãåç»ãšåé¡éãåŸåŸ©ããæ¥ã
ã§ããã æ¥œããã£ãããšïŒã¢ãŒããã¯ãã£ã®äžè¯é¡ éã«äžçªæ¥œããã£ãã®ã¯ã詊éšãéããŠèšå€§ãªã¢ãŒããã¯ãã£äºäŸã«è§Šããããããšã§ãã æ®æ®µã¯ç¹å®ã®åºå¹¹ã·ã¹ãã ãèŠãããšãå€ãã®ã§ãããå€çš®å€æ§ãªæ§æãåŠã¶ã®ã¯æ°é®®ã§ããAWSãªããããªè§£æ±ºçãããã®ãïŒããšããã ãã ã¯ã¯ã¯ã¯ããŸãããäœèšã«AWSã奜ãã«ãªããŸããã ããŸã æåŸã«ã¡ãã£ãšã ãèªæ
¢ãããŠãã ããïŒ 12åãã®è©Šéšãä¹ãè¶ãããè€çŸã«ãAWS Summit2025ã§ååŸããè³æ Œã®ã·ãŒã«ãããã ããŠããŸããïŒïŒãã¶ã€ã³å¥œããããŠé¡çžã«å
¥ããŸãããïŒ æRPGã倧奜ãã§ããããã®ã·ãªãŒãºããã£ãŠããã®ã§ããããŸããAWSã®è³æ Œã·ãŒã«ãRPG颚ãªã㊅ïŒïŒãããçµµã®ãã£ã©ã¯ã¿ãŒã䞊ãã§ããã®ãèŠãã ãã§ããã³ã·ã§ã³ãäžãããŸããããããŠç©ççãªåœ¢ã«ãªããšãé 匵ã£ãŠããã£ããªïœãšæ¹ããŠå®æããŸãã ç·è©ïŒå
šå ãååŸããŠå€ãã£ãããš 2æãã3æã®ã©ã¹ãã¹ããŒãã¯ãæ£çŽãããããã«ãªãç¬éããããŸããã ã§ããã1ã€åæ Œãããã³ã«ãèªåã§ãã§ãããã ããšããèªä¿¡ãç©ã¿éãªããæåŸã¯ æ©ã次ã®è©ŠéšãåãããïŒ ãšããã©ã³ããŒãºãã€ã«è¿ãç¶æ
ã«ãªã£ãŠããŸããïŒç¬ïŒã å
šå ãéæããŠåŸãããã®ã¯ãåãªãç§°å·ã ãã§ã¯ãããŸããã AWSãšãã巚倧ãªããºã«ã®å
šäœå ãèŠããããã«ãªã£ãããšã§ãã¢ãŒããã¯ããšããŠèªä¿¡ãæã£ãŠææ¡ãã§ããããã«ãªããŸããã ããããå®åçµéšãå°ãªãããããšè¿·ã£ãŠããæ¹ããããããã²äžæ©èžã¿åºããŠã¿ãŠãã ãããè³æ ŒååŸã®éçšã§åŸãããç¥èã¯ãå¿
ãçŸå Žã§ã®ããªãã®æŠåšã«ãªããŸãã æåŸãŸã§èªãã§ããã ãããããšãããããŸããïŒ 2025 ALL AWS Certifications Engineers ã®åã«æ¥ãã¬ãããããããã粟é²ããŸãïŒ P.S.å¢ããã®ãŸãŸã«ãå®ã¯ãAWS Certified Generative AI Developer – Professionalãã®ããŒã¿çãçªæããEarly Adopterãããžãããã£ãŠããŸãããæ°åãæ¹§ãããããã¡ãã®èšäºãæžãâŠãããããŸããã
ããã«ã¡ã¯ãQAãšã³ãžãã¢ã®ãªããã§ãã æ¥ã
ãœãããŠã§ã¢å質ãšåãåã£ãŠããè¥æãšã³ãžãã¢ã®çãããæšä»ããçæAIããšããèšèãèããªãæ¥ã¯ãªãã§ãããã å
æ¥ãçæAIæ¬ã®ãã¹ãã»ã©ãŒ ã çæAIã§äžçã¯ããå€ãã ã ïŒä»äºç¿å€ªèïŒSB CreativeïŒãèªãã§ã¿ãŸãããæ³åãè¶
ããé床ã§AIã®ã€ã³ãã¯ãã¯ç€ŸäŒå
šäœã«åãã§ããŸãããç§ãã¡ãœãããŠã§ã¢éçºã®çŸå Žãç¹ã«ããœãããŠã§ã¢ãã¹ããã®é åã¯ãä»ãŸãã«å€é©æã®å
¥ãå£ã«ç«ã£ãŠãããšæããŸããã ãAIããã¹ãã±ãŒã¹ãèªåã§äœã£ãŠããããªãããšã³ãžãã¢ã®ä»äºã¯ãªããªãã®ã§ã¯ïŒã ãããªäžå®ãçåãæããŠããæ¹ãå°ãªããªããããããŸããã ããããçµè«ããèšãã°ãä»äºã¯ããªããªããŸãããã ãã ãããã®ã質ãã¯æ ¹æ¬ããå€ãããŸããæ¬ããã°ã§ã¯ãçæAIããœãããŠã§ã¢ãã¹ããã©ãå€é©ããç§ãã¡ãšã³ãžãã¢ãç¹ã«è¥æãšã³ãžãã¢ã®æ¹ã
ãä»åŸã©ã®ãããªã¹ãã«ã身ã«ã€ããã¹ãããèå¯ããŠãããŸãã ãªãä»ããœãããŠã§ã¢ãã¹ãããå€é©æããªã®ã IPAïŒæ
å ±åŠçæšé²æ©æ§ïŒã瀺ãããã«ããœãããŠã§ã¢ãã¹ãã¯éçºããã»ã¹ã«ãããŠãå質ã®äœã蟌ã¿ããšãå質ã®ç¢ºèªããæ
ããæ¥µããŠéèŠãªå·¥çšã§ããïŒåè: IPA ãœãããŠã§ã¢ãã¹ãïŒ â»1 åŸæ¥ã®éçºïŒäŸãã°Våã¢ãã«ïŒã«ãããŠããã¹ãå·¥çšã¯å€ãã®å·¥æ°ãšã³ã¹ããèŠããé åã§ããããã¹ãèšèšã®å±äººæ§ããã¹ãã±ãŒã¹ã®ç¶²çŸ
æ§ã®æ
ä¿ãèšå€§ãªãªã°ã¬ãã·ã§ã³ãã¹ãã®å·¥æ°ç¢ºä¿ç ãããã¯ãå€ãã®ãããžã§ã¯ããæ±ããå
±éã®èª²é¡ã§ãã ãŸãã«ä»ããã®é åã«ãçæAIãã¡ã¹ãå
¥ããããšããŠããŸãã çæAIãå¯èœã«ããããšïŒäŸïŒïŒ ãã¹ãã±ãŒã¹ã®èªåçæ: 仿§æžïŒèªç¶èšèªïŒãèªã¿èŸŒãŸããå¢çå€ãåå€åå²ãèæ
®ãããã¹ãã±ãŒã¹ãç¬æã«çæããã ãã¹ãããŒã¿ã®å€æ§å: æ£åžžç³»ã ãã§ãªããç°åžžç³»ããšããžã±ãŒã¹ã®ãã¹ãããŒã¿ã倧éã«çæããã ãã¹ãã³ãŒãã®èªåèšè¿°: E2Eãã¹ããåäœãã¹ãã®ã³ãŒãïŒäŸ: Selenium, JUnitïŒãçæã»ä¿®æ£ããã ãã°å ±åã®åæåæ: ãã°ããšã©ãŒã¡ãã»ãŒãžãAIãåæããåå ã®ããããã€ãããããã°å ±åæžãèªå起祚ãããããã ãªã°ã¬ãã·ã§ã³ãã¹ãã®æé©å: ã³ãŒãã®å€æŽç®æãè§£æãã圱é¿ç¯å²ãç¹å®ãå®è¡ãã¹ããã¹ãã±ãŒã¹ãæå°éã«çµã蟌ãã ããããå®çšã¬ãã«ã«ãªãã°ããã¹ãã«ãããå·¥æ°ãæéã¯åçã«æžå°ããã§ãããããã¯ãããã¹ãã¯äœæ¥å·¥æ°ã§é 匵ããã®ããšããæä»£ã¯çµãããåãã çæAIã®æŽ»çšãåæãšããæ°ãããã¹ãããã»ã¹ ãäž»æµã«ãªããããããç§ãã¡ããå€é©æããšåŒã¶çç±ã§ãã â»1 IPA ç¬ç«è¡æ¿æ³äºº æ
å ±åŠçæšé²æ©æ§ æ°ããèŠç¹ïŒAIæä»£ã«ãæ¬åœã«ãæ±ããããã¹ãã«ãšã¯ïŒ èŠç¹ãå€ããŠã¿ãŸãããããã¹ãäœæ¥ã®å€ããAIãæ
ãããã«ãªã£ããããšã³ãžãã¢ã®äŸ¡å€ã¯ã©ãã«ããã®ã§ããããïŒ ããã§ãäžã€ã®éèŠãªèŠç¹ããããŸããããã¯ã ãçæAIãæŽ»çšããããã«ã¯ãåºç€çãªããžãã¹ãªãã©ã·ãŒããããã以åããéèŠã«ãªãããšããé説çãªäºå®ã§ãã çæAIã¯ãäžèœã®éæ³ãã§ã¯ãããŸãããAIã¯ãæç€ºãããããšãããã§ããŸããã ãããŠããã®æç€ºãææ§ã§äžæç¢ºã§ããã°ãAIãçã¿åºãã¢ãŠããããïŒãã¹ãã±ãŒã¹ãã³ãŒãïŒããŸããææ§ã§äœ¿ãç©ã«ãªããªããã®ã«ãªããŸãã ã€ãŸããç§ãã¡ãç²åŸãã¹ãæ°ããç¥çã¹ãã«ãšã¯ã以äžã®3ã€ã«éçŽãããŸãã 1. é«åºŠãªã仿§èªè§£åããšãèŠä»¶å®çŸ©èœåã AIã«ç確ãªãã¹ãã±ãŒã¹ãçæãããããã«ã¯ã ãšã³ãžãã¢èªèº«ãããã®æ©èœã®ãèŠä»¶ããšã仿§ããå®ç§ã«çè§£ããŠãã å¿
èŠããããŸãã ããã®æ©èœã®ç®çã¯äœãïŒæç€ºçãæç€ºçãªæå³ã¯äœãïŒã ããŠãŒã¶ãŒã«ãšã£ãŠã®æ¬åœã®äŸ¡å€ã¯ã©ãã«ããã®ãïŒã ã仿§æžã®ãã®äžæã®ãè¡éãã«é ãããæé»ã®åææ¡ä»¶ã¯ã©ãã«ããã®ãïŒã èŠä»¶ãæ·±ãçè§£ããAIãè§£éã§ããæç¢ºãªèšèïŒããã³ããïŒã«èœãšã蟌ãèœåã ããããããAIæä»£ã®ãã¹ããšã³ãžãã¢ã«æ±ããããã¡ã€ã³ã¹ãã«ã§ãã ææ§ãªãã¹ã仿§æžãæž¡ãããŠãããšã¯AIããããããããã¯æç«ããŸããã AIã䜿ãããªãåæãšããŠã人éã®æ¬è³ªçãªèœåãšç¥èŠãæ·±ãæŽå¯åãåãããã®ã§ãã 2. ãè«ççæèãã«åºã¥ããã¹ãèšèšèœå AIãäœåãã®ãã¹ãã±ãŒã¹ãçæãããšããŠããã®åŠ¥åœæ§ã誰ã倿ããã®ã§ããããïŒ ãç¶²çŸ
æ§ãã«ãã¬ããžã¯ååãïŒã ãéèŠãªèгç¹ïŒã»ãã¥ãªãã£ãããã©ãŒãã³ã¹ããŠãŒã¶ããªãã£ïŒãæããŠããªããïŒã ãAIãâèŠèœãšããŠããã±ãŒã¹ã¯ãªããïŒå°æ¥ã®æœåšãªã¹ã¯ã¯ãªããïŒã ãããã倿ããã«ã¯ãåºæ¬ä»æ§ã®çè§£ããã¹ãèšèšã®åçååïŒåå€åå²ãå¢çå€åæãç¶æ
é·ç§»ãªã©ïŒãæ·±ãçè§£ããäžã§ã®ãè«ççãªæèåããäžå¯æ¬ ã§ãã AIã¯ãäœæ¥ãèªäœã¯é«éåããŸããããåºæ¬èšèšã®ææ³ãããå質ä¿èšŒããæ
ä¿ããŠãããããã§ã¯ãããŸãããAIã®åºåãéµåã¿ã«ãããã¯ãªãã£ã«ã«ã«è©äŸ¡ãããã¹ãæŠç¥å
šäœãèšèšãããç¥çã¢ãŒããã¯ãã£ããšããŠã®åœ¹å²ãéèŠã«ãªããŸãã 3. åºç€çãªãèªã¿æžãèœåã ããã§ãããèªã¿æžãèœåããšã¯ãèšèªååãã®ãã®ã§ãã æžãå: AIãžã®çç¢ºãªæç€ºïŒããã³ãããšã³ãžãã¢ãªã³ã°ïŒãã¹ããŒã¯ãã«ããŒïŒéçºè
ãPMïŒãžã®æçãªãã°å ±åãAIãçæããããã¥ã¡ã³ãã®æ ¡æ£ã èªãå: èšå€§ãªä»æ§æžã®æ¬è³ªãæŽãèªè§£åãAIã®çæç©ãè¿
éã«ã¬ãã¥ãŒããèœåã çµå±ã®ãšãããç§ãã¡ã®ä»äºã¯ãèšèãã§æãç«ã£ãŠããŸããAIãšããæ°ããâ仲éâãšæ£ç¢ºã«ã³ãã¥ãã±ãŒã·ã§ã³ãåãããããžã§ã¯ããåæ»ã«é²ããããã®ãèªã¿æžãèœåãã®éèŠæ§ã¯ããã€ãŠãªãã»ã©é«ãŸã£ãŠãããšèããŸãã ãŸãšãïŒå€é©ãä¹ãããªããæ°ãã䟡å€ãçã¿åºãAIãã¹ããšã³ãžãã¢ãž çæAIã®ç»å Žã«ãããããœãããŠã§ã¢ç£æ¥ãå
šäœãææ¬çã«å€ããããšã¯ééããããŸãããç¹ã«ããœãããŠã§ã¢ãã¹ãã®çŸå Žã¯ããã®åœ±é¿ãæã匷ãåããé åã®äžã€ã§ãã ãã¹ããšã³ãžãã¢ã®åœ¹å²ã¯ããæãåãããŠãã¹ããå®è¡ãã人ãããããAIãé§äœ¿ããŠãå質ã¬ãã«ãã©ã®ããã«é«ããŠãã©ãä¿èšŒããããèšèšã»å€æã»è©äŸ¡ãã人ããžãšã·ããããŠããã§ãããã ããããå€é©ã®äžã§ãå®éã®ãã¹ãçŸå Žã§ãæ°ããAIé§ååã®ãœãªã¥ãŒã·ã§ã³ãç»å Žãå§ããŠããŸãã äŸãã°ãAGESTãå±éããæ¬¡äžä»£AIãã¹ãããŒã«ãTFACTãã®ããã«ãçæAIã®åããã¹ãã®æšæºããã»ã¹ã«çµã¿èŸŒãã AIãã©ãããã©ãŒã ããã®äžã€ã§ãã â AGEST AIãã¹ã管çããŒã« ïœ TFACT èªåŸèµ°è¡åAIãœãªã¥ãŒã·ã§ã³ã¯ãç§ãã¡ã®ãã¹ãããã»ã¹ãåçã«å¹çåããŠããã匷åãªããŒãããŒãšãªãåŸãŸãã ãããŠãAIã«æå³éãã®ãã¹ããè¡ãããããã«ã¯ãææ§ããæé€ãããæ£ç¢ºãªèšèãã§è¡šçŸããåãäžå¯æ¬ ã§ããããŒã«ãé²åããã°ããã»ã©ããã®ããŒã«ãææ®ãã人éã®ãèšèªåèœåãããè«ççæèãã®äŸ¡å€ã¯ãããé«ãŸãã®ã§ãã è¥æãšã³ãžãã¢ãžã®ãšãŒã« è¥æãšã³ãžãã¢ã®çããã«ãšã£ãŠããã®å€é©ã¯ãè
åšãã§ã¯ãªãããããããã£ã³ã¹ãã§ãããªããªããããã©ã³ãšã³ãžãã¢ãé·å¹Žã®çµéšã§å¹ã£ãŠãããçµéšãããåãã®äžéšãAIãè£å®ããè¥æãšã³ãžãã¢ã¯æ°ããçºæ³ãšAIããŒã«ã§åè² ã§ãããããªã®ã§ãã ä»ã身ã«ã€ããã¹ãã¯ãç¹å®ã®ããŒã«æäœã§ã¯ãªãã 1. 仿§ãæ·±ãèªã¿è§£ãåã 2. ç©äºãè«ççã«èããåã 3. èŠä»¶ãæ·±ãçè§£ãæ£ç¢ºãªèšèã§è¡šçŸãATã«ç確ãªããã³ãããå®çŸ©ã§ããåã ãšãããæ¥µããŠãåºç€çãã§ãæ®éçããªã¹ãã«ã§ãã ãã®AIå€é©ã®æ³¢ãæãããAIãšãã匷åãªä»²éã䜿ãããªãããœãããŠã§ã¢ã®åè³ªãæ¯ãããããã§ãã·ã§ãã«ãšããŠãå
±ã«æªæ¥ã«åããŠæé·ããŠãããŸãããã ãããã£ãŒã«ïŒ QAãšã³ãžãã¢ãªãã åäžçŽã¯äž»ã«å€§ææºåž¯éä¿¡äºæ¥è
ã®æµ·å€ïŒç±³åœã»è±åœã»ã€ã³ãïŒæ°èŠäºæ¥éçºãããžã£ãŒãšããŠåŸäºã ä»äžçŽã¯ãäž»ã«èªåè»åãã³ãã¯ãããã«ãŒã®äŒç»ã³ã³ãµã«ãã£ã³ã°ãéçºå®åã®æ¯æŽãå®è£
ãã¹ãé¢é£ã®PMãçµéšãè¿å¹Žã¯å¹
åºãäŒæ¥ã¯ã©ã€ã¢ã³ãåãQAã³ã³ãµã«ã¿ã³ããšããŠæŽ»åäžã The post çæAIã¯ãœãããŠã§ã¢ãã¹ããâç Žå£âããã®ãïŒÂ ãŒÂ è¥æãšã³ãžãã¢ãåããã¹ããå€é©ããšãæ°ããã¹ãã«ã first appeared on Sqripts .
ã¯ããã« Amazon OpenSearch Service ã䜿çšãããã¯ãã«æ€çŽ¢ã§ã¯ exact k-NN ããã㯠Approximate k-NN ã䜿çšãããŸããexact k-NNã§ã¯ç·åœããçã«è¿åãæ¢çŽ¢ããããšã«ããæãæ£ç¢ºãªæ€çŽ¢ãå¯èœã§ããããã¯ãã«ããŒã¿æ°ã«å¯ŸããŠç·åœ¢ã«å®è¡æéãå¢ãããããå€§èŠæš¡ãªããŒã¿ã»ããã«å¯ŸããŠã¯æ·±å»ã«ããã©ãŒãã³ã¹ãæªåããå¯èœæ§ããããŸããäžæ¹ã§ Approximate k-NN ã¯ç²ŸåºŠãäžå®èœãšã代ããã«é«éãªæ€çŽ¢ãå®çŸããææ³ã§ããAmazon OpenSearch Service ã«ãããŠå©çšã§ããApproximate k-NNã¢ã«ãŽãªãºã çšã®ãã¯ãã«æ€çŽ¢ãšã³ãžã³ã¯äž»ã« FAISS ãš Lucene ããããFAISS ãšã³ãžã³ã«ã¯ã¢ã«ãŽãªãºã ãšã㊠HNSW ãš IVF ããããŸã( åè )ã æ¬ããã°ã§ã¯ãFAISS ãšã³ãžã³ã䜿çšãããã¯ãã«æ€çŽ¢ã«ãããŠã æ°èŠãã¯ãã«ããŒã¿ã®æå
¥ãäžå®å®ããŸãã¯å€±æããå Žå ã®åå 調æ»ããã³å¯ŸåŠæ³éžæã®èãæ¹ã«ã€ããŠèª¬æããŸãã ã·ããªãªïŒæ°èŠãã¯ãã«ããŒã¿ã®æå
¥ãäžå®å®ããŸãã¯å€±æãã äžåºŠãã¯ãã«ããŒã¿ããŒã¹ã®ã»ããã¢ãããå®äºãåé¡ãªã皌åããŠãããšããŠããæ€çŽ¢å¯Ÿè±¡ãšãªãããã¥ã¡ã³ãæ°ãå¢ãããã䜿çšãããŠãŒã¶ãŒæ°ãå¢å ããŠãããšæ§ã
ãªãã©ãã«ãçºçããå¯èœæ§ããããŸããOpenSearch Service ã«ããããã©ãã«ã¯ã€ã³ã¹ã¿ã³ã¹ã¿ã€ãã®å¢åŒ·ã«ããã¹ã±ãŒã«ã¢ãããããŒãæ°è¿œå ã«ããã¹ã±ãŒã«ã¢ãŠããããããšã§è§£æ±ºã§ããããšã¯å€ãã§ãããäœããã®ãã©ãã«ã«å¯ŸããŠåå 調æ»ãè¡ããã³ã¹ãã粟床ãã¬ã€ãã³ã·ãŒãšãã£ãèŠçŽ ã®ãã¬ãŒããªããçè§£ããäžã§é©åãªå¯ŸåŠææ³ãéžæããŠããããšã¯ OpenSearch Service ãæå¹æŽ»çšããŠããäžã§éåžžã«éèŠã§ãã FAISS ãšã³ãžã³ã«ããããã¯ãã«æ€çŽ¢ã䜿çšããå Žåã®ãã©ãã«ã®äžã€ãšããŠãæ°èŠãã¯ãã«ããŒã¿ã®æå
¥ãäžå®å®ã ã£ããã倱æããå ŽåãèããããŸããæ¬¡å
æ°ã®å€ããã¯ãã«ããŒã¿ã Bulk API ãªã©ã§æå
¥ããå Žåãã€ã³ãã¯ã·ã³ã°ã«èŠããè² è·ã¯å€§ãããªããã¡ã§ããç¹ã«ããã¯ãã«æ€çŽ¢ãé«éåããããã®ã°ã©ãæ§é ãä¿æããã¡ã¢ãªã®ãããªãªãœãŒã¹ã®ãã£ãã·ãã£æ¯æžãåé¡ã«ãªãããšãå€ãã§ãã 調æ»ããã³å¯ŸåŠæ³éžæã®å€§ãŸããªæµãã¯ä»¥äžã«ããã«ãªããŸãã æ°èŠãã¯ãã«ããŒã¿ã®æå
¥ãäžå®å®ããŸãã¯å€±æããå Žåã®å¯ŸåŠæ³éžæ ãã¯ãã«æ€çŽ¢ãè¡ãéã«ãã°ãã°åé¡ã«ãªãã®ãã¡ã¢ãªç®¡çã§ããæ°èŠãã¯ãã«ããŒã¿ã®æå
¥ããããã¯ãããå Žåã䜿çšã¡ã¢ãªãµã€ãºå¢å ã«äŒŽããµãŒããããã¬ãŒã«ãŒãçºåããŠããå¯èœæ§ããããŸããOpenSearch èªäœã¯ Java ã«ããå®è£
ãããŠãããããã©ã«ãã§ã¯ãåããŒããæã£ãŠããã¡ã¢ãªé åã® 50% ã 32GB ã®å€§ããæ¹ã JVM ããŒããšããŠäœ¿çšãããŸããæ®ãã®é åããã€ãã£ãã¡ã¢ãªãšããŠãOS ããã¡ã€ã«ã·ã¹ãã ãã£ãã·ã¥ããã㊠k-NN ãã¯ãã«ã®æ€çŽ¢çšã¡ã¢ãªãšããŠäœ¿çšãããããšã«ãªããŸãã OpenSearchãã¯ãã«æ€çŽ¢ã«ãããã¡ã¢ãªç®¡ç åå 調æ»1.1: KNNGraphMemoryUsage ã«ãããã€ãã£ãã¡ã¢ãªäœ¿çšç¶æ³ã®èª¿æ» ãã¯ãã«æ€çŽ¢ãè¡ãéã«ãã°ãã°åé¡ã«ãªãã®ãã¡ã¢ãªç®¡çã§ããæ°èŠãã¯ãã«ããŒã¿ã®æå
¥ããããã¯ãããå Žåã䜿çšã¡ã¢ãªãµã€ãºå¢å ã«äŒŽããµãŒããããã¬ãŒã«ãŒãçºåããŠããå¯èœæ§ããããŸããOpenSearch èªäœã¯ Java ã«ããå®è£
ãããŠãããããã©ã«ãã§ã¯ãåããŒããæã£ãŠããã¡ã¢ãªé åã®50%ã 32GB ã®å€§ããæ¹ã JVM ããŒããšããŠäœ¿çšãããŸããæ®ãã®é åããã€ãã£ãã¡ã¢ãªãšããŠãOS ããã¡ã€ã«ã·ã¹ãã ãã£ãã·ã¥ããã㊠k-NN ãã¯ãã«ã®æ€çŽ¢çšã¡ã¢ãªãšããŠäœ¿çšãããããšã«ãªããŸãã CloudWatch ã¡ããªã¯ã¹ãåç
§ããŠãããŒã¿ããŒãã«ããã KNNGraphMemoryUsage ããã㯠KNNGraphMemoryUsagePercentage ãåç
§ããããšã§ããã€ãã£ãã¡ã¢ãªã®ãã¡ã©ã®çšåºŠããã¯ãã«ã°ã©ããå æããŠãããã¢ãã¿ãªã³ã°ããããšãã§ãã倧ããªãã¯ãã«ããŒã¿ãæ±ã£ãŠããå Žåéåžžã«éèŠãªãã¡ã€ã³ãµã€ãžã³ã°ã®ææšã«ãªããŸãã ç¹ã« FAISS ãšã³ãžã³ã§ HNSW ã®ã€ã³ããã¯ã¹ãäœæããŠããå Žåãæ€çŽ¢ãé«éåãããããã¯ãã«ããŒã¿æå
¥æã«ã°ã©ãæ§é ãæ§ç¯ãããŸããæ€çŽ¢ã¯ãšãªãå®è¡ãããéãããã㯠Warm-up API ãåŒã°ããéã«ãã®ã°ã©ãã¯ãã€ãã£ãã¡ã¢ãªã«ããŒããããŸãããã°ã©ãã®ããŒã¿ãµã€ãºã倧ãããªããšäžèšã® k-NN çšãã€ãã£ãã¡ã¢ãªãµã€ãºãè¶
éãããµãŒããããã¬ãŒã«ãŒãçºåããå¯èœæ§ããããŸããããã«äŒŽããã€ã³ããã¯ã¹ã¯æ°èŠãã¯ãã«ããŒã¿ã®æå
¥ããããã¯ããããã«ãªããŸãã ãµãŒããããã¬ãŒã«ãŒãçºåããã¡ã¢ãªãµã€ãºã«é¢ããŠã¯ã knn.circuit_breaker.limit ïŒããã©ã«ã 50%ïŒã«èšå®ãããŠããããã®å€ã«å¯ŸããŠäžèšã¡ããªã¯ã¹ãç¶äºãæã£ãŠããå¿
èŠããããŸãã åããŒãã® k-NN ã«é¢ããçµ±èšæ
å ±ã¯ä»¥äžã®ã³ãã³ãã«ãã£ãŠãååŸããããšãå¯èœã§ãããµãŒããããã¬ãŒã«ãŒã«ããããŒã¿æå
¥ããããã¯ãããŠããå Žåãã¬ã¹ãã³ã¹ã«å«ãŸãã circuit_breaker_triggered ã®å€ã true ã«ãªããŸãã GET /_plugins/_knn/stats ãã®ã·ãã¥ãšãŒã·ã§ã³ã«ãããŠããã¯ãã«ã°ã©ãã«ããã¡ã¢ãªäœ¿çšãåæžããããããã¯ã¡ã¢ãªãå¢åŒ·ãã察å¿ãå¿
èŠã«ãªããŸãã åå 調æ»1.2ïŒFreeStorageSpace ã«ãããã£ã¹ã¯å®¹éã®ç¢ºèª CloudWatch ã¡ããªã¯ã¹ã®äžã€ã§ããã FreeStorageSpace ãåç
§ããããšã§ãOpenSearch Service ã«ãããåããŒããã©ã®çšåºŠã®ã¹ãã¬ãŒãžæ®éããããã調æ»ããããšãã§ããŸãã OpenSearch Service ã¯åããŒã¿ããŒãã®ã¹ãã¬ãŒãžã® 20%ïŒæå€§ 20 GiBïŒããã»ã°ã¡ã³ãããŒãžããã°ãªã©ã®å
éšæäœçšã«ãããããäºçŽããŠããŸããCloudWatch ã¡ããªã¯ã¹ã® FreeStorageSpace ã¯ãã®äºçŽåãå·®ãåŒããåŸã®æ®éã瀺ããããOpenSearch ã® _cluster/stats ã _cat/allocation API ãè¿ãå€ãããåžžã«äœãå€ã«ãªããŸãã ã¹ãã¬ãŒãžä¿è·ã®èгç¹ã§ã¯ãããããã®ããŒãã®ç©ºã容éããå©çšå¯èœã¹ãã¬ãŒãžã® 20%ããŸãã¯ã20 GiBãã®ãã¡å°ããæ¹ãäžåã£ãæç¹ã§ãæžãèŸŒã¿æäœããããã¯ããŸãïŒ ClusterBlockException ïŒããããã¯æ©æ§ã¯ãOSS ã® OpenSearch ãæã€ disk watermark ïŒlow: 85%ãhigh: 90%ãflood_stage: 95%ïŒãããå
ã«çºåããã®ãäžè¬çã§ãã FreeStorageSpace ã¡ããªã¯ã¹ãç£èŠããCloudWatch ã¢ã©ãŒã ãèšå®ããããšã§ããããã¯çºçåã«ã¹ãã¬ãŒãžéŒè¿«ãæ€ç¥ã§ããŸãã 察åŠ1.1ïŒéåå OpenSearchã«ããããã¯ãã«ã¯ knn_vector åã®32ãããæµ®åå°æ°ç¹é
åãšããŠä¿åãããŸãããããããããããŒã¿éã®å°ããªãã¯ãã«ã«å§çž®ããã¢ãããŒãã§ãã以äžã®4ã€ã®éååææ³ããµããŒãããŠããŸããããå§çž®åºŠã®é«ãéååã¯æ€çŽ¢ã®ç²ŸåºŠãèœãšãå¯èœæ§ããããŸãããã¡ã¢ãªäœ¿çšéã®åæžã ãã§ãªããæ€çŽ¢ããã©ãŒãã³ã¹ã®åäžããã£ã¹ã¯äœ¿çšéã®åæžã«ãã€ãªãããŸãã粟床èŠä»¶ã«äœè£ããããæ€çŽ¢é床ãç¶æãããã¯é«éåããäžã§ã¡ã¢ãªå¹çåãè¡ãããå Žåæçšãªææ³ã§ãã 詳现ã«é¢ããŠã¯ ãã¡ã ã®ããã°ãåç
§ãã ããã ã¹ã«ã©ãŒéåå (Scaler Quantization) ãã€ããªéåå ãã¯ãã«ã®å次å
ã 1 ãããïŒ-1 ãŸã㯠+1ïŒã§è¡šçŸããæãå§çž®çã®é«ãéååææ³ãæå€§ 32 åãšå€§å¹
ã«ã¡ã¢ãªãã¹ãã¬ãŒãžäœ¿çšéãäœæžã§ããŸããã粟床ã®äœäžãæã倧ãããªããŸãã ãã€ãéåå 忬¡å
ã 8 ãããæŽæ°ïŒint8ïŒã§è¡šçŸããå
ã®æµ®åå°æ°ç¹æ°ã 256 段éã«éååããææ³ãã¡ã¢ãªãçŽ 1/4 ã«åæžãã€ã€ãæ¯èŒçé«ã粟床ãç¶æã§ãããã©ã³ã¹ã®è¯ãæ¹åŒã§ãã FP16éåå 32 ãããæµ®åå°æ°ç¹æ°ïŒFP32ïŒã 16 ãããæµ®åå°æ°ç¹æ°ïŒFP16ïŒã«å€æããææ³ãã¡ã¢ãªãååã«åæžãã粟床ã®å£åãå°ãªããããé«ç²ŸåºŠãæ±ããããçšéã«é©ããŠããŸãã çŽç©éååïŒProduct QuantizationïŒ ãã¯ãã«ãè€æ°ã®ãµããã¯ãã«ã«åå²ããåãµããã¯ãã«ãç¬ç«ã«ã¯ã©ã¹ã¿ãªã³ã°ããŠã³ãŒãããã¯ã§è¡šçŸããææ³ãæå€§ 64 åãšé«ãå§çž®çãšé«éãªæ€çŽ¢ãäž¡ç«ã§ããå€§èŠæš¡ãã¯ãã«æ€çŽ¢ã§ãã°ãã°äœ¿çšãããŸãããå©çšã«ãããäºåã®ãã¬ãŒãã³ã°ãå¿
èŠã«ãªããŸãã 察åŠ1.2ïŒMemory Optimized Search (察象ïŒHNSWãããŒãžã§ã³3.1+) Lucene ãšã³ãžã³ãš FAISS ãšã³ãžã³ã®ãã€ããªããã¢ãããŒããè¡ãããšã§ããã¯ãã«ã°ã©ãã®å
šãŠãã¡ã¢ãªã«èŒããããšãªãæ€çŽ¢ãå®è¡ããããšãå¯èœã§ããæ°% ã® Recall ããã³ã¹ã«ãŒãããã®äœäžãçããå¯èœæ§ããããŸããã3ã4 åã®ã¡ã¢ãªäœ¿çšéåæžã®å¯èœæ§ããããŸãããã®ææ³ã䜿çšããå Žåãã°ã©ãã®äžéšãèŒããã¡ã¢ãªãšã㊠OS ããŒãžãã£ãã·ã¥ã䜿çšããããã KNNGraphMemoryUsage ã¯å¢å ããŸããã ãã³ãããŒãã³ã°ãªã©ã¯ ãã¡ã ã®ããã°ããåç
§ãã ããã以äžã®ããã«ã knn.memory_optimized_search ãèšå®ããããšã«ããæå¹åã§ããŸãããã®ææ³ã®ç¹åŸŽãšããŠãindex åäœã§æå¹åããå Žå㯠reindex ãå¿
èŠãªãããšãæããããŸããindex ã®èšå®ã®ã¿ã§æå¹åã§ããã®ã§æè»œã«ã¡ã¢ãªäœ¿çšéåæžãå¯èœã§ãã PUT /<index-name> { "settings" : { "index.knn": true, "index.knn.memory_optimized_search" : true }, "mappings": { <index-fields> } } 察åŠ1.3ïŒ Disk mode (察象ïŒããŒãžã§ã³2.17+) ãã£ã¹ã¯ããŒã¹ã®ãã¯ãã«æ€çŽ¢ã§ã¯ãéååãããã¯ãã«ã®ã¿ãã¡ã¢ãªã«ä¹ããµã³ããªã³ã°ãè¡ãããã£ã¹ã¯äžã®å®å
šãªç²ŸåºŠã®ãã¯ãã«ã§ãªã©ã³ã¯ãè¡ãææ³ã§ããéååã®å§çž®çãéžæããããšã«ãããã¡ã¢ãªã«èŒãããã¯ãã«ããŒã¿ã®ãµã€ãºãæå€§ 32 åäœæžããããšãã§ããŸããã粟床ã®äœäžã¯æå°éã«æããããšãå¯èœã§ãã æ€çŽ¢é床ã®äœäžã蚱容ã§ããã¯ãŒã¯ããŒãã§ããã€ã€ã粟床ã®äœäžãããããŠæå€§éã®ã¡ã¢ãªå¹çãå®çŸãããå Žåæçšãªææ³ã§ãã 以äžã®ããã«ã knn_vector ã®ãã£ãŒã«ãã® mode ã on_disk ã«èšå®ããããšã§æå¹åã§ããŸããéååã®å§çž®ç㯠compression_level ãšããŠæå®ããããšãã§ããFAISS ãšã³ãžã³ã§ã¯ 1x ã 2x ã 8x ã 16x ã 32x ãéžæå¯èœã§ãã PUT /<index-name> { "settings" : { "index": { "knn": true } }, "mappings": { "properties": { "my_vector_field": { "type": "knn_vector", "dimension": 8, "space_type": "innerproduct", "data_type": "float", "mode": "on_disk", "compression_level": "16x" } } } } 察åŠ1.4ïŒEBSããªã¥ãŒã ã®è¿œå OpenSearch Service ã«ãããããŒã¿ããŒãã¯ã¹ãã¬ãŒãžãšã㊠EBS ããªã¥ãŒã ã䜿çšããŠããŸããããŒã¿ããŒãã®ã¹ãã¬ãŒãžãæ¯æžããéãã¯ã©ã¹ã¿ãŒã®èšå®ããããŒããããã® EBS ã¹ãã¬ãŒãžãµã€ãºã远å ããããšã§éåžžã«ç°¡åã«å¯ŸåŠããããšãã§ããŸããããŒã¿ããŒããããã® EBS ã¹ãã¬ãŒãžã®æå€§ãµã€ãºã¯ 1536 GiB ã§ãã ã¯ã©ã¹ã¿ãŒèªäœã®ããŒã¿ããŒãæ°ãå¢ãããããããŒã¿ããŒãã®ã€ã³ã¹ã¿ã³ã¹ã¿ã€ãããã倧ãããã®ã«å€æŽããã®ã«æ¯ã¹ãŠã³ã¹ãå¹çããæè»œã«ã¹ãã¬ãŒãžæ¯æžã«å¯ŸåŠã§ããææ³ã«ãªã£ãŠããŸãã CLI ã§ã¯ä»¥äžã®ãªãã¬ãŒã·ã§ã³ã«ãã£ãŠèšå®å€æŽå¯èœã§ãã aws opensearch update-domain-config \ --domain-name your-domain-name \ --ebs-options '{ "EBSEnabled": true, "VolumeType": "gp3", "VolumeSize": 1024 }' ãŸãšã æ¬ããã°ã§ã¯ãOpenSearch Service ã«ãã㊠FAISS ãšã³ãžã³ã䜿çšãããã¯ãã«æ€çŽ¢ã¯ãŒã¯ããŒããéçšããŠããéã«çºçããããã©ãã«ãšããŠæ°èŠãã¯ãã«ããŒã¿ã®æå
¥ãäžå®å®ããŸãã¯å€±æããå Žåã«çç®ãããã®åå ç©¶æãšå¯ŸåŠæ¹æ³éžæã®èãæ¹ã«ã€ããŠç޹ä»ããŸããããã®ãã©ãã«èªäœã¯ãã¯ãã«ã°ã©ãã®ã¡ã¢ãªã«èµ·å ããããšãããããOpenSearch ãæäŸããã¡ã¢ãªæé©åææ³ã®äžããé©åãªéžæãè¡ã£ãŠããããšãéèŠã§ãã OpenSearch Service ã®æ©èœã¯ç¶ç¶çã«æ¡å
ãããŠãããããæ°æ©èœã掻çšããããã«ãã¯ã©ã¹ã¿ãŒã®ããŒãžã§ã³ã¢ããã°ã¬ãŒãã宿çã«æ€èšããããšãæšå¥šããŸãã èè
黿š ç¢å€® (Takuo Kuroki) ã¢ããŸã³ãŠã§ããµãŒãã¹ãžã£ãã³ååäŒç€Ÿãœãªã¥ãŒã·ã§ã³ã¢ãŒããã¯ã 2024幎4æå
¥ç€ŸãçŸåštoCã®ITãµãŒãã¹æäŸäŒæ¥ã«ãããã¯ã©ãŠãå
šè¬ã®æè¡æ¯æŽãè¡ãã€ã€ãOpenSearchã®ã³ãã¥ããã£æŽ»åãæ©èœæ¹åã«åãçµãã§ããŸãã


















