Amazon Bedrock 㯠12 æ 4 æ¥ã çæ AI ã¢ããªã±ãŒã·ã§ã³ã®ã³ã¹ããšã¬ã€ãã³ã·ãŒã®åæžã«åœ¹ç«ã€ 2 ã€ã®æ©èœããã¬ãã¥ãŒçã§å°å
¥ããŸããã Amazon Bedrock ã€ã³ããªãžã§ã³ãããã³ããã«ãŒãã£ã³ã° â ã¢ãã«ãåŒã³åºããšãã«ãåãã¢ãã«ã·ãªãŒãºã® åºç€ã¢ãã« (FM) ãçµã¿åãããŠäœ¿çšããããšã§ãå質ãšã³ã¹ããæé©åã§ããããã«ãªããŸãããããšãã°ã Anthropicâs Claude ã¢ãã«ã·ãªãŒãºã§ã¯ãAmazon Bedrock ã¯ããã³ããã®è€éãã«å¿ã㊠Claude 3.5 Sonnet ãš Claude 3 Haiku ã®éã§ãªã¯ãšã¹ããã€ã³ããªãžã§ã³ãã«ã«ãŒãã£ã³ã°ã§ããŸããåæ§ã«ãAmazon Bedrock ã¯ãªã¯ãšã¹ãã Meta Llama 3.1 70B ãš 8B ã®éã§ã«ãŒãã£ã³ã°ã§ããŸããããã³ããã«ãŒã¿ãŒã¯ãå¿çã®è³ªãšã³ã¹ããæé©åããªãããåãªã¯ãšã¹ãã«å¯ŸããŠã©ã®ã¢ãã«ãæé«ã®ããã©ãŒãã³ã¹ãæäŸããããäºæž¬ããŸããããã¯ãåçŽãªã¯ãšãªãããå°ãããããéããããè²»çšå¯Ÿå¹æã®é«ãã¢ãã«ã§åŠçã§ããè€éãªã¯ãšãªããã髿§èœãªã¢ãã«ã«ã«ãŒãã£ã³ã°ã§ããã«ã¹ã¿ããŒãµãŒãã¹ã¢ã·ã¹ã¿ã³ããªã©ã®ã¢ããªã±ãŒã·ã§ã³ã«ç¹ã«åœ¹ç«ã¡ãŸããã€ã³ããªãžã§ã³ãããã³ããã«ãŒãã£ã³ã°ã¯ã粟床ãæãªãããšãªãã³ã¹ããæå€§ 30% åæžã§ããŸãã Amazon Bedrock ã¯ããã³ãããã£ãã·ã¥ããµããŒãããããã«ãªããŸãã â è€æ°ã®ã¢ãã«åŒã³åºãã«ããã£ãŠãé »ç¹ã«äœ¿çšãããã³ã³ããã¹ããããã³ããã«ãã£ãã·ã¥ã§ããããã«ãªããŸãããããã¯ããŠãŒã¶ãŒãåãããã¥ã¡ã³ãã«ã€ããŠè€æ°ã®è³ªåãããããã¥ã¡ã³ã Q&A ã·ã¹ãã ããã³ãŒããã¡ã€ã«ã®ã³ã³ããã¹ãã管çããå¿
èŠãããã³ãŒãã£ã³ã°ã¢ã·ã¹ã¿ã³ããªã©ãåãã³ã³ããã¹ããç¹°ãè¿ã䜿çšããã¢ããªã±ãŒã·ã§ã³ã«ç¹ã«åœ¹ç«ã¡ãŸãããã£ãã·ã¥ãããã³ã³ããã¹ãã¯ãã¢ã¯ã»ã¹ãããã³ã«æå€§ 5 åé䜿çšã§ããŸããAmazon Bedrock ã®ããã³ãããã£ãã·ã¥ã«ããããµããŒããããŠããã¢ãã«ã®ã³ã¹ããæå€§ 90% åæžããã¬ã€ãã³ã·ãŒãæå€§ 85% åæžã§ããŸãã ãããã®æ©èœã«ãããã¬ã€ãã³ã·ãŒãäœæžããããã©ãŒãã³ã¹ãšã³ã¹ãå¹çã®ãã©ã³ã¹ãåãããšã容æã«ãªããŸããããã§ã¯ãããããã¢ããªã±ãŒã·ã§ã³ã§ã©ã®ããã«äœ¿çšã§ããããèŠãŠã¿ãŸãããã ã³ã³ãœãŒã«ã§ã® Amazon Bedrock ã€ã³ããªãžã§ã³ãããã³ããã«ãŒãã£ã³ã°ã®äœ¿çš Amazon Bedrock ã€ã³ããªãžã§ã³ãããã³ããã«ãŒãã£ã³ã°ã¯ãé«åºŠãªããã³ãããããã³ã°ãšã¢ãã«çè§£æè¡ã䜿çšããŠããã¹ãŠã®ãªã¯ãšã¹ãã«ãããåã¢ãã«ã®ããã©ãŒãã³ã¹ãäºæž¬ããå¿çã®è³ªãšã³ã¹ããæé©åããŸãããã¬ãã¥ãŒäžã¯ã Anthropicâs Claude ããã³ Meta Llama ã¢ãã«ã·ãªãŒãºã®ããã©ã«ãã®ããã³ããã«ãŒã¿ãŒã䜿çšã§ããŸãã ã€ã³ããªãžã§ã³ããªããã³ããã«ãŒãã£ã³ã°ã«ã¯ã AWS ãããžã¡ã³ãã³ã³ãœãŒã« ã AWS ã³ãã³ãã©ã€ã³ã€ã³ã¿ãŒãã§ã€ã¹ (AWS CLI) ã AWS SDK ããã¢ã¯ã»ã¹ã§ããŸãã Amazon Bedrock ã³ã³ãœãŒã« ã§ã¯ãããã²ãŒã·ã§ã³ãã€ã³ã® [ åºç€ã¢ãã« ] ã»ã¯ã·ã§ã³ã® [ ããã³ããã«ãŒã¿ãŒ ] ãéžæããŸãã 詳现æ
å ±ãåŸãã«ã¯ã Anthropic ããã³ããã«ãŒã¿ãŒ ã®ããã©ã«ãã«ãŒã¿ãŒãéžæããŸãã ããã³ããã«ãŒã¿ãŒã®èšå®ããã ã¯ãã¹ãªãŒãžã§ã³æšè«ãããã¡ã€ã« ã䜿çšã㊠Claude 3.5 Sonnet ãš Claude 3 Haiku ã®éã§ãªã¯ãšã¹ããã«ãŒãã£ã³ã°ããŠããããšãããããŸããã«ãŒãã£ã³ã°åºæºã¯ãã©ã³ã¿ã€ã ã«ã«ãŒã¿ãŒå
éšã¢ãã«ã«ãã£ãŠäºæž¬ãããåããã³ããã®æå€§ã¢ãã«ã®å¿çãšæå°ã¢ãã«ã®å¿çã®å質差ãå®çŸ©ããŸãããã©ãŒã«ããã¯ã¢ãã«ã¯ãéžæããã¢ãã«ã®ã©ããæãŸããããã©ãŒãã³ã¹åºæºãæºãããªãå Žåã«äœ¿çšããããã®ã§ãAnthropicâs Claude 3.5 Sonnet ã§ãã ããã³ããã«ãŒã¿ãŒã䜿çšããŠãã£ããããã«ã¯ [ ãã¬ã€ã°ã©ãŠã³ãã§éã ] ãéžæããæ¬¡ã®ããã³ãããå
¥åããŸãã ã¢ãªã¹ã«ã¯ N 人ã®å
åŒãããŠã圌女ã«ã¯ M 人ã®å§åйãããŸããã¢ãªã¹ã®å
åŒã«å§åйã¯äœäººããŸããïŒ çµæã¯ããã«æäŸãããŸããå³åŽã®æ°ãã ã«ãŒã¿ãŒã¡ããªã㯠ã¢ã€ã³ã³ãéžæããŠãããã³ããã«ãŒã¿ãŒã§ã©ã®ã¢ãã«ãéžæããããã確èªããŸããä»åã¯ã質åãããªãè€éãªã®ã§ãAnthropicâs Claude 3.5 Sonnet ã䜿ãããŸããã ããã§ãåãããã³ããã«ãŒã¿ãŒã«ç°¡åãªè³ªåãããŸãã ãhello worldãããã°ã©ã ã®ç®çã1è¡ã§èª¬æããŠãã ããã ä»åã¯ãAnthropicâs Claude 3 Haiku ãããã³ããã«ãŒã¿ãŒã«éžã°ããŸããã ã¡ã¿ããã³ããã«ãŒã¿ãŒ ãéžæããŠæ§æã確èªããŸãããã©ãŒã«ããã¯ãšããŠã70B ã¢ãã«ã䜿çšãã Llama 3.1 70B ããã³ 8B ã®ã¯ãã¹ãªãŒãžã§ã³æšè«ãããã¡ã€ã«ã䜿çšããŠããŸãã ããã³ããã«ãŒã¿ãŒã¯ã Amazon Bedrock ãã¬ããžããŒã¹ ã Amazon Bedrock ãšãŒãžã§ã³ã ãªã©ãä»ã® Amazon Bedrock æ©èœãšçµ±åãããŠããã»ãã è©äŸ¡ãå®è¡ãã å Žåã«ãçµ±åãããŸããããšãã°ãããã§ã¯ãç§ã®ãŠãŒã¹ã±ãŒã¹ã§ã¯ãããã³ããã«ãŒã¿ãŒãå¥ã®ã¢ãã«ãŸãã¯ããã³ããã«ãŒã¿ãŒãšæ¯èŒããã®ã«åœ¹ç«ã€ã¢ãã«è©äŸ¡ãäœæããŸãã ã¢ããªã±ãŒã·ã§ã³ã§ããã³ããã«ãŒã¿ãŒã䜿çšããã«ã¯ãããã³ããã«ãŒã¿ãŒã® Amazon ãªãœãŒã¹ããŒã (ARN) ã Amazon Bedrock API ã®ã¢ãã« ID ãšããŠèšå®ããå¿
èŠããããŸãããã®ä»çµã¿ã AWS CLI ãš AWS SDK ã§ã©ã®ããã«æ©èœããããèŠãŠã¿ãŸãããã AWS CLI ã§ã® Amazon Bedrock ã€ã³ããªãžã§ã³ãããã³ããã«ãŒãã£ã³ã°ã®äœ¿çš Amazon Bedrock API ã¯ããã³ããã«ãŒã¿ãŒãåŠçããããã«æ¡åŒµãããŸãããããšãã°ã ListPromptRouters ã䜿çšã㊠AWS ãªãŒãžã§ã³ã®æ¢åã®ããã³ããã«ãŒããäžèŠ§è¡šç€ºã§ããŸãã aws bedrock list-prompt-routers åºåã«ã¯ãã³ã³ãœãŒã«ã§èŠããã®ãšäŒŒããæ¢åã®ããã³ããã«ãŒã¿ã®æŠèŠã衚瀺ãããŸãã åã®ã³ãã³ãã®å
šåºåã¯æ¬¡ã®ãšããã§ãã { "promptRouterSummaries": [ { "promptRouterName": "Anthropic Prompt Router", "routingCriteria": { "responseQualityDifference": 0.26 }, "description": "Routes requests among models in the Claude family", "createdAt": "2024-11-20T00:00:00+00:00", "updatedAt": "2024-11-20T00:00:00+00:00", "promptRouterArn": "arn:aws:bedrock:us-east-1:123412341234:default-prompt-router/anthropic.claude:1", "models": [ { "modelArn": "arn:aws:bedrock:us-east-1:123412341234:inference-profile/us.anthropic.claude-3-haiku-20240307-v1:0" }, { "modelArn": "arn:aws:bedrock:us-east-1:123412341234:inference-profile/us.anthropic.claude-3-5-sonnet-20240620-v1:0" } ], "fallbackModel": { "modelArn": "arn:aws:bedrock:us-east-1:123412341234:inference-profile/us.anthropic.claude-3-5-sonnet-20240620-v1:0" }, "status": "AVAILABLE", "type": "default" }, { "promptRouterName": "Meta Prompt Router", "routingCriteria": { "responseQualityDifference": 0.0 }, "description": "Routes requests among models in the LLaMA family", "createdAt": "2024-11-20T00:00:00+00:00", "updatedAt": "2024-11-20T00:00:00+00:00", "promptRouterArn": "arn:aws:bedrock:us-east-1:123412341234:default-prompt-router/meta.llama:1", "models": [ { "modelArn": "arn:aws:bedrock:us-east-1:123412341234:inference-profile/us.meta.llama3-1-8b-instruct-v1:0" }, { "modelArn": "arn:aws:bedrock:us-east-1:123412341234:inference-profile/us.meta.llama3-1-70b-instruct-v1:0" } ], "fallbackModel": { "modelArn": "arn:aws:bedrock:us-east-1:123412341234:inference-profile/us.meta.llama3-1-70b-instruct-v1:0" }, "status": "AVAILABLE", "type": "default" } ] } GetPromptRouter ãšããã³ããã«ãŒã¿ ARN ã䜿çšãããšãç¹å®ã®ããã³ããã«ãŒã¿ã«é¢ããæ
å ±ãååŸã§ããŸããããšãã°ãMeta Llama ã¢ãã«ã·ãªãŒãºã®å Žå: aws bedrock get-prompt-router --prompt-router-arn arn:aws:bedrock:us-east-1:123412341234:default-prompt-router/meta.llama:1 { "promptRouterName": "Meta Prompt Router", "routingCriteria": { "responseQualityDifference": 0.0 }, "description": "Routes requests among models in the LLaMA family", "createdAt": "2024-11-20T00:00:00+00:00", "updatedAt": "2024-11-20T00:00:00+00:00", "promptRouterArn": "arn:aws:bedrock:us-east-1:123412341234:default-prompt-router/meta.llama:1", "models": [ { "modelArn": "arn:aws:bedrock:us-east-1:123412341234:inference-profile/us.meta.llama3-1-8b-instruct-v1:0" }, { "modelArn": "arn:aws:bedrock:us-east-1:123412341234:inference-profile/us.meta.llama3-1-70b-instruct-v1:0" } ], "fallbackModel": { "modelArn": "arn:aws:bedrock:us-east-1:123412341234:inference-profile/us.meta.llama3-1-70b-instruct-v1:0" }, "status": "AVAILABLE", "type": "default" } Amazon Bedrock ã§ããã³ããã«ãŒã¿ãŒã䜿çšããã«ã¯ãAPI ã³ãŒã«ãè¡ããšãã«ããã³ããã«ãŒã¿ãŒ ARN ãã¢ãã« ID ãšããŠèšå®ããŸãããããšãã°ãããã§ã¯ AWS CLI ãš Amazon Bedrock Converse API ã§ Anthropic ããã³ããã«ãŒã¿ãŒã䜿çšããŠããŸãã aws bedrock-runtime converse \ --model-id arn:aws:bedrock:us-east-1:123412341234:default-prompt-router/anthropic.claude:1 \ --messages '[{ "role": "user", "content": [ { "text": "Alice has N brothers and she also has M sisters.How many sisters does Aliceâs brothers have?" } ] }]' \ åºåã«ã¯ãããã³ããã«ãŒã¿ãŒã䜿çšããåŒã³åºãã«ã¯ãå®éã«äœ¿çšãããã¢ãã«ãç€ºãæ°ãã ãã¬ãŒã¹ ã»ã¯ã·ã§ã³ãå«ãŸããŸãããã®å Žåã¯ãAnthropicâs Claude 3.5 Sonnet ã§ãã { "output": { "message": { "role": "assistant", "content": [ { "text": "To solve this problem, let's think it through step-by-step:\n\n1) First, we need to understand the relationships:\n - Alice has N brothers\n - Alice has M sisters\n\n2) Now, we need to consider who Alice's brothers' sisters are:\n - Alice herself is a sister to all her brothers\n - All of Alice's sisters are also sisters to Alice's brothers\n\n3) So, the total number of sisters that Alice's brothers have is:\n - The number of Alice's sisters (M)\n - Plus Alice herself (+1)\n\n4) Therefore, the answer can be expressed as: M + 1\n\nThus, Alice's brothers have M + 1 sisters." } ] } }, . . . "trace": { "promptRouter": { "invokedModelId": "arn:aws:bedrock:us-east-1:123412341234:inference-profile/us.anthropic.claude-3-5-sonnet-20240620-v1:0" } } } AWS SDK ã«ãã Amazon Bedrock ã€ã³ããªãžã§ã³ãããã³ããã«ãŒãã£ã³ã°ã®äœ¿çš AWS SDK ãããã³ããã«ãŒã¿ãŒã§äœ¿çšããããšã¯ã以åã®ã³ãã³ãã©ã€ã³ãšã¯ã¹ããªãšã³ã¹ãšäŒŒãŠããŸããã¢ãã«ãåŒã³åºããšãã«ãã¢ãã« ID ãããã³ããã¢ãã« ARN ã«èšå®ããŸãããããšãã°ã次㮠Python ã³ãŒãã§ã¯ã ConverseStream API ã§ã¡ã¿ã©ãã«ãŒã¿ãŒã䜿çšããŠããŸãã import json import boto3 bedrock_runtime = boto3.client( "bedrock-runtime", region_name="us-east-1", ) MODEL_ID = "arn:aws:bedrock:us-east-1:123412341234:default-prompt-router/meta.llama:1" user_message = "Describe the purpose of a 'hello world' program in one line." messages = [ { "role": "user", "content": [{"text": user_message}], } ] streaming_response = bedrock_runtime.converse_stream( modelId=MODEL_ID, messages=messages, ) for chunk in streaming_response["stream"]: if "contentBlockDelta" in chunk: text = chunk["contentBlockDelta"]["delta"]["text"] print(text, end="") if "messageStop" in chunk: print() if "metadata" in chunk: if "trace" in chunk["metadata"]: print(json.dumps(chunk['metadata']['trace'], indent=2)) ãã®ã¹ã¯ãªããã¯ãå¿çããã¹ããšãã¬ãŒã¹ã®å
容ãå¿çã¡ã¿ããŒã¿ã«åºåããŸãããã®åçŽãªãªã¯ãšã¹ãã«å¯ŸããŠãããã³ããã«ãŒã¿ãŒã¯ããé«éã§æé ãªã¢ãã«ãéžæããŸããã ãHello Worldãããã°ã©ã ã¯ãããã°ã©ãã³ã°èšèªã®åºæ¬çãªæ§æãšæ©èœã瀺ãåºæ¬çãªäŸãšãªãã·ã³ãã«ãªå
¥éããã°ã©ã ã§ãéåžžã¯éçºç°å¢ãæ£ããèšå®ãããŠããããšã確èªããããã«äœ¿çšãããŸãã { "promptRouter": { "invokedModelId": "arn:aws:bedrock:us-east-1:123412341234:inference-profile/us.meta.llama3-1-8b-instruct-v1:0" } } AWS SDK ã§ã®ããã³ãããã£ãã·ã¥ã®äœ¿çš Amazon Bedrock Converse API ã§ã¯ããã³ãããã£ãã·ã¥ã䜿çšã§ããŸãããã£ãã·ã¥ããã³ã³ãã³ãã«ã¿ã°ãä»ããŠåããŠã¢ãã«ã«éä¿¡ãããšãã¢ãã«ã¯å
¥åãåŠçããäžéçµæããã£ãã·ã¥ã«ä¿åããŸããåãã³ã³ãã³ããå«ãåŸç¶ã®ãªã¯ãšã¹ãã§ã¯ãã¢ãã«ã¯ååŠçãããçµæããã£ãã·ã¥ããèªã¿èŸŒã¿ãã³ã¹ããšåŸ
ã¡æéã®äž¡æ¹ã倧å¹
ã«åæžããŸãã ããã³ãããã£ãã·ã¥ã¯ãããã€ãã®æé ã§ã¢ããªã±ãŒã·ã§ã³ã«å®è£
ã§ããŸãã ããã³ããã®äžã§é »ç¹ã«åå©çšãããéšåãç¹å®ããŸãã æ°ãã cachePoint ãããã¯ã䜿çšããŠããããã®ã»ã¯ã·ã§ã³ãã¡ãã»ãŒãžã®ãªã¹ãã«ãã£ãã·ã¥ããããã«ã¿ã°ä»ãããŸãã ã¬ã¹ãã³ã¹ã¡ã¿ããŒã¿ã®äœ¿çšç¶æ³ã»ã¯ã·ã§ã³ã§ããã£ãã·ã¥ã® 䜿çšç¶æ³ ãšã¬ã€ãã³ã·ãŒã®æ¹åãç£èŠããŠãã ããã ããã¥ã¡ã³ããæäœãããšãã®ããã³ãããã£ãã·ã¥ã®å®è£
äŸã次ã«ç€ºããŸãã ãŸãã AWS ã®ãŠã§ããµã€ããã 3 ã€ã®æææ±ºå®ã¬ã€ãã PDF 圢åŒã§ããŠã³ããŒãããŸã ããããã®ã¬ã€ãã¯ãã客æ§ã®ãŠãŒã¹ã±ãŒã¹ã«åã£ã AWS ãµãŒãã¹ãéžæããã®ã«åœ¹ç«ã¡ãŸãã æ¬¡ã«ãPython ã¹ã¯ãªããã䜿çšããŠãããã¥ã¡ã³ãã«ã€ã㊠3 ã€ã®è³ªåãããŸãããã®ã³ãŒãã§ã¯ãã¢ãã«ãšã®äŒè©±ãåŠçãã converse() 颿°ãäœæããŸãããã®é¢æ°ãåããŠåŒã³åºããšãã«ãããã¥ã¡ã³ãã®ãªã¹ããš cachePoint ãããã¯ã远å ããããã®ãã©ã°ãå«ããŸãã import json import boto3 MODEL_ID = "us.anthropic.claude-3-5-sonnet-20241022-v2:0" AWS_REGION = "us-west-2" bedrock_runtime = boto3.client( "bedrock-runtime", region_name=AWS_REGION, ) DOCS = [ "bedrock-or-sagemaker.pdf", "generative-ai-on-aws-how-to-choose.pdf", "machine-learning-on-aws-how-to-choose.pdf", ] messages = [] def converse(new_message, docs=[], cache=False): if len(messages) == 0 or messages[-1]["role"] != "user": messages.append({"role": "user", "content": []}) for doc in docs: print(f"Adding document: {doc}") name, format = doc.rsplit('.', maxsplit=1) with open(doc, "rb") as f: bytes = f.read() messages[-1]["content"].append({ "document": { "name": name, "format": format, "source": {"bytes": bytes}, } }) messages[-1]["content"].append({"text": new_message}) if cache: messages[-1]["content"].append({"cachePoint": {"type": "default"}}) response = bedrock_runtime.converse( modelId=MODEL_ID, messages=messages, ) output_message = response["output"]["message"] response_text = output_message["content"][0]["text"] print("Response text:") print(response_text) print("Usage:") print(json.dumps(response["usage"], indent=2)) messages.append(output_message) converse("Compare AWS Trainium and AWS Inferentia in 20 words or less.", docs=DOCS, cache=True) converse("Compare Amazon Textract and Amazon Transcribe in 20 words or less.") converse("Compare Amazon Q Business and Amazon Q Developer in 20 words or less.") ã¹ã¯ãªããã¯ãåŒã³åºãããšã«å¿ç㚠䜿çšç¶æ³ã«ãŠã³ã¿ãŒ ãåºåããŸãã ããã¥ã¡ã³ãã®è¿œå : bedrock-or-sagemaker.pdf ããã¥ã¡ã³ãã®è¿œå : generative-ai-on-aws-how-to-choose.pdf ããã¥ã¡ã³ãã®è¿œå : machine-learning-on-aws-how-to-choose.pdf å¿çããã¹ã: AWS Trainium ã¯æ©æ¢°åŠç¿ãã¬ãŒãã³ã°ã«æé©åãããŠãããAWS Inferentia ã¯äœã³ã¹ãã§é«æ§èœãªæ©æ¢°åŠç¿æšè«åãã«èšèšãããŠããŸãã äœ¿çšæ¹æ³: { "inputTokens": 4, "outputTokens": 34, "totalTokens": 29879, "cacheReadInputTokenCount": 0, "cacheWriteInputTokenCount": 29841 } å¿çããã¹ã: Amazon Textract ã¯ããã¥ã¡ã³ãããããã¹ããšããŒã¿ãæœåºããAmazon Transcribe ã¯ãªãŒãã£ãªãã¡ã€ã«ãŸãã¯ãããªãã¡ã€ã«ãããªãŒãã£ãªãããã¹ãã«å€æããŸãã äœ¿çšæ¹æ³: { "inputTokens": 59, "outputTokens": 30, "totalTokens": 29930, "cacheReadInputTokenCount": 29841, "cacheWriteInputTokenCount": 0 } å¿çããã¹ã: Amazon Q Business ã¯ãšã³ã¿ãŒãã©ã€ãºããŒã¿ã䜿çšããŠè³ªåã«åçããAmazon Q Developer 㯠AWS ã®ã¢ããªã±ãŒã·ã§ã³ãšãµãŒãã¹ã®æ§ç¯ãšéçšãæ¯æŽããŸãã äœ¿çšæ¹æ³: { "inputTokens": 108, "outputTokens": 26, "totalTokens": 29975, "cacheReadInputTokenCount": 29841, "cacheWriteInputTokenCount": 0 } ã¬ã¹ãã³ã¹ã® 䜿çšç¶æ³ ã»ã¯ã·ã§ã³ã«ã¯ã cacheReadInputTokenCount ãš cacheWriteInputTokenCount ãšãã 2 ã€ã®æ°ããã«ãŠã³ã¿ãŒãå«ãŸããŠããŸããåŒã³åºãã®ããŒã¯ã³ã®ç·æ°ã¯ãå
¥åããŒã¯ã³ãšåºåããŒã¯ã³ã®åèšã«ããã£ãã·ã¥ã«èªã¿æžããããããŒã¯ã³ãå ãããã®ã§ãã åŒã³åºãã®ãã³ã«ãã¡ãã»ãŒãžã®ãªã¹ããåŠçãããŸããæåã®åŒã³åºãã®ã¡ãã»ãŒãžã«ã¯ãããã¥ã¡ã³ããæåã®è³ªåãããã³ãã£ãã·ã¥ãã€ã³ããå«ãŸããŸãããã£ãã·ã¥ãã€ã³ãããåã®ã¡ãã»ãŒãžã¯çŸåšãã£ãã·ã¥ã«ãªãããããã£ãã·ã¥ã«æžã蟌ãŸããŸãã 䜿çšç¶æ³ ã«ãŠã³ã¿ãŒã«ãããšã29,841 åã®ããŒã¯ã³ããã£ãã·ã¥ã«æžã蟌ãŸããŠããŸãã "cacheWriteInputTokenCount": 29841 次ã®åŒã³åºãã§ã¯ãåã®å¿çãšæ°ãã質åãã¡ãã»ãŒãžã®ãªã¹ãã«è¿œå ãããŸãã cachePoint ã®åã®ã¡ãã»ãŒãžã¯å€æŽãããããã£ãã·ã¥å
ã«ãããŸãã äºæ³ã©ããã 䜿çšç¶æ³ ã«ãŠã³ã¿ãŒããã以åã«æžã蟌ãŸããã®ãšåãæ°ã®ããŒã¯ã³ããã£ãã·ã¥ããèªã¿åãããããšãããããŸãã "cacheReadInputTokenCount": 29841 ç§ã®ãã¹ãã§ã¯ãæåã®åŒã³åºããšæ¯èŒããŠã次ã®åŒã³åºããå®äºãããŸã§ã«ãããæéã 55% çããªããŸããããŠãŒã¹ã±ãŒã¹ïŒãã£ãã·ã¥ãããã³ã³ãã³ããå€ãå Žåãªã©ïŒã«ããããŸãããããã³ãããã£ãã·ã¥ã«ãã£ãŠã¬ã€ãã³ã·ãæå€§ 85% æ¹åãããŸãã ã¢ãã«ã«ãã£ãŠã¯ãã¡ãã»ãŒãžã®ãªã¹ãã«è€æ°ã®ãã£ãã·ã¥ãã€ã³ããèšå®ã§ããŸãããŠãŒã¹ã±ãŒã¹ã«é©ãããã£ãã·ã¥ãã€ã³ããèŠã€ããã«ã¯ãããŸããŸãªæ§æã詊ããŠãå ±åããã䜿çšç¶æ³ãžã®åœ±é¿ã確èªããŠãã ããã ç¥ã£ãŠããã¹ãããš Amazon Bedrock ã€ã³ããªãžã§ã³ãããã³ããã«ãŒãã£ã³ã°ã¯ãç±³åœæ±éš (ããŒãžãã¢åéš) ããã³ç±³åœè¥¿éš (ãªã¬ãŽã³) ã® AWS ãªãŒãžã§ã³ ã§ 12 æ 4 æ¥ãã¬ãã¥ãŒçããå©çšããã ããŸãããã¬ãã¥ãŒäžã¯ãããã©ã«ãã®ããã³ããã«ãŒã¿ãŒã䜿çšã§ããŸããããã³ããã«ãŒã¿ãŒã䜿çšããŠãè¿œå æéã¯ããããŸãããéžæããã¢ãã«ã®è²»çšãæ¯æããŸããããã³ããã«ãŒã¿ãŒã¯ã è©äŸ¡ã®å®è¡ ã ãã¬ããžããŒã¹ã®äœ¿çš ã ãšãŒãžã§ã³ãã®èšå®ãªã© ãä»ã® Amazon Bedrock æ©èœãšãšãã«äœ¿çšã§ããŸãã ããã³ããã«ãŒã¿ãŒã䜿çšããå
éšã¢ãã«ã¯ããã³ããã®è€éããçè§£ããå¿
èŠããããããã€ã³ããªãžã§ã³ãããã³ããã«ãŒãã£ã³ã°ã¯çŸåšè±èªããã³ããã®ã¿ããµããŒãããŠããŸãã Amazon Bedrock ã«ããããã³ãããã£ãã·ã¥ã®ãµããŒãã¯ãç±³åœè¥¿éš (ãªã¬ãŽã³) ã§ Anthropicâs Claude 3.5 Sonnet V2 ãš Claude 3.5 Haiku ã®ãã¬ãã¥ãŒçãæäŸãããŠããŸããç±³åœæ±éš (ããŒãžãã¢åéš) ã§ã¯ Amazon Nova MicroãAmazon Nova Liteãããã³ Amazon Nova Pro ã®ããã³ãããã£ãã·ã¥ãå©çšã§ããŸãã ããã³ãããã£ãã·ã¥ã䜿çšãããšããã£ãã·ã¥èªã¿åãã¯ããã£ãã·ã¥ãããŠããªãå
¥åããŒã¯ã³ãšæ¯èŒã㊠90% å²åŒãããŸãããã£ãã·ã¥ã¹ãã¬ãŒãžã«è¿œå ã®ã€ã³ãã©ã¹ãã©ã¯ãã£æéã¯ããããŸãããAnthropic ã¢ãã«ã䜿çšããå Žåããã£ãã·ã¥ã«æžã蟌ãŸããããŒã¯ã³ã«ã¯è¿œå æéãããããŸããAmazon Nova ã¢ãã«ã§ã¯ããã£ãã·ã¥æžã蟌ã¿ã«è¿œå ã³ã¹ãã¯ããããŸããã詳现ã«ã€ããŠã¯ã Amazon Bedrock ã®æé ãã芧ãã ããã ããã³ãããã£ãã·ã¥ã䜿çšããå Žåãã³ã³ãã³ãã¯æå€§ 5 åéãã£ãã·ã¥ããããã£ãã·ã¥ããããããã³ã«ã«ãŠã³ãããŠã³ããªã»ãããããŸããããã³ãããã£ãã·ã¥ã¯ã ã¯ãã¹ãªãŒãžã§ã³æšè« ãééçã«ãµããŒãããããã«å®è£
ãããŠããŸããããã«ãããã¢ããªã±ãŒã·ã§ã³ã§ã¯ãã¯ãã¹ãªãŒãžã§ã³æšè«ã®æè»æ§ãå©çšããŠãããã³ãããã£ãã·ã¥ã«ããã³ã¹ãæé©åãšã¬ã€ãã³ã·ãŒã®ã¡ãªããã享åã§ããŸãã ãããã®æ°æ©èœã«ãããè²»çšå¯Ÿå¹æãé«ã髿§èœãªçæ AI ã¢ããªã±ãŒã·ã§ã³ãç°¡åã«æ§ç¯ã§ããŸãããªã¯ãšã¹ããã€ã³ããªãžã§ã³ãã«ã«ãŒãã£ã³ã°ããé »ç¹ã«äœ¿çšãããã³ã³ãã³ãããã£ãã·ã¥ããããšã§ãã¢ããªã±ãŒã·ã§ã³ã®ããã©ãŒãã³ã¹ãç¶æããããã«åäžããããšåæã«ãã³ã¹ãã倧å¹
ã«åæžã§ããŸãã ãããã®æ°æ©èœã®è©³çްã確èªããŠä»ãã䜿çšãéå§ããã«ã¯ã Amazon Bedrock ã®ããã¥ã¡ã³ã ã«ã¢ã¯ã»ã¹ãã AWS re:Post for Amazon Bedrock ã«ãã£ãŒãããã¯ãéä¿¡ããŠãã ããã community.aws ã§ã¯ã詳ããæè¡ã³ã³ãã³ããæ€çŽ¢ãããã«ããŒã³ãã¥ããã£ã Amazon Bedrock ã䜿çšããæ¹æ³ãèŠåºãããšãã§ããŸãã â Danilo åæã¯ ãã¡ã ã§ãã