æ¬èšäºã¯Â BASE ã¢ããã³ãã«ã¬ã³ã㌠2023  ã®15æ¥ç®ã®èšäºã§ãã ã¯ããã« ããã«ã¡ã¯ãBASEã®ããŒã¿åæããŒã ïŒData Strategy TeamïŒã§äžæ£å¯Ÿçãè¡ã£ãããæ©æ¢°åŠç¿ãè§Šã£ããããŠãã竹å
ã§ãã ChatGPTïŒGPT-3.5 TurboïŒã2022幎ã®11æã«å
¬éãããŠãããã ããã1幎以äžãçµã£ãããšã«ãªããŸãã ãããŠãã®1幎è¿ãã§ChatGPTã«å¹æµãã倿°ã®LLMã®å
¬éãåœç£LLMäœæã®åããæ¡æ£ã¢ãã«ã䞻軞ãšããç»åçæAIã®å°é ãªã©æ§ã
ãªã ãŒãã¡ã³ããããããããçµãŠãçæAIããšããåèªã¯2023å¹Žã®æµè¡èªå€§è³ã«éžã°ããã»ã©äººå£ã«èŸçããçµæãšãªããŸããã çæAIãç¹ã«ChatGPTãã¯ãããšãã察話çšã«ãã¥ãŒãã³ã°ãããå€§èŠæš¡èšèªã¢ãã«ïŒä»¥äžãã£ããLLMãšè¡šèšããŸããïŒã®å®å¿çšãšããé¢ã«é¢ããŠãããšã人ã®ä»£ããã«æç« ãäœæãããããç¥ãããæ
å ±ãæç€ºãããããã¢ã€ãã¢ãææ¡ãããããšãã£ã人éã®ã¢ã·ã¹ã¿ã³ãã®ããã«æ¯ãèããæ§è³ªãæŽ»ããã䜿ããæ¹ãå€ãå°è±¡ã§ãBASEã«ãããŠããã£ããLLMã®ãããã£ãåŽé¢ã掻çšãããµãŒãã¹ã®éçºããªãªãŒã¹ãé²ãã§ããŸãã äžæ¹ã§å°ãèŠæ¹ãå€ãããšããã£ããLLMã¯ä»»æã®ããã¹ããå
¥åãšããŠåãä»ããæå®ããæé ã«åŸã£ãŠã¿ã¹ã¯ãå®è¡ããåºåã®ãã©ãŒããããããçšåºŠã³ã³ãããŒã«ã§ãããäžçç¥èããã£ãèªç¶èšèªåŠçããŒã«ã§ãããšããåŽé¢ãååšããŸããïŒç²ŸåºŠã¯ã¿ã¹ã¯ã®é£æåºŠãã¢ãã«ã®æ§èœã«äŸåããŸããïŒ ChatGPTã«ããã¯ã©ã¹åé¡ ãã£ããLLMã®ããããåŽé¢ã«çç®ããå®å¿çšäŸãããŒã«åã«é¢ããŠã¯ãããããããšãããã§ã«ãããããªå Žæã§æ€èšŒãããå®éã«éçšãããŠããã®ãããããŸããããæ§ã
ãªäºæ
ããåè
ã®ãã¢ã·ã¹ã¿ã³ãAIãçãªäŸãšæ¯èŒããŠããŸã衚ç«ã£ãŠåãäžããããŠããªããããªå°è±¡ããããŸãã ãããã£ãèæ¯ããããçŽè¿ã§ååããã¹ãã®ã«ããŽãªåé¡ãšããå
žåçãªã¿ã¹ã¯ãçŸå®çãªã³ã¹ãã§å®è¡ããããã«ããã£ããLLMãå©çšããã¡ãã£ãšããããŒã«ãäœãæ©äŒããã£ããããããã«ã€ããŠãŸãšããŠãããããšæããŸãã ãã£ããLLMã«ããããã¹ãåé¡ BASEã§ã¯æ€çŽ¢ãã¬ã³ã¡ã³ãã·ã¹ãã ã®æ¹åãäžæ£æ±ºæžå¯Ÿçãäžé©åãªã³ã³ãã³ããžã®å¯Ÿçãªã©ã«æŽ»çšããããäžé𿩿¢°åŠç¿ããŒã¹ã®ããã¹ãåé¡ã¢ãã«ã®äœæãè¡ã£ãŠããŸããå
·äœçã«ã¯ä»¥åã玹ä»ãã ååã«ããŽãªã®åé¡ã¢ãã« ãªã©ãæããããŸãã ãã®ãããªããã¹ãåé¡ã¢ãã«ãäœæããã«ã¯ãåŸæ¥ã§ããã°äººã®æã«ãã£ãŠã©ãã«ä»ãïŒã¢ãããŒã·ã§ã³ïŒãããååãªãµã€ãºã®åŠç¿/ãã¹ãããŒã¿ã»ãããçšæããå¿
èŠããããŸãããããããªããååãªãµã€ãºãšã©ãã«ã®å質ãæ
ä¿ãããããŒã¿ã»ãããäœæããã®ã¯å®¹æã§ã¯ãªããã¯ã©ãŠããœãŒã·ã³ã°ãªã©ãå©çšããå Žåã§ãçžåœãªæéçãééçã³ã¹ãããããããšã«ãªããŸããååã«ããŽãªã®åé¡ãšãããå
容èªäœã¯æ¯èŒçåãçµã¿ãããã¿ã¹ã¯ã«ã€ããŠãããŒã¿ã»ããã®äœæãããã¯ãšãªã£ãŠããŸããã äžæ¹ã§ChatGPTã®ãããªãã£ããLLMã¯ãé©åãªæç€ºæïŒããã³ããïŒãäžããã ãã§æ§ã
ãªã¿ã¹ã¯ãè§£ãããšãã§ãããšããéåžžã«é«ãæ±çšæ§ãæè»æ§ããã£ãŠãããããããã¹ãåé¡ã«ãããŠããã¡ã€ã³ãã¥ãŒãã³ã°ç¡ãã§ååãªåãçºæ®ããããšãã§ãããã¡ã€ã³ã«ãã£ãŠã¯äººéãšæ¯èŒããŠãéè²ãªãæ§èœãçºæ®ããããšãå¯èœã§ãã[1] ããããªãããã£ããLLMããã®ãŸãŸããã¹ãåé¡ã¢ãã«ãšããŠå©çšãç¶ããå Žåããã¡ã€ã³ãã¥ãŒãã³ã°ããã¢ãã«ã§æšè«ãè¡ãææ³ãšæ¯èŒã㊠æšè«é床 ã³ã¹ã APIã®å©çšå¶éïŒChatGPTãBARDã®ãããªAPIãå©çšããå ŽåïŒ åºåã®ãã©ãŒãããã®å®å®æ§ ãªã©ã®é¢ã§èª²é¡ãçºçããŸãã ç¹ã«æšè«é床ã®é¢ã§èšãã°ç°¡åãªããã¹ãåé¡ã«ãããŠã1ä»¶ãããæ°ç§ãåæ°ç§ã¯èŠããã±ãŒã¹ãå€ããã¢ãã«ã®æé©åããããåŠçãåºæ¬çã«ã¯äžå¯èœã§ããããã«ãããŒã¿ã®éã«ãã£ãŠã¯ããããæšè«ã远ãã€ããªãããšããããŸãã ããããã¹ã±ãŒã©ããªãã£äžã®èª²é¡ã解決ããæ¹æ³ãšããŠã¯ããã£ããLLMãçšããŠããã¹ãåé¡ãè¡ã£ãçµæãæåž«ä¿¡å·ãšãããããçšããŠBERTãªã©ã®ãã軜éãªäºååŠç¿ã¢ãã«ããã¡ã€ã³ãã¥ãŒãã³ã°ãããšããæ¹æ³ãèããããŸãã èŠããã«äººéã®ä»£ããã«ãã£ããLLMã«ã¢ãããŒã·ã§ã³ããããšããããšã«ãªããŸãããè€éã§å·šå€§ãªã¢ãã«ã®æããç¥èãããããããã€ã¡ã³ãã«é©ããã¢ãã«ãžãšç§»è»¢ãããæè¡ã§ããç¥èèžçïŒknowledge distillationïŒ[2]ãè¡ã£ãŠãããšããèŠæ¹ãã§ãããããããŸããã ïŒãã ãChatGPTã®å ŽåãåºåãOpenAIãšã®ç«¶åãšãªããããªã¢ãã«ã®åŠç¿ç®çã§å©çšããããšãèŠçŽã§çŠæ¢ãããŠãã[3]ããæ³šæãå¿
èŠã«ãªããŸããïŒ åé¡ã¿ã¹ã¯ãå®è¡ããããã®ããã³ããã®ãã³ãã¬ãŒãå ããŒã¿ã»ãããžã®ã¢ãããŒã·ã§ã³ãç®çãšããŠããã¹ãåé¡ãå®è¡ãããšããå·¥çšã«ã€ããŠã¯ãããçšåºŠããŒã«åããæ¹ã䟿å©ã§ãããšèããŸããã ããã¹ãåé¡ãå®è¡ãããããã®æç€ºãçµæã®ãã©ãŒãããã®æå®ãªã©ã«å¿
èŠãªããã³ããããã¡ãã¡æžããã«ãscikit-learnãPyTorchãªã©ãšåããããªæ¯ãèããããPythonã®ã©ã€ãã©ãªãšããŠäœ¿çšã§ããã°ãã¡ã€ã³ããšã®åãåããè¯ãã§ãã äŸãã°ãã¥ãŒã¹ã®ãããã¯åé¡ããã€ãŒãã®ãã¬ããžåé¡ãªã©ç°ãªããã¡ã€ã³ã®ããã¹ãåé¡ã¿ã¹ã¯ãè§£ãããã«ãã£ããLLMãå©çšããéããã¡ãã¡ãã¯ã©ã¹åé¡ããŠãã ãããçãªããã³ãããããã®äŸã®ããã«json圢åŒã§åºåããŠãã ãããçãªãã©ãŒãããéšåããAPIãå©ãéšåãæžãã®ã¯ãªããªãã«ç
©ããããã®ãšãªããŸããã¿ã¹ã¯ãè§£ãäžã§å¿
èŠæäœéãšãªãæ
å ±ãèŠä»¶ã®ã¿ãçŽæ¥åŒæ°ãªã©ã§èšå®ã§ããããšãæãŸããã§ãã ã¯ã©ã¹åé¡ã¿ã¹ã¯ãå®è¡ãããããã®ããã³ããã«é¢ããŠèšãã°ããã¡ã€ã³ã«é¢ãããå
±éããŠããéšåãšããã¡ã€ã³ããšã«æå®ããå¿
èŠã®ããéšåã«åããããšãã§ããåè
ãããçšåºŠãã³ãã¬ãŒãåããäžã§åŸè
ããã®ãã³ãã¬ãŒãã«åœãŠã¯ããããšãå¯èœã§ãã ãã¡ã€ã³ã«é¢ãããå
±éåã§ããéšåãšããŠã¯ ããã¹ãåé¡ãå®è¡ãããããã®æç€ºéšå çç±ã確床ããã«ãã©ãã«ãšããããªã©ã®æç¡ã®æå® åçš®èšå®ã«å¿ããåºåã®ãã©ãŒããããšãã®äŸç€ºéšå ãªã©ãæãããã ããã¹ãåé¡ã«ãããŠãã¡ã€ã³ããšã«æå®ããå¿
èŠã®ããéšåãšããŠã¯ ã©ã®ãããªæèã®ããã¹ããåé¡ããããïŒäŸ: WebãµãŒãã¹ã®å©çšè
ã®ã³ã¡ã³ãïŒ ã©ã®ãããªã©ãã«ã«åé¡ããããïŒäŸ: å©çšæã®å°è±¡ïŒ ããããã®ã©ãã«ã¯ã©ããªãã®ããïŒäŸ: ããã¬ãã£ãorããžãã£ããïŒ ãªã©ãæããããŸãã 以äžãèžãŸããŠãçµæçã«ä»¥äžã®ããã«åäœãããã£ããLLMã«ããããã¹ãåé¡ããŒã«ãäœæããŸããã from llmtask.tasks import ClassificationTask # ã¯ã©ã¹åé¡ãããããã¹ãã®èª¬æ input_description = "EC review comments" # ã¯ã©ã¹ã®èª¬æ label_description = "Impressions from the comments" # ã©ãã«å: ã©ãã«ã®èª¬æãå
·äœäŸ labels = { "Positive" : "Receive a good impressionïŒendorsement, praise, support, recommendationïŒ" , "Negative" : "Receive a bad impressionïŒdisagree, criticize, attack, slanderïŒ" , "Neutral" : "Neither positive nor negative" } task = ClassificationTask( input_description=input_description, label_description=label_description, labels=labels, require_reason= True , llm= "openai" , language= "en" , ) output = task( input_text= "The order was delivered right away!" , model= "gpt-3.5-turbo-1106" , ) labels = output.label label_index=output.label_index print (label_index, labels) # >> 0 Positive reason = output.reason print (reason) # >> The comment 'The order was delivered right away!' expresses satisfaction and a positive impression. å
éšã§ã¯ãã³ãã¬ãŒãã«åŸã£ãŠã ããã以äžã®ãããªã€ã¡ãŒãžã®ããã³ãããäœæãããããŒã¹ãããåºåçµæãæ»ãå€ãšããŠè¿ãããã«ãªã£ãŠããŸãã """ Perform text labeling according to the following instructions. Let text X be EC review comments. Let label Y be Impressions from the comments. Select one of the labels Y that corresponds to text X. Briefly describe the reason for the labeling. The output format is json format as follows: {"reason": "Reason for labeling (string type)", "label": "Label to be assigned (string type) "} for example {"reason": "Because it is xx.", "label": "label"}. label Y=['Positive', 'Negative', 'Neutral'] Details of each label: {'Positive': 'Receive a good impressionïŒendorsement, praise, support, recommendationïŒ', 'Negative': 'Receive a bad impressionïŒdisagree, criticize, attack, slanderïŒ', 'Neutral': 'Neither positive nor negative'} text X='The order was delivered right away!' """ å¥ã®èšèªã®åé¡ã«ãããŠãåæ§ãªåœ¢åŒã§ã¿ã¹ã¯ãå®è¡ããããšãã§ããexampleãšããŠã®ããŒã¿ã®è¿œå ããã«ãã©ãã«åºåã®æå®ãªã©ãå¯èœãšãªã£ãŠããŸãã input_description = "ECãµã€ãã®ã¬ãã¥ãŒã³ã¡ã³ã" label_description = "ã³ã¡ã³ãããèªã¿åããå°è±¡" labels = { "ããžãã£ã" : "è¯ãå°è±¡ïŒè³è³ãæ¯æãæšå¥šãªã©ïŒ" , "ãã¬ãã£ã" : "æªãå°è±¡ïŒæ¹å€ãæ»æãäžå·ãªã©ïŒ" , "ãã¥ãŒãã©ã«" : "ã©ã¡ãã§ããªãäžç«çãªå°è±¡" , } task = ClassificationTask( input_description=input_description, label_description=label_description, labels=labels, multi_label= False , require_reason= True , require_confidence= True , llm= "openai" , language= "ja" , ) task.set_examples( example_inputs=[ "ãšãŠãè¯ãå質ã§ããã" , "å
è£
ãç ŽããŠããŸããã" , "å
æ¬æšã«æ¬åºããããŸãã" ], example_labels=[ "ããžãã£ã" , "ãã¬ãã£ã" , "ãã¥ãŒãã©ã«" ]) output = task( input_text= "泚æãããååãããã«å±ããŸããïŒ" , model= "gpt-3.5-turbo-1106" , ) labels = output.label label_index=output.label_index print (label_index, labels) # >> 0 ããžãã£ã reason = output.reason print (reason) # >> ãããã«å±ããŸããïŒããšããå
容ãããè³è³ã®æå³ã§ããžãã£ããªå°è±¡ã«è©²åœããŸãã ããã³ããã®ãã³ãã¬ãŒãã¯ä»¥äžã®ãããªåœ¢åŒã§èšèªããšã«å®è£
ããŠããŸããïŒããŸãæŽç·ŽãããŠããŸãããïŒ class _ClassificationPrompt : role: str task_description: str input_definition_holder: str ... def __init__ (self, input_description: str , label_description: str , labels: dict [ str , str ], multi_label: bool = False , require_reason: bool = False , require_confidence: bool = False ) -> None : self.instruction = self._build_instruction() ... def _build_instruction (self) -> str : instruction = "" instruction += self.task_description instruction += self.input_definition_holder.format(input_description=self.input_description) instruction += self.output_definition_holder.format(label_description=self.label_description) ... return instruction class _EnglishClassificationPrompt (_ClassificationPrompt): role = "Machine learning model for labeling text" task_description = f "Perform text labeling according to the following instructions." input_definition_holder = "Let text X be {input_description}." ... class _JapaneseClassificationPrompt (_ClassificationPrompt): role = "ããã¹ãã®ã©ãã«ä»ããè¡ãæ©æ¢°åŠç¿ã¢ãã«" task_description = "æ¬¡ã®æç€ºã«åŸãããã¹ãã®ã©ãã«ä»ããå®è¡ããã" input_definition_holder = "ããã¹ãXã{input_description}ãšããã" ... å®éã«äžèšã®ããŒã«ã䜿çšããŠããã¹ãããŒã¿ã®ã©ãã«ä»ããè¡ããéåžžã«äœã³ã¹ãã§ååãªéããã³è³ªïŒäººæã§ã®ã¢ãããŒã·ã§ã³çµæãšæ¯èŒããŠéè²ãªãçšåºŠïŒã®ããŒã¿ã»ãããäœæããããšãå¯èœãšãªããŸããã äŸãã°ååã«ããŽãªã®åé¡ã«é¢ããŠã¯æçµçã«çŸãè¶
ããã©ãã«æ°ãèšå®ãã圢ã«ãªããŸãããããã¡ã€ã³ãã¥ãŒãã³ã°ãè¡ã£ãã¢ãã«ã®ã¡ããªã¯ã¹ã«é¢ããŠãååãªæ°å€ãåºãããšãã§ããŠããŸãã 課é¡ã屿ãªã© åºåã®ãã©ãŒããã æè»æ§ã®é«ããšåŒãæãã«ãåºåã100%æåŸ
ãã圢åŒã«ãªããšã¯éããªããšããç¹ã¯ãã£ããLLMã®ããç¥ãããæ¬ ç¹ã®1ã€ã§ãããä»åã®ãããªããã¹ãåé¡ã«ãããŠãäŸå€ã§ã¯ãããŸããã äžèšã®ããŒã«ã§ã¯ã©ãã«åãçŽæ¥åçãã圢ã§ããã³ãããäœæããŠããŸãããäžããããéžæè¢ã«é©åãªãã®ããªãã£ãå Žåãªã©ã¯ãéžæè¢ã«ãªãã©ãã«åãåçããããšãå€ã
ãããŸããã ã©ãã«åãåçãããã®ã§ã¯ãªãã{1: âã©ãã«1â, 2: âã©ãã«2â, 3: âã©ãã«3â}ãšãã£ã圢åŒã®éžæè¢ã«å¯ŸããŠè©²åœããã©ãã«ã®çªå·ãè¿ãããã«ããã³ãããå®è£
ããããšãå¯èœã§ãåœåã¯ãã®åœ¢åŒãæ¡çšããŠããŸããããã®å Žååºåã®ãã©ãŒãããã¯å®å®ãããã®ã®ã粟床ãäžããïŒreasonãèŠãéãæ£ããçè§£ã¯ã§ããŠããããã€ã³ããã¯ã¹ãéžã¶ãšããã§ééããŠããïŒã±ãŒã¹ãèŠããããããã©ãã«åãçŽæ¥çããæ¹åŒãæ¡çšããŸããã äžæ¹ã§éžæè¢ã«ãªããã®ã倿°åçãããŠããå Žåã«ã¯ãã©ãã«ã»ãããèŠçŽãåèã«ããªããããã®ç¹ã§ã¯åœ¹ã«ç«ã€åŽé¢ããããŸããã ããã³ããã®é·ã çŸç¶ã®ä»çµã¿ã§ã¯1ããŒã¿ã®æšè«ãè¡ã床ã«ãã®ããŒã¿ã®ããã¹ãã ãã§ãªããå
±éã®æç€ºãã©ãã«ã®èª¬æãšãã£ãã¿ã¹ã¯ã®èª¬æãè¡ãã·ã¹ãã ããã³ãããéäžæããå¿
èŠããããŸãã ãã®ããç¹ã«ã©ãã«æ°ãçŸãè¶
ãããããªæ¥æ¬èªã®ã¿ã¹ã¯ã§ã¯å
šäœã®ããŒã¯ã³ãµã€ãºãéåžžã«å€§ãããªã£ãŠããŸããããã©ãã«ã®èª¬æéšåã«çްããå
·äœäŸãèšè¿°ãããç°¡çŽ ãªãã®ã«ããããåŸãªããšããããšããããŸããã äžåºŠããŒã¹ãšãªãæç€ºãäžããåŸã§è€æ°ããŒã¿ã®ããã¹ãããŸãšããŠå
¥åããããšãå¯èœã§ã¯ãããŸãããããŒã¯ã³æ°ãé·ããªãããšã«ãã£ãŠç²ŸåºŠãäžããå¯èœæ§ãããããããŒã¯ã³æ°ã®ãµã€ãºå¶éã«åŒã£ãããå¯èœæ§ããããšããç¹ãçæãããšãäžççžã§ã¯ãããªããããããŸããã ãããã¯ChatGPTã®ãã¡ã€ã³ãã¥ãŒãã³ã°æ©èœãããŸã掻çšã§ããã°ãã®ç¹ã解決ã§ãããããããããã®èŸºãã¯èŠæ€èšŒãšãã£ããšããã§ãã éŸå€ã®èšå® ããã¹ãåé¡ã¢ãã«ãšåããããªæ¯ãèããããŠããŸãããåºåã確çã§ã¯ãªãã©ãã«ãã®ãã®ã§ãããããéŸå€ã®èª¿ç¯ãã§ããªãç¹ã¯æ¬ ç¹ãšããŠæããããŸãã äžå¿ããã³ããã®äžã«ç¢ºåºŠïŒconfidenceïŒãšããŠ0ã100ã®æ°å€ãåºåããããããªãªãã·ã§ã³ã«ãäžå¿å¯Ÿå¿ãããŠã¯ã¿ãŸããããããŸãä¿¡é Œã§ããªãå°è±¡ããããŸãããïŒå
šäœã§äžè²«ããåºæºãä¿ãããŠããªãå°è±¡ã§ãããïŒ ãããã« åé ã§ãè§Šããéããã£ããLLMã«é¢ããŠã¯ãæ
å ±æ€çŽ¢ã®ä»£æ¿çãªäœ¿ãæ¹ããèŠçŽã翻蚳ãçžè«åœ¹ãã¢ã€ãã¢åµåºãèªåŠåŠç¿ãšãã£ãã話ãçžæããã¢ã·ã¹ã¿ã³ããçãªãã®ã代衚çãªãŠãŒã¹ã±ãŒã¹ãšããŠåãäžããããããšãå€ãã§ãããèŠæ¹ãå€ããã°ãå®çŸ©ããåé¡ãè§£éããèªåçã«è§£ããªããæå®ãããã©ãŒãããã§åºåããŠãããããŒã«çãªäœ¿ãæ¹ãå¯èœã§ãã 人éã®è©±ãçžæã«ãªã£ãŠããããã人éãè§£ããªãé£ããåé¡ãè§£ããŠããããããAIãšããåŽé¢ã®ä»ã«ãåŸæ¥äººéãè¡ãªã£ãŠãããåçŽã§çããããçšåºŠæ±ºãŸã£ãŠãããäžçç¥èããªããšè§£ããªããèªç¶èšèªã®çµ¡ãã¿ã¹ã¯ãèªåçã«åŠçããŠãããAIãšããåŽé¢ã«çç®ãããšãæ¥åã®å€§å¹
ãªå¹çåãã³ã¹ãåæžãå³ãããããããŸããã ãŸããå®éããã³ããæ¬¡ç¬¬ã§ã¯ããã¹ãåé¡ã®ã¢ãããŒã·ã§ã³ã ãã§ãªãããã¹ãã®ã¯ã©ã¹ã¿ãªã³ã°[4]ãããŒã¿ã®æ¡åŒµ[5]ãªã©ã«ã€ããŠãå¿çšäŸãèããããŠãããåŸæ¥ã®æ©æ¢°åŠç¿æè¡ãšããŸãçµã¿åãããããšã§ãæ°ãã䟡å€ããã€ã³ãã¯ãã®ãã䜿ãéãçºèŠã§ãããããããŸããã æè¿ã§ã¯ãã£ããLLMã¯ç»åãšããã¹ãã®å
¥åºå察å¿ã«ãããã«ãã¢ãŒãã«åãšããæ¬¡ã®ã¹ãããã«é²ã¿ã€ã€ãããLLMãå©çšãã人éåŽãé ãæãããããŠããããããªå©çšå¯èœæ§ãæš¡çŽ¢ãæ€èšŒããŠããããšãæ±ããããŸãã æåŸãšãªããŸãããåŒç€Ÿã§ã¯æ©æ¢°åŠç¿ãšã³ãžãã¢ãåéããŠãããŸãïŒ ãèå³ã®ããæ¹ã¯ãæ°è»œã«ãå¿åãã ããïŒ https://open.talentio.com/r/1/c/binc/homes/4380 ææ¥ã¯@endu ããã®èšäºã§ãããæ¥œãã¿ã«ïŒ References [1] Fabrizio Gilardi, Meysam Alizadeh, Maël Kubli, âChatGPT Outperforms Crowd-Workers for Text-Annotation Tasksâ, Mar 2023. [2] G. Hinton, O. Vinyals, and J. Dean, âDistilling the knowledge in a neural networkâ, Mar. 2015. [3] https://openai.com/policies/terms-of-use [4] Yuwei Zhang, Zihan Wang, Jingbo Shang, âClusterLLM: Large Language Models as a Guide for Text Clusteringâ, May 2023 [5] Zhihong Shao, Yeyun Gong, Yelong Shen, Minlie Huang, Nan Duan, Weizhu Chen, âSynthetic Prompting: Generating Chain-of-Thought Demonstrations for Large Language Modelsâ, Feb 2023