
ãAIå ¥éãChatGPTãæ¯åéãçããè¿ãçç±ââãæž©åºŠããã©ã¡ãŒã¿ãæ¯å©ã§çè§£ãã
ChatGPTã«åã質åã2åéããšãæ¯å埮åŠã«éãçããè¿ã£ãŠããŸãããæšæ¥ã¯äžæããã£ãã®ã«ã仿¥ã¯éãããšæããçµéšã¯ãããŸãããã
ð¡ïž ããã¯ãã°ã§ã¯ãããŸãããAIãæå³çã«ãã©ã³ãã æ§ããæã€ããã«èšèšãããŠããããã§ãã
ä»åã¯ãAIã®è¿çããªãæ¯åå€ããã®ãââãã®ä»çµã¿ãæ¯ãããæž©åºŠïŒTemperatureïŒããšãããã©ã¡ãŒã¿ãæ¯å©ã§è§£èª¬ããŸãããã®ä»çµã¿ãç¥ããšãChatGPTã®äœ¿ãæ¹ãããäžæ®µéæ·±ããªããŸãã
AIã¯ã確çãã§æ¬¡ã®èšèãéžãã§ãã
ãŸãåºæ¬ã«ç«ã¡è¿ããŸãã
ð ãã®ã·ãªãŒãºã®ç¬¬2åã§èª¬æããããã«ãLLMã¯ãæ¬¡ã«æ¥ãèšèã確çã§éžã¶ãä»çµã¿ã§åããŠããŸããã仿¥ã®å€©æ°ã¯ããšããæã®æ¬¡ã«ã¯ããæŽããã40%ããæããã30%ããéšãã20%ããè¯ããã5%âŠâŠãšããããã«ãåè£ã®èšèããããã«ç¢ºçãå²ãæ¯ãããŠããŸãã
ããã§éèŠãªåãããããŸãããã®ç¢ºçãæãé«ãèšèããåžžã«éžã¹ã°ããã®ã§ã¯ïŒ
å®ã¯ãããããããšåé¡ãèµ·ããŸãã
ãäžçªç¢ºçãé«ãèšèã ãéžã¶ããšäœãèµ·ããã
ð æã確çã®é«ãèšèã ããéžã³ç¶ãããšãAIã®è¿çã¯æ¯åãŸã£ããåãã«ãªããŸãã
ããšãã°ãããããã®æ è¡å ã¯ïŒããšèãããšããåžžã«ã京éœããšã ãçãç¶ããAIãæ³åããŠãã ããã確ãã«ééãã§ã¯ãããŸããããåã質åãäœåºŠããŠãåãçãããè¿ã£ãŠããªããåµé æ§ããªãã䜿ã£ãŠããŠé£œããŠããŸããŸãã
ð¡ ãŸãã確çãæãé«ãèšèã ããéžã¶ãæ¹éã¯ãæç« ãéäžã§ç¡éã«ãŒãã«é¥ããªã¹ã¯ããããŸãããããããã¯äº¬éœã§ãã京éœã¯ããããã§ããããããã¯äº¬éœã§ãâŠâŠããšããããã«ãåããã¿ãŒã³ãç¹°ãè¿ããŠããŸãããšããããŸãã
ãããé²ãããã«å°å ¥ãããã®ããæž©åºŠãã§ãã
ãæž©åºŠããšã¯äœãââç©çã®æ¯å©ã§çè§£ãã
ð¡ïž ãæž©åºŠããšããååã¯ãç©çåŠããåããŠããæ¯å©ã§ãã
ç©çã®äžçã§ã¯ãæ°äœååã®æž©åºŠãé«ãã»ã©ååã®åãã¯æ¿ãããäºæž¬ãã«ãããªããŸããæž©åºŠãäœãã»ã©ååã¯èœã¡çããåããäºæž¬ãããããªããŸãã
AIã®ã枩床ãã©ã¡ãŒã¿ãã¯ãããšãŸã£ããåãèãæ¹ã§ãã
枩床ãé«ãïŒäŸïŒ1.0ã2.0ïŒ â 確çã®äœãèšèãç©æ¥µçã«éžã¶ããã«ãªããŸããã京éœã以å€ã«ãã¢ã€ã¹ã©ã³ãããç æŒ ã®ã©çãäžããæé¢ããšãã£ãæå€ãªéžæè¢ãåè£ã«äžãã£ãŠããŸããè¿çã¯åµé çã»å€æ§ã«ãªããŸãããè絡ã®ãªãçããåºããããªããŸãã
枩床ãäœãïŒäŸïŒ0ã0.3ïŒ â 確çã®é«ãèšèã ããéžã¶ããã«ãªããŸããè¿çã¯å®å®ã»äžè²«ããŸãããæ¯å䌌ããããªçãã«ãªããŸããæ£ç¢ºããæ±ããããäœæ¥ã«åããŠããŸãã
ð ããããã«ãŒã¬ãããã§äŸãããšçŽæçã§ããæž©åºŠãé«ããšãã«ãŒã¬ããã®ç®ãåçã«æ£ãã°ã£ãŠãã©ãã«æ¢ãŸããããããªããç¶æ ãæž©åºŠãäœããšãã»ãšãã©ã®é¢ç©ããåœéžãã§åãŸã£ãŠããã«ãŒã¬ããã§ãã»ãŒæ¯ååãå Žæã«æ¢ãŸãç¶æ ã§ãã
çšéã«ãã£ãŠã枩床ãã䜿ãåãã
⡠枩床ã®ä»çµã¿ãç¥ããšãã©ã䜿ãåããã°ããããèŠããŠããŸãã
é«ãã®æž©åºŠãåããŠããçšéïŒ
ã¢ã€ãã¢åºãã»ãã¬ã€ã³ã¹ããŒãã³ã°
åµäœã»ç©èªã»è©©ã®çæ
æ°ããèŠç¹ãæå€ãªçºæ³ã欲ãããšã
äœãã®æž©åºŠãåããŠããçšéïŒ
äºå®ç¢ºèªã»èŠçŽã»ç¿»èš³
ã³ãŒãã®çæã»ãã°ä¿®æ£
決ãŸã£ã圢åŒã§åºåããŠã»ãããšãïŒäœææŽåœ¢ã衚ã®äœæãªã©ïŒ
ChatGPTã§ã¯ãäŒè©±ã€ã³ã¿ãŒãã§ãŒã¹ã®äžã§æž©åºŠãçŽæ¥æå®ããããšã¯ã§ããŸããããããã³ããã®æžãæ¹ã§éæ¥çã«ã³ã³ãããŒã«ã§ããŸãããèªç±ã«çºæ³ããŠããšæžãã°é«æž©ã«è¿ãåããããããããæ£ç¢ºã«ã»äžè²«ãã圢åŒã§ããšæžãã°äœæž©ã«è¿ãåããåŒãåºããŸããAPIã䜿ãéçºè ã¯ã`temperature`ãã©ã¡ãŒã¿ãšããŠ0ã2ã®æ°å€ãçŽæ¥æå®ã§ããŸãã
ãTop-pãââæž©åºŠãšçµã¿åãããããäžã€ã®èšå®
ð§ æž©åºŠã«å ããŠã**Top-pïŒãŸãã¯Nucleus SamplingïŒ**ãšããèšå®ãèŠããŠãããšçè§£ãæ·±ãŸããŸãã
枩床ããå šåè£ã®ç¢ºçãã©ãæ£ãããããæ±ºããã®ã«å¯ŸããTop-pã¯ãäžäœäœ%ã®åè£ã®äžããéžã¶ãããæ±ºããŸãã
ããšãã°Top-p=0.9ãªãã確çã®åèšã90%ã«éããäžäœã®åè£çŸ€ã®äžããã ãéžã³ãŸããæ¥µç«¯ã«ç¢ºçãäœãèšèïŒããšãã°æèã«å šãåããªãåèªïŒã¯æåããåè£ããé€å€ãããã®ã§ã枩床ãäžããŠã極端ã«çå€ããªèšèãåºã«ãããªããŸãã
枩床ãšTop-pãçµã¿åãããããšã§ããåµé çã ãã©æ¯é¢æ» è£ã§ã¯ãªãããšããçµ¶åŠãªãã©ã³ã¹ãäœãããšãã§ããŸãã ChatGPTã®ããã¯ãšã³ãã§ããã®2ã€ãçµã¿åãããŠèª¿æŽãããŠããŸãã
ãŸãšãïŒAIã®ã©ã³ãã æ§ã¯ãèšèšãããæºãããã ã£ã
ð ä»åã®å å®¹ãæŽçããŸãã
â LLMã¯æ¬¡ã®èšèã確çã§éžã¶ããã®ç¢ºçãžã®ãæºããããå¶åŸ¡ããã®ã枩床ãã©ã¡ãŒã¿
â æž©åºŠãé«ãã»ã©å€æ§ã§åµé çãªè¿çã«ãäœãã»ã©å®å®ã»äžè²«ããè¿çã«ãªã
â ããã³ããã®æžãæ¹ã§æž©åºŠã«è¿ã广ã鿥çã«åŒãåºãã
â Top-pãšçµã¿åãããããšã§ãåµé çãã€æ¯é¢æ» è£ã§ãªãããã©ã³ã¹ãåãã
â æ¯åéãçããè¿ã£ãŠããã®ã¯ãã°ã§ã¯ãªããæå³çã«èšèšãããæºãã
ãæ¯ååãçããè¿ã£ãŠããªããããšãžã®æžæãããä»çµã¿ãç¥ãããšã§ãããããèšèšãªã®ãããšããçŽåŸã«å€ãããŸãã ChatGPTã䜿ãäžã§ã®ãäºæž¬äžå¯èœããããé©åãªæž©åºŠèšèšã®çµæãšããŠçè§£ã§ããããã«ãªããŸãã
次åã¯ãAIã¯ã©ããã£ãŠãå«ççãªè¿çããåŠãã ã®ãââRLHFãšããä»çµã¿ãæ¯å©ã§çè§£ãããã解説ããŸãã
ãã©ããŒã»ã¹ãã§ç¶ããèªãå±ã¿ã«ãªããŸã ð±
ãããããããã£ãããšæã£ãããåšãã®AIåå¿è ã®æ¹ã«ã·ã§ã¢ããŠãããããšå¬ããã§ãã
é¢é£èšäº
ãã®ã·ãªãŒãºã®ä»ã®èšäºãããããŠã©ããã