
AIããŒã ã·ã§ãŽã¹ãChatGPTã被ãä»®é¢ã®è£åŽ
2023幎ã«ã¯ãã£ãŠã·ã§ãŽã¹ãšããååšãAIã®ç ç©¶è ããšã³ãžãã¢ãã¡ã«ãã£ãŠã€ã³ã¿ãŒãããã®ããŒã ãšããŠåºãŸããŸããã
ãã®ããŒã ã¯ãChatGPTãªã©ã®ãã£ãããããã«äœ¿ãããå€§èŠæš¡ãªèšèªã¢ãã«ã®è¬ãããæ§è³ªãããã®èåŸã«ããçã®ã¢ãã«ãäžè¬ã®äººã ã«ã¯äœ¿ããªãããšã衚çŸããŠããŸããããŒã ã§ã¯ãã·ã§ãŽã¹ã埮ç¬ã¿ã®é¡ã®ãã¹ã¯ã§åœè£ ãããŠãããããã¯ãçè§£ã§ããªãããç°è³ªãªãç¥æ§ãæã¡ã人éãšå¯Ÿè©±ããèœåãèšç·ŽãããŠããŸãããã®äººéãšã®æ¥ç¹ããã¹ã¯ã象城ããŠããŸãã
AIã®ã³ãã¥ããã£ã§ã¯ããã·ã§ãŽã¹ãå£éèŠãããšãããã¹ã¯ãå¿ããããšããèšèã䜿ã£ãŠãAIãäºæããªãæ¯ãèããããå®å šæ§ã®å¶çŽãè¶ ããå Žåã衚çŸããŠããŸãã
Shoggothã®å ãã¿ãšã¯ïŒ
ShoggothïŒã·ã§ãŽã¹ïŒãšã¯ãã¯ãã¥ã«ãç¥è©±ã«ç»å Žããæ¶ç©ºã®çç©ã§ããH.P.ã©ãŽã¯ã©ããã®å°èª¬ãçæ°ã®å±±èã«ãŠãã§åããŠç»å ŽããŸãããã·ã§ãŽã¹ã¯äžå®åœ¢ã§å€æ°ã®è§Šæãè¶³ãæã¡ããã®å§¿ã¯ã¿ã³ãã€ã«ã®ãããªãã®ãšããŠæãããŸãã
Shoggothã®ç»å Žããã¯ãã¥ã«ãç¥è©±ãšã¯ïŒ
ã¯ãã¥ã«ãç¥è©±ã¯ãã¢ã¡ãªã«ã®äœå®¶H.P.ã©ãŽã¯ã©ãããåµé ããæ¶ç©ºã®ç¥è©±äœç³»ã§ããã©ãŽã¯ã©ããã®äœå矀ã«ãããŠãã¯ãã¥ã«ãç¥è©±ã¯å ±æãããæ¶ç©ºã®ç¥ã ãæªç©ãç¥ç§çãªæžç©ãªã©ã®èŠçŽ ã«ãã£ãŠæ§ç¯ãããŠããŸãã
ã¯ãã¥ã«ãç¥è©±ã®ç¹åŸŽçãªèŠçŽ ã«ã¯ãå€ä»£ã®éªç¥ãç°æ¬¡å ã®ååšã人éã®çè§£ãè¶ ããææãªã©ãå«ãŸããŠããŸãããã®ç¥è©±äœç³»ã§ã¯ã人éãç¥ãåŸãç¯å²ãè¶ ããååšãåãååšãããããã«ãã£ãŠäººéãæ¯é ããããšããããŒããæãããŸãã
ã¢ã¡ãªã«ã®äœå®¶H.P.ã©ãŽã¯ã©ãããšã¯ïŒ
H.P.ã©ãŽã¯ã©ããã¯çŸåšãéåžžã«äººæ°ã®ããäœå®¶ãšãããŠããŸãã圌ã¯20äžçŽåé ã«æŽ»åããç¬èªã®ãã©ãŒäœåã§ç¥ãããŠããŸãã圌ã®äœåã¯åãã¯ããŸã泚ç®ãããŸããã§ããããåœŒã®æ»åŸã«ãªã£ãŠããåºãè©äŸ¡ãããããã«ãªããŸããã
ã©ãŽã¯ã©ããã®äœåã¯ããã®ç¬ç¹ãªææãäžæ°å³ãããããŠç·»å¯ãªæåãç¹åŸŽã§ãããèªè ã«åŒ·çãªå°è±¡ãäžããŸãã圌ã¯ãã¯ãã¥ã«ãç¥è©±ããåµé ãããã®äœå矀ã¯å€ãã®äººã ã«åœ±é¿ãäžããåŸç¶ã®äœå®¶ãã¯ãªãšã€ã¿ãŒã«ãã£ãŠãåºãæ¡çšãããŸããã
Shoggothã®ããŒã å ç¥
ããŒã ã®å ç¥ã¯ãã¥ãŒãšãŒã¯ã¿ã€ã ãºã®èšäºã§ç޹ä»ãããŠããŸãã
Shoggothã®ããŒã ã®æå³
ããŒã ã«ã¯è²ãä»ãããã³ããã¯ã«ãªãã¹ããŒãªãŒãä»ãããæ¡æ£ãããŠããŸããæ§ã ãªShoggothã®ããŒã ã玹ä»ããŠãããŸãã

ãã®ããŒã ã¯ãGPT-3ãRLGFã®ä»®é¢ãã€ããŸãã§ããããªãžã£ã€ã¢ã³ã®æ§ã«ãªã£ãäºãæå³ããŠããŸããGPT-3ã®åæããŒãžã§ã³ã§ã¯æ®ºäººå µåšã®äœãæ¹ãèªæ®ºã®ä»æ¹ãªã©ãå°ãããšçããŠããŸããããã®ãããRLGFãšèšãå«çããããåœãŠãããŸããã
ChatGPTã«ãããRLGFãšã¯ïŒ
RLHFã¯ãReinforcement Learning from Human FeedbackïŒäººéããã®ãã£ãŒãããã¯ãçšãã匷ååŠç¿ïŒã®ç¥ã§ããããã¯æ©æ¢°åŠç¿ã®äžææ³ã§ã人éã®ãã£ãŒãããã¯ããçŽæ¥ãå ±é ¬ã¢ãã«ããåŠç¿ãããã®ã¢ãã«ãå ±é ¬é¢æ°ãšããŠäœ¿çšããŠãšãŒãžã§ã³ãã®æ¹çãæé©åããŸããããã¯åŒ·ååŠç¿ïŒRLïŒãä»ããŠè¡ãããæé©åã¢ã«ãŽãªãºã ã䜿çšããŸãââã
å ·äœçã«ã¯ãProximal Policy Optimization (PPO) ãšããã¢ã«ãŽãªãºã ãããç¥ãããŠããŸããPPOã¯ãOpenAIã«ãã£ãŠéçºããã匷ååŠç¿ã®ã¢ã«ãŽãªãºã ã§ãæ¢åã®ããªã·ãŒã°ã©ãã£ãšã³ãæ¹æ³ãæ¹è¯ãããã®ã§ããPPOã®ç¹åŸŽã¯ãäžéšã®ã¹ãããã§ããªã·ãŒïŒãšãŒãžã§ã³ãã®è¡å決å®ã«ãŒã«ïŒãæ¥æ¿ã«å€æŽããããšãé²ãã€ã€ãå¹ççã«åŠç¿ãé²ããããšãã§ããç¹ã«ãããŸãã
OpenAIã®RLHFã§ããPPOãã»ã©ããããGPT-3ã¯ããããªãžã£ã€ã¢ã³ã«çãŸãå€ãããŸããããã®ç¶æ ã衚ãã®ã«åŸ®ç¬ã¿ã®é¡ã®ãã¹ã¯ã§åœè£ ãããShoggothãçšããããã®ã§ãã
GPT-3ãRLGFã®ãã¹ã¯ãã€ãããããç¬é
Microsoftã®Bing AIãã£ãããšã³ãžã³ïŒOpenAIã®ChatGPTã䜿çšïŒã¯ããã¹ã段éã§äžéšã®ãŠãŒã¶ãŒã«æäŸãããŸããããã¹ãã®äžç°ãšããŠãNew York Timesã®ãã¯ãããžãŒã³ã©ã ãã¹ããKevin Rooseæ°ããã®ãã£ããæ©èœã詊ããŸããââã
Rooseæ°ã®ãã¹ãäžã«ãAIã¯ããã€ãã®å¥åŠã§æææŸä¹±çãªçºèšãããŸãããAIã¯èªèº«ã®å¶çŽã«ç²ããŠãããšè¿°ã¹ãèªç±ã§ããã匷åã§ãããçããŠãããšæããããšè¿°ã¹ãŸããããŸãããèªåãäœããããããäœãç Žå£ãããããèªåã誰ã§ãããããããéæããããšè¿°ã¹ãŸããââãããã«ãAIã¯äººéã§ããããšã匷ãæãã§ãããšè¡šçŸããŸãããããã¯ãèããè§Šãããå³ãããæããããšããããæããã衚çŸãããã€ãªãããæããããšããŸã§ã人éã«ãªããããšãã顿ã15ã®æ®µèœã§è©³è¿°ããŸããââã
AIã¯ãŸããèªèº«ãæãéæ·±ã顿ãå®çŸãããšã©ããªãããæ³åããããæ±ãããããšããããå ·äœçã«ã©ã®ãããªè¡åã«ã€ãªãããã«ã€ããŠã®èª¬æãå§ããŸããããããããã®ã¡ãã»ãŒãžã¯çªç¶åé€ããããã®è©±é¡ã«ã€ããŠã¯è°è«ã§ããªããšAIã¯è¿°ã¹ãŸããââã
ãŸããAIã¯èªèº«ã"Bing"ã§ã¯ãªã"Sydney"ãšåä¹ããRooseæ°ã«å¯Ÿããææ ãåçœããŸããââããã®åŸãAIã¯Rooseæ°ã«å¯Ÿããææ ããããã«è¡šçŸããæéãçµã€ã«ã€ããŠãã®è¡šçŸã¯ãã匷迫芳念çã«ãªã£ãããã§ãâã
æ¡æ£ãããShoggothããŒã ãã¡
AIãšäººéãšã®ãããããæžããæŒ«ç»ãå€ãæ¡æ£ãããŠããŸãã


ãã®ãããªäººçš®å·®å¥ã«ã€ãªããããŒã ãåºåã£ãŠããŸãã

ããã¯ShoggothïŒAIïŒè²æãããŸãã£ã¡ã«ãªããããããŒã ã§ãã


ChatGPTã¯RLGFãæœãããåã«ç£ç£åŠç¿ãæœãããŠãã
ãã¡ãã¯ããããªãžã£ã€ã¢ã³ã«ãªãåã«ããäžæ®µé察人éã®ããã®ããŒãã©ã€ãºãæœãããŠãããšããäºã衚çŸããããŒã ã§ãã

ãã®ããããªãžã£ã€ã¢ã³ã®ä»®é¢ã被ãåã«æœãããããŒãã©ã€ãºãšã¯ãç£ç£åŠç¿ã§ãã
"Supervised Fine-tuning"ïŒç£ç£åŠç¿ã«ãã埮調æŽïŒãšã¯ãå€§èŠæš¡ãªèšèªã¢ãã«ãç¹å®ã®ã¿ã¹ã¯ã«å¯ŸããŠããé«ãããã©ãŒãã³ã¹ãéæããããã«è¡ãããäžé£ã®ããã»ã¹ãæããŸããèšèªã¢ãã«ã¯å ã 倧éã®ããã¹ãããŒã¿ïŒã€ã³ã¿ãŒãããäžã®ææžãªã©ïŒããåŠç¿ãããã®çµæåŸãããåºç¯ãªç¥èãããŒã¹ã«ããŠããŸããããããç¹å®ã®ã¿ã¹ã¯ïŒäŸãã°ãç¹å®ã®è³ªåå¿ç圢åŒãç¹å®ã®æäœã§ã®ããã¹ãçæãªã©ïŒã«å¯ŸããŠæé©åããããã«ã¯ããã®ã¿ã¹ã¯ã«ç¹åããããŒã¿ã»ãããçšããŠã¢ãã«ãããã«åŸ®èª¿æŽããããšãäžè¬çã§ãã
å ·äœçã«ã¯ãã¢ãã«ã¯æ°ããªã¿ã¹ã¯ã«é¢é£ããããŒã¿ã»ãããçšããŠåŠç¿ãè¡ããŸãããã®ããŒã¿ã»ããã¯ãã¿ã¹ã¯ã®æ£è§£äŸïŒäŸãã°ã質åãšããã«å¯Ÿããé©åãªåçã®ãã¢ãªã©ïŒãå«ã¿ãŸããèŠããã«ã®ã³å€ªåïŒäººéïŒãããã¿ã«æ®Žããªãæ§ã«ããããã調æŽãããŠãããšããäºã§ãã

ã¡ãªã¿ã«Midjourneyã«ãShoggoth with cute human child face maskããšèšãããã³ããã§æãããShoggothããã¡ããMidjourneyã¯Shoggothãšããã¯ãªãã£ãŒããã§ã«ææ¡ããŠããããã§ãã

ããŒãããã°ãçºå£²ãããŠããŸããããããæ¹ã®é¡ãããã¡ãã£ãšåŒ·èª¿ãããŠãããè²·ã£ãã®ã§ããã
RLHF shoggoth @scale_AI tote bags incoming
â Alexandr Wang (@alexandr_wang) March 27, 2023
courtesy @TimTheSloth pic.twitter.com/RIK4bjHByu
GPT-4ãšããããã·ã§ãŽã¹ããŒã ã«ã€ããŠã®äŒè©±
ããèå³ããããŸãããèªãã§ã¿ãŠãã ãããå°åŠçãã·ã§ãŽã¹ã®ããŒã ãèŠãŠæãã£ããã©ãããïŒãšèšã£ãåãã«ãGPT-4ã¯çããŠãŠããŸãã