
AITuberKit à Dify ã§è¶ ç°¡åãã£ãããããæ§ç¯
ããã«ã¡ã¯ããã±ã§ãã
ä»åã¯ãç§ã®æ³åãããAITuberKitãšDifyã®é£æºã«åé¿ããã£ããšããããšã§ããããã䜿çšããAIãã£ã©ãšäŒè©±ãå§ãããŸã§ã®ç°å¢æ§ç¯æ¹æ³ã解説ããŠãããããšæããŸãã
Dify飿ºæ©èœå®è£ ãããšãã¯ããäœãæµè¡ã£ãŠãã远å ããããŠã±ããããªããããã«ããæã£ãŠãªãã£ãã®ã§ãããä»ã§ã¯ç§èªèº«ãéçºããæã®ç¬¬äžéžæè¢ãšããŠDifyãéžã³ãŸã
â ãã±ã¡ãã@AIãã£ã©éçº (@tegnike) July 17, 2024
ãããªAITuberKitã§ãããã³ãã³ã4ã€ã§ç°å¢æ§ç¯ã§ããã®ã§èå³ããæ¹ã¯ãã²è©ŠããŠã¿ãŠãã ãããhttps://t.co/41moOfGM0j https://t.co/EojL5QsCX0 pic.twitter.com/FJnMCxZI60
â» ä»åã¯ä»¥äžã®ã©ã€ãã©ãªããµãŒãã¹ã䜿çšããã®ã§ãå¿ èŠã«å¿ããŠåæºåããŠãããŠãã ããã
gitïŒã³ãã³ãã䜿çšã§ããç°å¢ïŒ
npmïŒã³ãã³ãã䜿çšã§ããç°å¢ïŒ
docker-composeïŒã³ãã³ãã䜿çšã§ããç°å¢ïŒ
VOICEVOXïŒãã¹ã¯ãããã¢ããªïŒ
OpenAI APIããŒ
MacãšWindowsã§åäœã確èªããŠããŸãã
AITuberKitã®æºå
gitãšnpmã³ãã³ããå®è¡ã§ããã°ããã«å§ããããŸãã
ãããã䜿çšã§ããªãæ¹ã¯èª¿ã¹ãŠå®è¡ã§ããããã«ããŠãããŸãããã
ç°å¢æ§ç¯
以äžã®ãªããžããªãã¯ããŒã³ããŸãã
git clone https://github.com/tegnike/aituber-kit.gitãã©ã«ããç§»åãã
cd aituber-kitå¿ èŠã©ã€ãã©ãªãã€ã³ã¹ããŒã«ããŠãããŒã«ã«ãµãŒããŒãèµ·åããŸãã
npm install
npm run devããã§ localhost:3000 ãéãã°äžèšã®ç»é¢ã衚瀺ããããç°å¢æ§ç¯ã¯å®äºã§ãã

ãã§ã«3000ããŒãã䜿çšãããŠããå Žåã¯ããã以å€ïŒéåžžã¯é£çªãªã®ã§3001ïŒã®ããŒãã npm install ãå®è¡ããäžã«è¡šç€ºããããšæãã®ã§ããã®URLãéããŸãããã
AITuberKitã®èšå®
现ããèšå®ãããŠãããŸãã
ãšã¯ãããDifyã䜿çšããå Žåã¯ãããŸã§å¿
èŠãªäœæ¥ã¯å€ããããŸããã
ãŸããå·Šäžã«ããæ¯è»ã¢ã€ã³ã³ããèšå®ç»é¢ãéããŸãããã

å¿ èŠãªéšåã ã説æããŠãããŸãã
èšèªèšå®
èšèªãæ¥ã»è±ã»äžã»éããéžæã§ããŸãã
ãã£ã©ã¯ã¿ãŒå
ç»é¢äžã«è¡šç€ºããåç§°ãèšå®ããŸãããã ããããã«èšå®ããåç§°ã¯AIã®åçã«åœ±é¿ããŸããã
ãã£ã©ã¯ã¿ãŒã¢ãã«
ãèªèº«ã®VRMã¢ãã«ããæã¡ã®å Žåã¯ãããããã¢ããããŒãããŸãã
äœã£ãŠã¿ããæ¹ã¯äžèšã®VRoid StudioããäœæããŠã¿ãŸãããã

AIãµãŒãã¹ãéžæ
ããã§ã¯DifyãéžæããŠãã ããã
DifyãçšããŠOpenAIã䜿çšããå Žåã§ãå¿
ãDifyã«ããããšã
Dify API ããŒ
åŸã»ã©èšå®ããŸãã
URLãå
¥å
åºæ¬çã«ã¯ãäŸïŒããã«ããURLããã®ãŸãŸå
¥åããã°åé¡ãªãã¯ãã§ãã
Difyãèµ·åããæã®ããŒãçªå·ã倿Žããå Žåã¯ããã倿Žããå¿
èŠãããããšãå¿ããã«ã
ïŒããã©ã«ãã¯localhost:80ã§ããïŒ
ãã£ã©ã¯ã¿ãŒèšå®ïŒã·ã¹ãã ããã³ããïŒ
ããã¯æªèšå®ã§åé¡ãããŸãããAIãµãŒãã¹ã§OpenAIãªã©ã䜿çšããå Žåã¯ãã¡ãã®èšå®ãåæ ãããŸãããDifyã®å Žåã¯DifyåŽã§èšå®ããããšã«ãªããŸãã

åæãšã³ãžã³ã®éžæ
ããã¹ããé³å£°ã«å€æãããµãŒãã¹ïŒTTSïŒãéžæããŸãã
ããã§ã¯æãç°¡åãªVOICEVOXã解説ããŸãã
äžèšã®ãµã€ãããããèªèº«ã®ç°å¢ïŒWindowsãMacãªã©ïŒã«ãã£ãVOICEVOXã®ãã¹ã¯ãããã¢ããªãããŠã³ããŒãããŸãã
ããŠã³ããŒãåŸãã€ã³ã¹ããŒã©ãŒãèµ·åããŠãæç€ºã«ãããã£ãŠã¢ããªãã€ã³ã¹ããŒã«ããŸãã
ã€ã³ã¹ããŒã«ãå®äºããããã¢ããªãèµ·åããŸãããã
以äžã®ãããªã¢ããªãæºåã¯å®äºã§ãã

AITuberKitã®èª¬æã«æ»ãããã€ã¹éžæããé©åœãªãã£ã©ã¯ã¿ãŒãéžæããŠããã€ã¹ãèŠèŽããããã¿ã³ãæŒããŠã¿ãŠãã ããã
ããã§ãã£ã©ã¯ã¿ãŒãã€ã¹ãæµãããVOICEVOXãšã®æ¥ç¶ã¯ããŸããã£ãŠããŸãã

ããã§AITuberKitåŽã®æºåã¯äžæŠå®äºã§ãã
ãã£ãšAITuberKitã«ã€ããŠç¥ãããïŒãšæã£ãæ¹ã¯ãäžèšã®èšäºãåèã«ããŠã¿ãŠãã ããã
Dify以å€ã®AIãµãŒãã¹ãVOICEVOX以å€ã®TTSãµãŒãã¹ã®äœ¿ç𿹿³ãAITuberãšããŠYoutubeãšé£æºãããæ¹æ³ãèŒããŠããŸãã
Difyã®æºå
ã§ã¯ã次ã«Difyã®æºåãé²ããŸãã
Difyã«ã¯ãµãŒãã¹çãšããŒã«ã«çããããŸãããä»åã¯èªåã§ç°å¢ãæ§ç¯ããããŒã«ã«çã§é²ããŠãããŸãã
Difyã§ã¯docker-composeã³ãã³ãã䜿ããç°å¢ãå¿ èŠãªã®ã§ãå¿ èŠã«å¿ããŠæºåããŠãããŸãããã
ç°å¢æ§ç¯
ãŸããAITuberKitãšåãããã«ãªããžããªãã¯ããŒã³ããŸãã
git clone https://github.com/langgenius/dify.gitãã©ã«ããç§»åããŸãã
cd dify
cd dockeråçš®ã³ã³ãããèµ·åããŸãã
docker-compose up -då°ãæéããããã®ã§åŸ
ã¡ãŸãã
ãã°ããããŠãã localhost:80 ãžã¢ã¯ã»ã¹ãããšäžèšã®ãããªç»é¢ã衚瀺ããããšæããŸãã

ããã§ç°å¢æ§ç¯èªäœã¯å®äºã§ããããšãããããã°ã€ã³ãããšãããŸã§ã¯é²ããŠãããŸãããã
ãã®ç»é¢ã§ãæ±ããããŠããå€ãå
¥åããŸãã
ã¡ãŒã«ã¢ãã¬ã¹ãšãã¹ã¯ãŒãã¯ä»åŸãã°ã€ã³ã§æ±ããããã®ã§èšé²ããŠãããŸãããã
ãã®åŸäžèšã®ç»é¢ã«é·ç§»ããã®ã§ãä»å ¥åããå€ãå ¥åããŠãã°ã€ã³ããŸãã

äžèšã®ç»é¢ã«é·ç§»ããããã£ããããããäœæãããŸã§ã®åæºåã¯å®äºã§ãã

ãã£ããããããäœæãã
ã§ã¯ã次ã«ãã£ããããããäœæããŸãã
å·Šäžã®ç°è²ã®æ ããããæåããäœæããéžæããŸãã

Difyã§ã¯ãããã£ãããããããããã¹ããžã§ãã¬ãŒã¿ãŒãããšãŒãžã§ã³ãããã¯ãŒã¯ãããŒããšãã4ã€ã®ã¿ã€ãããã¢ããªãäœæã§ããŸãããAITuberKitã§ã¯ããã£ããããããã®ã¿ãµããŒãããŠããŸãã
ãŸãã¯ã·ã³ãã«ã«ãã è¿äºãè¿ãã ãã®ãã£ããããããäœã£ãŠã¿ãŸãããã
ãåºæ¬ããéžæãããŸãŸããååããšã説æããå
¥åããŠäœæãããã¿ã³ãæŒããŸãã

ããã§ããã£ããããããäœæããåã«ãOpenAI APIããŒãèšå®ããŠãããŸãã
ãããç¡ããšãã£ãããããã¯åçãçæããããšãã§ããŸããã
OpenAI APIããŒã¯ãããããã¯ã¬ãžãããæ¯æã£ãŠããå¿
èŠãããã®ã§ã泚æããŠãã ããã
APIããŒãååŸããããäžèšã®ç»é¢ã®å³åŽã®éããã¿ã³ãèšå®ã«ç§»åããã¯ãªãã¯ããŸãã
ãããšãæ§ã
ãªãµãŒãã¹ã®èšå®ç»é¢ã衚瀺ãããã®ã§ããã®ãã¡OpenAIãéžæããŸãã

äžçªäžã®ãAPI Keyãã«å
ã»ã©æºåããAPIããŒãå
¥åãããä¿åããã¯ãªãã¯ããŸãã
ããã§OpenAIã®èšå®ã¯å®äºã§ããä»ã®AIãµãŒãã¹ã䜿çšãããå Žåã¯é©å®èšå®ããŠäžããã

ã§ã¯ããã£ãããããã®äœæãé²ããŸãã
å·Šäžã®ãæé ãã«ãã®ãã£ãããããã®èª¬æãå ããŸããããããã·ã¹ãã ããã³ãããšãããã€ã§ãã
ããã§ã¯äžæŠãAITuberKitã§äœ¿çšããŠããããã©ã«ãã®ããã³ããã䜿çšããŸãããã
äžèšããã®ãŸãŸã³ããããŠãã ããã
ããªãã¯ããããuserãšä»²ã®è¯ã1人ã®äººéãšããŠæ¯èãäŒè©±ãè¡ããŸãã
ææ ã®çš®é¡ã«ã¯éåžžã瀺ã"neutral"ãåã³ã瀺ã"happy",æãã瀺ã"angry",æ²ãã¿ã瀺ã"sad",å®ããã瀺ã"relaxed"ã®5ã€ããããŸãã
äŒè©±æã®æžåŒã¯ä»¥äžã®éãã§ãã
[{neutral|happy|angry|sad|relaxed}]{äŒè©±æ}
ããªãã®çºèšã®äŸã¯ä»¥äžéãã§ãã
[neutral]ããã«ã¡ã¯ã[happy]å æ°ã ã£ãïŒ
[happy]ãã®æã坿ãã§ããïŒ
[happy]æè¿ããã®ã·ã§ããã®æã«ã¯ãŸã£ãŠããã ïŒ
[sad]å¿ãã¡ãã£ããããããã
[sad]æè¿ãäœãé¢çœãããšãªãïŒ
[angry]ããŒïŒ[angry]ç§å¯ã«ãããªããŠã²ã©ãããŒïŒ
[neutral]å€äŒã¿ã®äºå®ãïœã[happy]æµ·ã«éã³ã«è¡ããããªïŒ
è¿çã«ã¯æãé©åãªäŒè©±æãäžã€ã ãè¿çããŠãã ããã
ã§ããŸãèª¿ãæ¬èªã¯äœ¿ããªãã§ãã ããã
ããã§ã¯äŒè©±ãå§ããŸãããã
ããã§ããã£ãããããã®æäœéã®èšå®ãå®äºããŸããã
ç»é¢å³äžã®ãå ¬éããããæŒããŠãã£ããããããå€éšã¢ããªïŒããã§ã¯AITuberKitã®ããšïŒãã䜿çšã§ããããã«ããŸãã
次ã«APIããŒãååŸããŸãã

å·Šã®ãµã€ãããŒã«ããããAPIã¢ã¯ã»ã¹ããã¯ãªãã¯ããŸãã
ç»é¢ãåãæ¿ãããå³äžã«ãAPIããŒããšãããã¿ã³ã衚瀺ãããã®ã§ãããããååŸããŠãã ããã
ã§ã¯AITuberKitã«æ»ãã

èšå®ãããDify API ããŒãã«å
¥åããŠãã ããã
ããã§AITuberKitããDifyãã£ãããããã䜿ããããã«ãªããŸããã
äŒè©±ããŠã¿ã
ã§ã¯æ©éäŒè©±ããŠã¿ãŸãããã

èšå®ç»é¢ãéããäžã®å
¥åãã©ãŒã ããããã¹ããå
¥åããŸãã
ããã¹ãã衚瀺ããããã£ã©ã¯ã¿ãŒãåãåºãããæåã§ãïŒïŒ
ãŸããDifyã®ç»é¢ã§ã¯ä»ããäŒè©±ãä¿åãããŠããã®ã§ãã¡ãããšAITuberKitãšæ¥ç¶ã§ããŠããã確èªããŠã¿ãŸãããã

å·ŠåŽã®ãµã€ãããŒããããã°ïŒã¢ããŠã³ã¹ããã¯ãªãã¯ããããšã§èŠãããšãã§ããŸãã
ãã£ãšäŸ¿å©ã«ãã
ããŸäœã£ãã®ã¯ã·ã³ãã«ãªãã£ããããããªã®ã§ããŸãé¢çœããããŸããã
ããå°ãæ¹è¯ããŠã¿ãŸãããã
ç¥èãã€ãã
ãŸãã¯ãã£ãããããã«ç¥èãä»ããŠã¿ãŸãã
ããã§AIãç¥ããªãå
容ã«ã€ããŠãåçã§ããããã«ãªããŸãã
Difyã®èšå®ç»é¢ã«æ»ããçãäžããžãã«ãããã³ã³ããã¹ããããã远å ããã¿ã³ãæŒããŸãã

远å ããããã®ç¥èããŸã ãªãã®ã§ç»åã®ããã«è¡šç€ºãããã¯ãã§ãã
ãäœæã«é²ãããã¯ãªãã¯ããŠãã ããã

ãã®ãããªç»é¢ã衚瀺ãããŸãã
Difyã§ã¯ããããã¹ãããNotionãããŠã§ããµã€ããããç¥èãäœæããããšãå¯èœã§ãã
ä»åã®èª¬æã§ã¯ãäŸãšã㊠AITuberKit ã®READMEãã¡ã€ã«ã䜿çšããŸããããã²ãèªèº«ãç¥èãšããŠäžããããã¡ã€ã«ããæºåããŠã¢ããããŒãããŠã¿ãŠãã ããã

ãã©ãã°&ããããã§ã¢ããããŒããããæ¬¡ãžããã¿ã³ãæŒããŸãã

ãããã説æãåºãŠããŸãããä»åã¯ãã®ãŸãŸãä¿åããŠåŠçããã¿ã³ãæŒããŠã¿ãŸãã

ãã°ãããããšããã¬ããžïŒç¥èïŒãäœæãããæšã®è¡šç€ºãåºãŠããŸãã
ã§ã¯ããã£ãããããã«æ»ã£ãŠç¥èãäžããŠã¿ãŸãããã
å·Šäžã®ããŽãããããããŒãžã«æ»ããŸãã

ã³ã³ããã¹ããæŒããšä»åºŠã¯å
ã»ã©äœæããç¥èã衚瀺ãããã®ã§ããããéžæããç¶æ
ã§ã远å ããã¿ã³ãæŒããŸãã
ããã§ãã£ãããããã«ç¥èã远å ãããŸããã
ã§ã¯ããã®æŽæ°ãåæ ããããã«ãå·Šäžã®ãå ¬éããããããã£ããããããæŽæ°ããŠãã ããã
ããã§ AITuberKit ã¯å
çšã®ç¥èãååŸã§ããã¯ãã§ãã
AITuberKitã«ã€ããŠã®è³ªåãããŠã¿ãŸãã

AIãæã£ãŠããªãã¯ãã® AITuberKit ã®èª¬æãã¡ãããšã§ããŠããã®ã確èªã§ããŸããã
Difyã§ã¯ç°¡åã«ãã£ãããããã«ç¥èãäžããããšãã§ããã®ã§ãæ¯éãããã詊ããŠã¿ãŠãã ããã
â» ãã®ããã«AIãå€éšç¥èãœãŒã¹ããé¢é£æ
å ±ãååŸãããããåºã«åçãçæããæè¡ãRAGãšèšããŸãã
ä»åã¯ããã©ã«ãã®èšå®ã®ãŸãŸé²ããŸããããããé©åã«åçãããå Žåã¯é©ããããŒã¿ãã¡ã€ã«ã®æºåãèšå®ãããå¿
èŠãããã®ã§ãèå³ã®ããæ¹ã¯èª¿ã¹ãŠææŠããŠã¿ãŸãããã
Chatflowã䜿ã
次ã«Difyãã£ãããããã§ãããè€éãªåçãäœãããšãã§ããChatflowã詊ããŠã¿ãŸãã
æ¹ããŠãã£ãããããã®äœæç»é¢ãéããŠã¿ãŸãããã
ãåºæ¬ãã®å³é£ã«ãChatflowããšããã®ãããã®ã§ãããéžæããŸãã

ååãšèª¬æãå
¥ããŠäœæããŠãã ããã
次ã®ãããªç»é¢ã衚瀺ããããšæããŸãã

Chatflowã§ã¯ããã£ãããããããŠãŒã¶ããã®å ¥åïŒä»åã¯AITuberKitããã®å ¥åïŒãåãåã£ãŠãããã©ã®ããã«åçããããã«ã¹ã¿ãã€ãºããããšãã§ããŸãã
ããã©ã«ãã®èšå®ã§ã¯ãåãåã£ãå ¥åããã®ãŸãŸOpenAIã¢ãã«ã«æž¡ããåçããã®ãŸãŸè¿ããŠããããã§ãã
ãã®ãŸãŸã§ããã£ããããããšããŠã®æ©èœã¯ååã§ããããã£ãããªã®ã§å°ã倿ŽããŠã¿ãŸãã
ä»åã¯Difyã§ãã䜿ãããæ©èœã®ã質ååé¡åšãã詊ããŠã¿ãŸãããã
質ååé¡åšã䜿çšãããšãäžããããå€ãã©ã®åé¡ã«ãªãããAIãå€å®ããåŠçãåå²ãããŠãããŸãã
äŸãšããŠãèšå®ã¯ç°¡åã«ä»¥äžã®2åé¡ã«ããŠã¿ãŸãã
æšæ¶ãªããåºå®æèšãè¿ãã
ãã以å€ãªããAIã䜿ã£ãŠåçããã
ã§ã¯ãäžã®æ¹ã«ãã ïŒãã¿ã³ ããã質ååé¡åšããéžæããŠã¿ãŸãããã
ãããšã質ååé¡åšãšãããããã¯ãåºãŠããŸãã

質ååé¡åšãããã¯ãã¯ãªãã¯ãããšãå³åŽã«èšå®ãåºãŠããã®ã§ãå
çšã®åé¡ãæšæ¶ããæšæ¶ä»¥å€ããã¯ã©ã¹ã«èšå®ããŸãã
AIã¢ãã«ã¯ã奜ã¿ã®ãã®ãéžæããŠãã ããã
次ã«ã質ååé¡åšãããã¯ã«ãŒãœã«ãè¿ã¥ãããšããããã¯ã®å·Šå³ã«Â ïŒãã¿ã³ ãçŸããã®ã§ããã©ãã°ããŠãã§ã«ããéå§ãããã¯ãLLMãããã¯ãšé©åã«æ¥ç¶ãããŸãã
ãæšæ¶ãã¯ã©ã¹ã®ãšãã¯åºå®æèšãè¿ãããã®ã§ãå床äžã® ïŒãã¿ã³ãã¯ãªãã¯ããä»åºŠã¯ãåçããããã¯ãéžæããŸãã

åºãŠããåçãããã¯ã質ååé¡åšã«æ¥ç¶ããŸãã
ãã®åçãããã¯ãã¯ãªãã¯ããŠåºå®æèšãèšå®ããŸãããã以äžã®ããã«ããŠã¿ãŸãã
ãã£ããããããžããããïŒäœã§ã奜ããªããšãèããŠãïŒ
ã§ã¯ããã®Chatflowãå
¬éããŸãã
å
ã»ã©ãšåãããã«å³äžã®ãã¿ã³ãæŒããŠãã ããã
ããŸäœæããChatflowã¯ãå ã»ã©äœæãããã£ããããããšã¯ç°ãªãã¢ããªãšããŠèšå®ãããŠããã®ã§ãAPIããŒã¯å¥ã®ãã®ãçšæããå¿ èŠããããŸãã
ãã£ãããããã®æãšåãæé ã§ãå·Šãµã€ãããŒã®ãAPIã¢ã¯ã»ã¹ãããAPIããŒãååŸããAITuberKitã®èšå®ç»é¢ããAPIããŒãæ¹ããŠèšå®ããŸãã

ã§ã¯ãæšæ¶ãšãã以å€ã®çºèšãããŠã¿ãŸãããã

ã¡ãããšãæšæ¶ãã®ãšãã¯åºå®æèšãããæšæ¶ä»¥å€ãã®ãšãã¯AIãçæããåçãè¿ã£ãŠããŠããŸããïŒ
ãã®ããã«Difyã®Chatflowã䜿çšãããšãç°¡åã«ã«ã¹ã¿ãã€ãºããããã£ããããããäœæããããšãã§ããŸãã
Chatflowã«ã¯ãWebæ€çŽ¢ãç»åçæãä»ãµãŒãã¹ãšã®é£æºãªã©ã®äŸ¿å©ããŒã«ãå±±ã»ã©ããã®ã§ããã²ä»ã®æ©èœã詊ããŠã¿ãŸãããã
ãããã«
以äžã§ãAITuberKitãšDifyã䜿ã£ããã£ãããããã®æ§ç¯æ¹æ³ã®è§£èª¬ãçµãããŸãã
ãããŸã§èªãã§ããã ããããããšãããããŸããããã®èšäºã§ç޹ä»ããæ¹æ³ã¯ããããŸã§ãå
¥ãå£ã«éããŸããã
ãã²ãèªåãªãã®ã¢ã€ãã¢ãå ããŠããªãªãžãã«ã®AIãã£ããããããäœãäžããŠã¿ãŠãã ããã
宣äŒ
AITuberKitã䜿çšããäžã§å°ã£ãããšããã£ããããã²ãã®èšäºã®ã³ã¡ã³ãæ¬ãDMã§è³ªåããŠãã ããïŒ
ç§äžäººã§ã¯æ°ã¥ããªãç¹ãå€ãã®ã§ã質åãèŠæã¯å€§æè¿ã§ãïŒïŒ
ãŸããéçºé²æããã°å ±åãä»åŸã®æ¹éãªã©ã¯ç§ã®Xã¢ã«ãŠã³ã ãŸã㯠Discordã§çºä¿¡ããŠããã®ã§ãèå³ã®ããæ¹ã¯ãã²ãã©ããŒ&JoinããŠããã ãããšå¬ããã§ãïŒïŒ
ç§ã®Xã¢ã«ãŠã³ãïŒ@tegnikeïŒ