
å€ç®æŒ±ç³ã®å°èª¬ããã£ãŒãã©ãŒãã³ã°ã«èªãŸããŠãããã質åããŠã¿ã
Transformersãšããèªç¶èšèªåŠçã®ãã£ãŒãã©ãŒãã³ã°ã¢ãã«ããããŸããããããç°¡åã«æ§ç¯ã§ããSimple Transformersãé¢çœãããªã®ã§è©ŠããŠã¿ãŸããã
Simple Transformersã䜿ããšãã¢ãã«ã«æç« ãèªãŸããããšããã¡ãã質åããããšæç« ã®äžããåçãè¿ããŠãããŸãã
ãšããããšã§ãå€ç®æŒ±ç³ã®å°èª¬ãããã€ãèªãŸããŠQ & Aããã£ãŠã¿ãããšæããŸãã
1. å€ç®æŒ±ç³ã®å°èª¬ãå ¥æãã
å€ç®æŒ±ç³ã®å°èª¬ã¯é空æåº«ããå ¥æã§ããŸãã
ãã ãé空æåº«ã®ããŒã¿ã¯ã«ããå ¥ã£ãŠããããšãããããããããåãé€ããªããšSimple Transformersãæ£ããèªèããŠãããŸããã
ã«ãã®åé€ã¯äžã®ããŒãžããã§ããŸãã
ã«ããåé€ãããããã¹ããã¡ã€ã«ã«ä¿åããŸãã
2. Simple Transformersã®ã¢ãã«ããã¬ãŒãã³ã°ãã
Simple Transformersã«ã€ããŠã¯ããã¡ãã®èšäºã®ãæ¥æ¬èªã®ããŒã¿ã»ããã§ã®è³ªåå¿çããåèã«ããŸããã
ã¢ãã«ã®äœæãšé転ãã¡ã€ã³QAããŒã¿ã»ãããçšãããã¬ãŒãã³ã°ãŸã§ã¯åããªã®ã§å²æããŸãã
3. ã¢ãã«ã«å°èª¬ãèªã¿èŸŒãŸããŠQ & Aããã
å€ç®æŒ±ç³ã®å°èª¬ãã¢ãã«ã«èªã¿èŸŒãŸããŠã質åå¿çããã£ãŠã¿ãŸãã
ãŸãã¯ããèæããèªã¿èŸŒãã§ã¿ãŸãã
with open("å€ç®æŒ±ç³_èæ_æ¹è¡ãªã.txt") as f:
kusa = f.read()åé ã®æåãªæãæèããªããããæºã«åããšã©ããªãïŒããšãã質åãããŠã¿ãŸãã
to_predict = [{"context": kusa, "qas": [{"id": "0", "question": "æºã«åããšã©ããªãïŒ"}]}]
print(model.predict(to_predict))
# åºåçµæ
# ([{'id': '0', 'answer': ['è§ãç«ã€', 'è§', 'æºã«åãã°è§ãç«ã€ãæ
ã«æ£¹ããã°æµããããæå°ãéãã°çª®å±ã ããšããã«äººã®äžã¯äœã¿ã«ããã äœã¿ã«ãããé«ãããšãå®ãæãžåŒãè¶ããããªããã©ããžè¶ããŠãäœã¿ã«ãããšæã£ãæãè©©ãçããŠãç»ãåºæ¥ãã', 'æºã«åãã°è§ãç«ã€ãæ
ã«æ£¹ããã°æµããããæå°ãéãã°çª®å±ã ããšããã«äººã®äžã¯äœã¿ã«ããã', 'å®ãæãžåŒãè¶ããããªã', 'æšç', 'å®ãæãžåŒãè¶ãã', 'ç ããªã', 'åŽ', '埡åããã¯ããèµ€ãæçµ¡ã®æä»£ããéãè¶ããŠãã ãã¶ããšäžåž¯ãã¿ãé¡ããåž³å ŽãžæããŠãã ãããèãšã¯æåããããç¥ãããçã¯å¹Žã
åž°ã£ãŠæ¥ãŠãæ³¥ãå£ãã åŽãããããããã«åãããŠãããç¥ãããçãšé
ã®éŠãšã¯ã©ãããŠãæ³åããåãé¢ããªãã', 'åãã°è§ãç«ã€', 'æŠé£', 'ç³', 'åŽããããããã', '山路ãç»ããªãããããèããã æºã«åãã°è§ãç«ã€', 'å°å¥³é', 'è§ãç«ã€ã', 'äŒè©±ã¯ããã§åããã飯ã¯ããããäºããè³ãåŒããšããå°å¥³éãå
¥å£ã®è¥ãéãããäžåºã®æ œèŸŒã¿ãéãŠãŠãåãäºéã®æ¬å¹²ã«éæè¿ããé ¬æãçªããŠãéåããæ¥æ³èгé³ã®ããã«äžãèŠè©°ããŠããã仿ã«åŒãæ¿ããŠãã¯ãªã¯ã éããªå§¿ã§ããã俯åããŠãç³ã®åããããã¡ããžéããªããããçžå¥œã«ãã»ã©ãªå€åãæ¥ããããã®ã§ãããããæã®äººã¯äººã«åãããã®çžåããè¯ãã¯ãªããšäºã£ãããã ãããªãã»ã©äººçããâ»(ãå¹¿ïŒæº²ã®ã€ãããã第3æ°Žæº1-84-15)ãããã人éã®ãã¡ã§çŒã»ã©æŽ»ããŠããéå
·ã¯ãªããå¯ç¶ãšåãäºåæ¬ã®äžãããè¶ã
ãäºçŸœå¯ãã€é¢ãã€èãäžãããé端ã«ããéšå±ã®è¥ã¯ãããã®ã§ãããè¥ã®é³ã«ã女ã¯åç¶ãšè¶ããçŒãäœã®æ¹ã«è»¢ãããèŠç·ã¯æ¯ç¢ã®ããšã空ã貫ããŠãäŒéããªãäœãçéã«èœã¡ããã¯ã£ãšæãéã«ãå°å¥³éãããŸãã¯ããšè¥ãç«ãŠåã£ããããšã¯è³æ¥µåæ°ãªæ¥ãšãªãã', 'åŒãè¶ããããªã', 'ç']}],
# [{'id': '0', 'probability': [0.5551466995386687, 0.2512035715161981, 0.14229527176495205, 0.02671039231109063, 0.005804802123475206, 0.0057596287949632525, 0.002448325391820815, 0.001190890268624726, 0.0011565070253226923, 0.001084317928849465, 0.0010399816881365236, 0.0009644123299206214, 0.0008806837714756102, 0.0008510908939693412, 0.000804070998145307, 0.0005906859899324285, 0.0005505798834178715, 0.0005157088534782025, 0.0005020435656273177, 0.0005003305256351624]}])åºåçµæã®ãã¡ãanswerã«ã¯ç¢ºçã®é«ãçãããé ã«åºåãããŸãããŸããprobabilityã«ã¯ç¢ºçãå ¥ã£ãŠããŸãã
ãè§ãç«ã€ããã55.5%ã®ç¢ºçã§ãããšåºãŠããŸãããããæãã«è¿ã£ãŠããŸãã
ç¶ããŠãããã質åããŠã¿ãŸãããã
â»åçã¯ãã¹ãŠè»¢èšãããšé·ãã®ã§çããã®ã ããæç²ããŠããŸã
ãæ ã«æ£¹ãããšã©ããªãïŒã
['容赊', '容赊ã¯ãªã', 'æµããã']è¥å¹²éãèšèãåºãŠããŠãŸãããïŒçªããæ£è§£ã§ãã
ã§ã容赊ã¯ãªããšããã®ãããªããšãªããã£ãŠãããããããŸããã
æå°ãéããšã©ããªãïŒ
['窮å±', '窮å±ã ããšããã«äººã®äžã¯äœã¿ã«ããã äœã¿ã«ãããé«ãããšãå®ãæãžåŒãè¶ããããªã']人ã®äžã¯ã©ããªæãïŒ
['äœã¿ã«ãã', 'äœã¿', 'åºããè·¯ã倱ã£ããããªæã', 'äœã¿ã«ããã äœã¿ã«ãããé«ãããšãå®ãæãžåŒãè¶ããããªã']ãŽã£ããæ£è§£ããŸããã
ãåŸèŒ©ã¯ç«ã§ãããããã£ãŠã¿ãŸãããã
åŸèŒ©ã¯èª°ïŒ
['äžå¥³', '䞻人', '坿å']ã ãã¶ééã£ãŠããŸããAIãèªåã®ããšã䞻人ã ãšèšãåºããšæãã§ããã
次ã¯ããããããã§è©ŠããŠã¿ãŸãããã
å
çãšç§ã¯ã©ãã§åºäŒã£ãïŒ
['æè¶å±', 'çç çº', 'çé¢']åé éšåãæ¡çšãããŠããŸããã
åäžå¿ã®ãªããã®ã¯ãªã«ïŒ
['銬鹿', '銬鹿ã ãšãã£ãŠ', '銬鹿ã ']ããã¯å çãKã«èšã£ãèšèã§ããã
Kãšãããã£ã©ã¯ã¿ãŒã¯ãã¹ãã€ãã¯ã§ã©ããæ°ã«ãªããšããããããŸããKã«ã€ããŠèããŠã¿ãŸãããã
ã¯äœã奜ãã ã£ãïŒ
['è©©éãªã©ãèªãäº', '粟é²ãšããèšè', 'éœå']ãŸãã«ãKã®ã€ã¡ãŒãžéãã§ãã
ã®å¥œããªé£ã¹ç©ã¯ãªã«ïŒ
['è»é¶', '粟é²ãšããèšè', '粟é²']è»é¶ã¯ãã·ã£ã¢ããšèªã¿ããã¯ããªã®ããã§ãã
æåŸã«å°èª¬ã®æžãæã§ãããç§ãã«ã€ããŠã質åããŠã¿ãŸãã
ç§ã¯äœã奜ãã ã£ãïŒ
['麊é
', 'é£äºã®ææ°å', 'å
çãšãã£ããã«éºŠé
']ãªãã»ã©ðº
â