
AIã®åé¡è¡šã«ããŸã 空ããŠããå ŽæïœNeedle 2ãšããæ°ããAIïœ
æ¯æ¥ã®ããã«ãæ°ããAIã¢ãã«ãç»å ŽããŸãã
ãããè³¢ããªã£ãLLMã
ãå°ãããªã£ãLLMã
ãã³ãŒãã£ã³ã°ã«åŒ·ãLLMã
ãæšè«ã«åŒ·ãLLMã
ç§ã¯æè¿ãããããã¢ãã«ãä¹ ãã远ã£ãŠããªãã®ã§ãããããŸã ãã®æ¹æ³ããã£ãïŒããšé¢å¿ããAIãåºãŸããã
Needle 2ã§ãã
Cactus ComputeãéçºããŠããã45Mãã©ã¡ãŒã¿ãçŽ14MBãšããæ¥µå°ã®AIã¢ãã«ã§ãã
å
¬åŒãªããžããªïŒ
https://github.com/cactus-compute/needle
ããã¯LLMã®å°åçã§ã¯ãªã
Needle 2ãåŸæãªã®ã¯ãTool CallingãDevice UseãStructured Extractionãªã©ãç°¡åã«èšãã°ã人éã®èšèããæ©æ¢°ãå®è¡ã§ãã圢ã«å€æããAIã§ãã
人éã®æç€º
â
Needle 2
â
Tool Call / JSON
â
APIã»DBã»ã¢ããªã»æ©åš
äŸãã°ããææ¥ã®æ7æã«ç §æãã€ããŠã
ãšããæç€ºãåãããããã®æå³ãæ§é åããŠãå®éã®ããŒã«ãåŒã³åºãã
ããã«å·šå€§ãªLLMã¯å¿ ãããå¿ èŠãããŸãããå¿ èŠãªã®ã¯ããèããããšãã§ã¯ãªããæ£ããå®è¡ããããšããNeedle 2ã¯ãããã«ç¹åããŠããŸãã
ãå°ããAIããšãããããAIã®éšåã
Needle 2ãæ°ãããšæã£ãçç±ã¯ããã€ããããŸããOllamaãªã©ã§äœ¿ã7Bã14Bã30Bãšãã£ãLLMã¯ãåºæ¬çã«ãé è³ãã§ãã
äžæ¹ãNeedle 2ã¯ããã®é è³ããä»äºã®äžéšãåãé¢ããããã«èŠããŸãã
倧åLLM
ãã©ãããïŒã
â
Needle 2
ãäœãå®è¡ããïŒã
â
API / DB / ã¢ããª
LLMãå°ãããããšããLLMãããå®è¡ããšããä»äºãç¬ç«ãããŠããŸããç§ã¯ããã«ãæ°ããAIã®å±
å ŽæãæããŸããç§ãªããããŒã³ã«ç©ãã§ãé£ã³åãããã§ãã
çšéã¯çãããã§ãçããªã
Tool Callingã ããèŠããšãçšéãéå®ãããŠããããã«èŠããŸããããããèªç¶èšèªãæ§é åãããæäœãžå€æããããšèãããšãäžæ°ã«åºãããŸãã
Web APIãããŒã¿ããŒã¹ã
ãããŒã³ã
ã¹ããŒãããŒã ãIoTãããããã
ããŒã«ã«ã¢ããªãæ¥åã·ã¹ãã ã
èªäœãããã€ã¯ããµãŒãã¹ã
ã€ãŸããNeedle 2ã®åŸãã«äœãæ¥ç¶ãããã¯ãéçºè 次第ã§ãããããçŽ14MBã
ãAIãäžã€å°å ¥ããããšãããããã·ã¹ãã ã«AIã®å°ããªéšåãäžå远å ãããšããæèŠããã¿ããšã¯ãŸãããã§ãã
ãŸã ããã®ãžã£ã³ã«ã®ååããªã
çŸåšã¯ãEdge AIããSmall Language ModelããAgentic LLMããTool Calling Modelããªã©ãæ¢åã®èšèã§èª¬æãããããããŸããã
ã§ããã©ãããã£ããããŸãããããã§ããããŠååãä»ãããªãã
Action ModelïŒã¢ã¯ã·ã§ã³ã¢ãã«ïŒ
Execution ModelïŒå®è¡ã¢ãã«ïŒ
Tool ModelïŒããŒã«ã¢ãã«ïŒ
Agent Component ModelïŒãšãŒãžã§ã³ãéšåã¢ãã«ïŒ
AI Micro-ModelïŒAIãã€ã¯ãã¢ãã«ïŒ
ãŸã æ£åŒã«å®ãŸã£ããžã£ã³ã«åã§ã¯ãããŸãããããããååãä»ããŠããã®ãããããŸããã
AIã®åé¡è¡šã«ããŸã 空ããŠããå Žæ
ãããŸã§ç§ãã¡ã¯ãAIããã©ãã ãè³¢ãããã§èŠãŠããŸãããã§ããããããã¯éããããããŸããã
èããAI
â
LLM / Reasoning
èŠãAI
â
Vision Model
æ¢ãAI
â
Embedding / Reranker
åããAI
â
Needle 2ã®ãããªã¢ãã«
Needle 2ã¯ããã®ç©ºããŠããå Žæã«ãããªããã¿ããšå ¥ããŸããã ããç§ã¯ããããããŸãæ°ããAIã¢ãã«ãåºãããšã¯æããŸããã§ããã
AIã®åé¡è¡šãã®ãã®ã«ãæ°ããæ¬ãã§ãããããããªãã
æ¯æ¥å¢ããŠããAIã®ååã远ããããã®ã§ã¯ãªãããããããä»ãŸã§ãªãã£ãå Žæããæ¢ããNeedle 2ã¯ããããªAIã®èŠæ¹ãæããŠãããæ°ãããŸãã
#AI #çæAI #LLM #Needle2 #CactusCompute #AgentAI
#EdgeAI #ToolCalling #ããŒã«ã«AI #AIãšãŒãžã§ã³ã #AIéçº #OSS