
SD 1.5ãSDXLãSD 3ãFLUX.1ãAuraFlowã¢ãã«ã®GGUFåãšå©ç𿹿³ïŒWindowsïŒ
â» Last update 1-15-2025
â» å€æã®æé ã¯1.ïœ2.ãåç
§ããŠãã ããã察å¿åœ¢åŒã¯ãã¿ã€ãã«ã«èšèŒã®ã»ãã«ã¯LTXVããããŸãïŒæªæ€èšŒïŒã
â» ã¢ãã«å
èµã®Text EncoderãããŒã¹ã¢ãã«ã®ãã®ãšã¯ç°ãªãå Žåã¯ãGGUF倿åŸãåãText Encoderã䜿çšããå¿
èŠããããŸãïŒç¹ã«SD 1.5ãSDXLã¯æ³šæïŒã
â 0. æŠèŠ
⌠0-0. ã¯ããã«
ãæ¬èšäºã§ã¯ãåçš®ã®ç»åçæã¢ãã«ãGGUF圢åŒã«å€æããç°å¢ãæ§ç¯ããŸãããŸããå®éã«å€æãè¡ã£ãŠå©çšããŠã¿ãŸãã
ããã®èšäºãå ¬éãããŸã§ã«æ°ã¶æãçµã£ãŠããŸããŸããããå€æã®æ¹æ³ã«ã€ããŠã¯äžèšã®èšäºã§ç¥ããŸããïŒæè¬ïŒã
⌠0-1. GGUF圢åŒã®ã¡ãªãã
ãã¢ãã«ãGGUFåãããšãäŸãã°Q8_0ã§ã¯ãã¡ã€ã«ãµã€ãºãçŽååïŒFP16ãBF16æ¯ã®å ŽåãText EncoderãšVAEã¯é€å€ïŒã«ãªããåçãµã€ãºã®FP8圢åŒããã粟床ãè¯ãããšãå©ç¹ãšãªããŸããQ6_K以äžã§ããã°ããã«å°ãããªããŸãããåœç¶ãªãã粟床ãäžãã£ãŠãããŸãã
ãäžèšã®èšäºã§ã¯ãFLUX.1ã«ãŠæ¯èŒãè¡ã£ãŠããŸãããªãœãŒã¹ãå°ãã§ãç¯çŽãããå Žåã¯ãQ6_Kçãéžæè¢ã«å ¥ããããããŸããã
⌠0-2. GGUF圢åŒã«ã€ããŠ
ãå€§èŠæš¡èšèªã¢ãã«ïŒLLMïŒãèªã¿èŸŒãããã«ã¯ãèŠæš¡ã«å¿ãã倧éã®ã¡ã¢ãªïŒäŸãã°æ°åGB以äžã100GB以äžïŒãå¿ èŠã§ãåäœç°å¢ãéå®ãããŸãããã®ãããããå°ãªãã¡ã¢ãªã§ããã€æ©ãæšè«ã§ããããã«éååããå Žåãå€ãããã®éã«å©çšããããã©ãŒããããGGUF圢åŒã§ãã24幎å€é ãããç»åçæã¢ãã«ã«ãããŠãããçšåºŠã®åºãããèŠããŠããŸãã
ãåèãŸã§ãäžèšã®èšäºã«ãŠLLMãGGUF圢åŒã«å€æããæ¹æ³ã説æããŠããŸããæ¬èšäºã§ã¯llama.cppã«ããããåœãŠãããšã§ãç»åçæã¢ãã«ã®å€æãã§ããããã«ããŸãã
â 1. ç°å¢ã®æ§ç¯
⌠1-1. æŠèŠ
ãComfyUIã§GGUF圢åŒãå©çšããããã®æ¡åŒµããŒããããããªããžããªã®toolsãã£ã¬ã¯ããªã«ã¯å€æã«å¿ èŠãªæ å ±ããããŸããçŸåšã®å¯Ÿå¿ç¶æ³ã¯å±¥æŽã確èªããŠãã ãããå·çæç¹ã§ã®æçµæŽæ°ã¯24幎11æã§ããã
ComfyUI-GGUF/tools/
https://github.com/city96/ComfyUI-GGUF/tree/main/toolsÂHistory for ComfyUI-GGUFtools
https://github.com/city96/ComfyUI-GGUF/commits/main/toolsÂ
ã倿ããããã®ç°å¢ã¯ãComfyUIã®ä»®æ³ç°å¢ã«äŸ¿ä¹ã§ããããªæ°ãããŸãããæ¬èšäºã§ã¯ç¬ç«ããä»®æ³ç°å¢ãäœæããŸãããã®å ã®æé ã§ã¯Pythonãå¿ èŠã§ãã
ãComfyUIããå©çšã®æ¹ã¯ãComfyUI-GGUFããææ°çã«æŽæ°ããŠãããŠãã ããã
⌠1-2. Build Tools for Visual Studio 2022ã®ã€ã³ã¹ããŒã«
ãæ¢ã«ã€ã³ã¹ããŒã«ãããŠããå Žåã¯èªã¿é£ã°ããŠãã ããã
ãhttps://visualstudio.microsoft.com/ja/downloads/ ãžã¢ã¯ã»ã¹ããŠãã ãããäžã«ã¹ã¯ããŒã«ãããšããã¹ãŠã®ããŠã³ããŒããããããŸãã®ã§ããâãã¹ãŠå±éããã¯ãªãã¯ããŸãããTools for Visual Studioãã®äžã«ãBuild Tools for Visual Studio 2022ããããã®ã§ãããŠã³ããŒãããŠå®è¡ããŸãã
ïŒâ»ãã®æé ã¯ããŸã«ã埮åŠã«å€æŽãããå ŽåããããŸãïŒ

ãã€ã³ã¹ããŒã©ãŒãèµ·åãããããC++ã«ãããã¹ã¯ãããéçºãã«ãã§ãã¯ãå ¥ããŠã€ã³ã¹ããŒã«ããŠãã ããããã®ç»é¢ã衚瀺ãããªãå Žåã¯ããVisual Studio Build Tools 2022ãã®ã倿Žããã¯ãªãã¯ãããšé·ç§»ããŸãã

⌠1-3. CMakeã®ã€ã³ã¹ããŒã«
ãéååãè¡ãllama-quantizeããã«ãããããã«ãCMakeã®ææ°çãã€ã³ã¹ããŒã«ããŸããã€ã³ã¹ããŒã«ããããŒãžã§ã³ãå€ããªã£ãŠããå Žåãããã®ã§ãå°å ¥ãæè¿ã§ã¯ãªãå Žåã¯æŽæ°ãããããããŸãã
ãhttps://cmake.org/download/ ãžã¢ã¯ã»ã¹ããŠãã ããããBinary distributions:ãã«ãããWindows x64 Installer:ããããŠã³ããŒãããŠãå®è¡ããŸãããã®ãŸãŸé²ããã ãã§æ§ããŸããã
⌠1-4. å®è¡ç°å¢ã®æºå(1)
ãæ¬èšäºã§ã¯äœæ¥ãã£ã¬ã¯ããªãã\aiworkããå®è¡ãã£ã¬ã¯ããªãã\aiwork\sd-ggufããšããŠããŸããã奜ã¿ã§èªã¿æ¿ããŠãã ããã
ãã³ãã³ãããã³ãããéããäžèšã®ã³ãã³ããé ã«å®è¡ããŠãã ããããpip installãã®ç®æã¯ãããŠã³ããŒãçã§å€å°ã®æéãèŠããŸãã
cd \aiwork
mkdir sd-gguf
cd sd-gguf
git clone https://github.com/ggerganov/llama.cpp
cd llama.cpp
python -m venv venv
venv\Scripts\activate
python.exe -m pip install --upgrade pip
pip install torch --index-url https://download.pytorch.org/whl/cu121
pip install safetensors
pip install .\gguf-py⌠1-5. å®è¡ç°å¢ã®æºå(2)
ãäžèšã®2ãã¡ã€ã«ãããŠã³ããŒãããŠãã\aiwork\sd-ggufãã«ç§»åããŠãã ããã
https://github.com/city96/ComfyUI-GGUF/blob/main/tools/convert.pyÂ
https://github.com/city96/ComfyUI-GGUF/blob/main/tools/lcpp_sd3.patchÂ
ãä»åŸã察å¿åœ¢åŒãå¢ããéã«ãlcpp_sd3.patchããããæ°ããpatchãã¡ã€ã«ãå ¬éãããŠããå¯èœæ§ããããŸããComfyUI-GGUF/tools/ ã®æ å ±ã確èªããŠã¿ãŠãã ããã
ããªããããŠã³ããŒãã¯ã¢ã¯ã»ã¹å ã®ç»é¢ã®å³äžããè¡ããŸãã

ããããŸã§ã®æé ã§ãå®è¡ãã£ã¬ã¯ããªãäžèšç»é¢ã®ç¶æ ã«ãªã£ãŠããã¯ãã§ãã

⌠1-6. å®è¡ç°å¢ã®æºå(3)
ãç¶ããŠãäžèšã®ã³ãã³ããé ã«å®è¡ããŠãã ãããè²ã ãšã¡ãã»ãŒãžã衚瀺ãããå ŽåããããŸãããæ°ã«ããå¿ èŠã¯ãããŸããã
ããªãããtags/b3962ããšãlcpp_sd3.patchãã®ç®æã¯ã察å¿åœ¢åŒã®è¿œå ã§å€æŽãããå ŽåããããŸãããã ComfyUI-GGUF/tools/Â ã«æ°ããŒãžã§ã³ã®æ å ±ãããã°ãå 容ã確èªããªããèªã¿æ¿ããŠãã ããã
git checkout tags/b3962
git apply ../lcpp_sd3.patch
mkdir build
cd build
cmake ..
cmake --build . --config Debug -j10 --target llama-quantizeãæé ãçµãããšãã\aiwork\sd-gguf\llama.cpp\build\bin\Debugãã®äžã«éååãè¡ãããã®ãllama-quantize.exeããå ¥ã£ãŠããŸãã
ãç°å¢ã®æ§ç¯ã¯ä»¥äžã§ããã³ãã³ãããã³ããã®ãŠã€ã³ããŠãéããŠãã ããã
â 2. 倿ã®å®è¡
⌠2-1. æŠèŠ
ãå®è¡ãã£ã¬ã¯ããªã\aiwork\sd-ggufãã«ããããã¡ã€ã«ãèšçœ®ããã¢ãã«ã®ãã¡ã€ã«ããã©ãã°ïŒããããããã ãã§å€æã§ããããã«ããŸãããã¡ã€ã«åã¯å人çã«ãcnv_sft-to-q8_0.batããšããŸããããç¹ã«æ±ºãŸãã¯ãããŸããã
ãè€æ°ãã¡ã€ã«ã«ã¯å¯Ÿå¿ããŠããŸãããå 容ãæç€ºããŠChatGPTãClaudeçã«è³ªåãããšãããã«äœã£ãŠããããšæããŸãã
ããªããå€æã®æé ã¯ããªãªãžãã« â F16.gguf â Q8_0.ggufããšãªã£ãŠããŸãã倿åŸã®ã¿ã€ããQ8_0以å€ïŒQ6_KçïŒã«ãããå Žåã¯ããQ8_0ãã®èšè¿°ããã¹ãŠæžãæããŠãã ããã
ãäžèšã¯ãllama-quantize ã®ãã«ãããã®æç²ã§ããQã§å§ãŸãã¿ã€ãã¯ã©ãã§ãå©çšã§ãããšæããŸãããäœããŠãQ4çšåºŠã«ãšã©ããŠãããšè¯ãã§ãããã
Allowed quantization types:
2 or Q4_0 : 4.34G, +0.4685 ppl @ Llama-3-8B
3 or Q4_1 : 4.78G, +0.4511 ppl @ Llama-3-8B
8 or Q5_0 : 5.21G, +0.1316 ppl @ Llama-3-8B
9 or Q5_1 : 5.65G, +0.1062 ppl @ Llama-3-8B
10 or Q2_K : 2.96G, +3.5199 ppl @ Llama-3-8B
21 or Q2_K_S : 2.96G, +3.1836 ppl @ Llama-3-8B
12 or Q3_K : alias for Q3_K_M
11 or Q3_K_S : 3.41G, +1.6321 ppl @ Llama-3-8B
12 or Q3_K_M : 3.74G, +0.6569 ppl @ Llama-3-8B
13 or Q3_K_L : 4.03G, +0.5562 ppl @ Llama-3-8B
15 or Q4_K : alias for Q4_K_M
14 or Q4_K_S : 4.37G, +0.2689 ppl @ Llama-3-8B
15 or Q4_K_M : 4.58G, +0.1754 ppl @ Llama-3-8B
17 or Q5_K : alias for Q5_K_M
16 or Q5_K_S : 5.21G, +0.1049 ppl @ Llama-3-8B
17 or Q5_K_M : 5.33G, +0.0569 ppl @ Llama-3-8B
18 or Q6_K : 6.14G, +0.0217 ppl @ Llama-3-8B
7 or Q8_0 : 7.96G, +0.0026 ppl @ Llama-3-8B
33 or Q4_0_4_4 : 4.34G, +0.4685 ppl @ Llama-3-8B
34 or Q4_0_4_8 : 4.34G, +0.4685 ppl @ Llama-3-8B
35 or Q4_0_8_8 : 4.34G, +0.4685 ppl @ Llama-3-8B
1 or F16 : 14.00G, +0.0020 ppl @ Mistral-7B
32 or BF16 : 14.00G, -0.0050 ppl @ Mistral-7B
0 or F32 : 26.00G @ 7B⌠2-2. 倿ããããã¡ã€ã«1
ã倿åŸã®ã*-Q8_0.ggufãããããããã¡ã€ã«ãšåãå Žæã«æžãåºããŸããåŠçãçµãã£ãããå¿ èŠã«å¿ããŠç§»åçãè¡ã£ãŠãã ããã2-1.ã«èšèŒãããšãããå¿ èŠã«å¿ããŠãQ8_0ãã®ç®æã倿ŽããŠãã ããã
ã倿ã®éäžã§äœ¿çšããã*-F16.ggufãã¯ã倿åŸã«åé€ããŠããŸããåé€ããããªãå Žåã¯ãdel %cnv_file1%ãããrem del %cnv_file1%ãã«å€æŽãããããã®è¡ãåé€ããŠãã ããã
@echo off
cd /d %~dp0
set input_file="%1"
set cnv_file1="%~dp0%~n1-F16.gguf"
set cnv_file2="%~dp0%~n1-Q8_0.gguf"
if not exist %input_file% (
echo.
echo convert the image generation model to GGUF format
echo please drag-and-drop model file ^(.safetensors, etc.^) onto this batch file
pause
exit /b 1
)
call llama.cpp\venv\Scripts\activate.bat
convert.py --src %input_file% --dst %cnv_file1%
if not exist %cnv_file1% (
echo.
echo error: not found %cnv_file1%
echo failed to process convert.py?
pause
exit /b 1
)
llama.cpp\build\bin\Debug\llama-quantize %cnv_file1% %cnv_file2% Q8_0
del %cnv_file1%
if not exist %cnv_file2% (
echo.
echo error: not found %cnv_file2%
echo failed to process llama-quantize?
) else (
echo.
echo saved file %cnv_file2%
echo convert processing completed successfully
)
pause⌠2-3. 倿ããããã¡ã€ã«2
ã倿åŸã®ã*-Q8_0.ggufããã倿å ã®ã¢ãã«ãšåãå Žæã«æžãåºããŸãããªãã2-2. ãšã®éãã¯1æåã ãã§ãã2-1.ã«èšèŒãããšãããå¿ èŠã«å¿ããŠãQ8_0ãã®ç®æã倿ŽããŠãã ããã
ã倿ã®éäžã§äœ¿çšããã*-F16.ggufãã¯ã倿åŸã«åé€ããŠããŸããåé€ããããªãå Žåã¯ãdel %cnv_file1%ãããrem del %cnv_file1%ãã«å€æŽãããããã®è¡ãåé€ããŠãã ããã
@echo off
cd /d %~dp0
set input_file="%1"
set cnv_file1="%~dp0%~1-F16.gguf"
set cnv_file2="%~dp10%~n1-Q8_0.gguf"
if not exist %input_file% (
echo.
echo convert the image generation model to GGUF format
echo please drag-and-drop model file ^(.safetensors, etc.^) onto this batch file
pause
exit /b 1
)
call llama.cpp\venv\Scripts\activate.bat
convert.py --src %input_file% --dst %cnv_file1%
if not exist %cnv_file1% (
echo.
echo error: not found %cnv_file1%
echo failed to process convert.py?
pause
exit /b 1
)
llama.cpp\build\bin\Debug\llama-quantize %cnv_file1% %cnv_file2% Q8_0
del %cnv_file1%
if not exist %cnv_file2% (
echo.
echo error: not found %cnv_file2%
echo failed to process llama-quantize?
) else (
echo.
echo saved file %cnv_file2%
echo convert processing completed successfully
)
pause⌠2-4. 倿ã®å®è¡
ã2-1. ã«ãæžãããšããã倿ãããã¢ãã«ã®ãã¡ã€ã«ãããããã¡ã€ã«ã«ãã©ãã°ïŒããããããã ãã§ããããããã¡ã€ã«ãšåãå ŽæããŸãã¯å€æå ã®ãã¡ã€ã«ãšåãå Žæã«åºåããŸããText EncoderãVAEãå«ãã ã¢ãã«ã§ãæ§ããŸããã
ã倿ãã§ããªãå Žåã¯ã察å¿ããŠããªã圢åŒãããã£ã¹ã¯ã®ç©ºããäžååãã倿ããã°ã©ã ã®åé¡ãã®ããããã§ãã
â 3. GGUFã¢ãã«ã®å©ç𿹿³
⌠3-1. æŠèŠ
ãFLUX.1ãäŸã«ããStable Diffusion WebUI ForgeããšãComfyUIããããããã§GGUF圢åŒã«å€æããã¢ãã«ãå©çšããŠã¿ãŸããåã¢ãŒããã¯ãã£ã§ã®åäœç¢ºèªã¯4.ã«æ²èŒããŠããŸãã
ããªããè©³çŽ°ãªæé ã¯èª¬æããŸããã®ã§ã3-2.ã3-3.ã«ç€ºãããªã³ã¯å ã®èšäºãåèã«ããŠãã ãããããã§ã¯ããªãªãžãã«ã®ãflux1-dev.safetensorsããGGUF圢åŒã«å€æããŸããã倿æžã¿ã¢ãã«ã®é åžå Žæã玹ä»ããŠãããŸãã

black-forest-labs/FLUX.1-dev
https://huggingface.co/black-forest-labs/FLUX.1-devÂ
â» ããŠã³ããŒãã«èš±å¯ãå¿ èŠcity96/FLUX.1-dev-gguf
https://huggingface.co/city96/FLUX.1-dev-ggufÂ
â» å€ææžã¿ã®ã¢ãã«ïŒF16ãQ2_KïœQ8_0ïŒ
⌠3-2. Stable Diffusion WebUI Forge
ãStable Diffusion WebUI Forgeã¯ãæšæºã§GGUF圢åŒã®FLUX.1ã«å¯Ÿå¿ããŠããŸãã

ãå©ç𿹿³ã¯ãäžèšã®èšäºã® 4-3. ãã 4-5. ããããåèã«ããŠãã ããã
⌠3-3. ComfyUI
ãComfyUIã¯ãæ¡åŒµããŒããã€ã³ã¹ããŒã«ããããšã§GGUF圢åŒã®FLUX.1ã«å¯Ÿå¿ããŸããã¯ãŒã¯ãããŒã®ã¢ãã«ãèªã¿èŸŒãéšåããUnet Loader (GGUF)ãã«å€æŽããŸããå¥éãText EncoderãšVAEãçšæããå¿ èŠããããŸãã

ãGGUF圢åŒã®ã¢ãã«ã«å¯Ÿå¿ããŠããªãïŒUnet Loader (GGUF) ãç¡ãïŒå Žåã¯ãäžèšã®èšäºã® 4. ãåèã«æºåãè¡ã£ãŠãã ããã
â 4. GGUFã¢ãã«ã®å©çšïŒComfyUIïŒ
⌠4-1. æŠèŠ
ãæ¬èšäºã§æ§ç¯ããç°å¢ã¯ãFLUX.1以å€ã®æ¹åŒã«ã察å¿ããŠããŸããå·çæç¹ã§å¯Ÿå¿ããŠããæ¹åŒïŒSD 1.5ãSDXLãSD 3ãFLUX.1ãAuraFlowïŒã«ã€ããŠãå®éã«å€æãè¡ã£ãäžã§åäœã確èªããŠã¿ãŸãã
ãç¹ã«SD 1.5ãSDXLã¯éèŠãªçæäºé ãããããã説æãé·ããªã£ãŠããŸãã
⌠4-2. 泚æç¹ïŒããé·æïŒ
ã倿å ã®ã¢ãã«ã«å èµãããText EncoderãVAEãããŒã¹ã¢ãã«ã®ãã®ãšã¯ç°ãªãå Žåãå¥ã®Text EncoderãVAEã䜿çšãããšåºåãå€åããŠããŸããŸãã
ããã以éã¯èå³ã®ããæ¹ã®ã¿ã芧ããã ããããã§ã¯ãªãå Žåã¯èªã¿é£ã°ããŠãã ããã
ãåºåãå€åããŠããŸãåé¡ã¯ç¹ã«ãSD 1.5ãSDXLã®ãã¥ãŒãã³ã°ã¢ãã«ã§çºçããŸããText EncoderãVAEã倿ŽïŒããããã«åºå®ïŒããŠãå·®ãæ¯ããªããã©ããã¯ãåºåãå ã®ã¢ãã«ã®ãã®ãšæ¯èŒããŠã¿ããããããŸããã
ããã ããã¢ãã«ãåé¢ãããç¶æ ã§å ¬éãããŠããã¢ãŒããã¯ãã£ã®å Žåã¯ãå ±éã®ïŒç¡å å·¥ã®ïŒText EncoderãVAEãå©çšãããããåé¡ãèµ·ããå¯èœæ§ãäœãã§ãã
ãããããã¯ãåé¡ãçºçããäŸãæããŸããäžèšã®ã¢ãã«ïŒå颿žã¿ãå«ãïŒãæå ã«ãããšããŸãã
ããŒã¹ã¢ãã« A0ïŒ= A1 + A2 + A3ïŒ
Diffusion Model = A1
Text Encoder = A2
VAE = A3ãã¥ãŒãã³ã°ã¢ãã« B0ïŒ= B1 + B2 + B3ïŒ
Diffusion Model = B1ïŒâ A1ïŒ
Text Encoder = B2ïŒâ A2ïŒ
VAE = B3ïŒâ A2ïŒB0 ãGGUF圢åŒã«å€æããã¢ãã« B1.gguf
Diffusion Model = B1.gguf
ããããããB1.gguf + B2 + B3ãã®çµã¿åããã§ããã°ãå ã®ã¢ãã«ãB0ãã®ä»£ããã«å©çšã§ããŸãããããããB1.gguf + A2 + A3ãã®çµã¿åããã«ããŠããŸããšãåºåãïŒå Žåã«ãã£ãŠã¯å€§ããïŒå€åããŠããŸããŸãã
ãå®éã«ããã¥ãŒãã³ã°ã¢ãã«ãToraFurryMix v20ããšãããŒã¹ã¢ãã«ã®ãStable Diffusion v1-5ãã§è©ŠããŠã¿ãŸããåè ã¯Text EncoderãVAEãšãã«ããŒã¹ã¢ãã«ã®ãã®ãšã¯ç°ãªã£ãŠããŸãã
ToraFurryMix
https://huggingface.co/tlano/ToraFurryMixÂStable Diffusion v1-5 Model Card
https://huggingface.co/stable-diffusion-v1-5/stable-diffusion-v1-5Â
ããŸãããã¥ãŒãã³ã°ã¢ãã«ãå©çšããäžèšã®ç»é¢ãæ¯èŒå ãšããŸãïŒæ¬¡é ã«çæç»åã®ã¿ãæ²èŒããŠããŸãïŒã

ãæ¬¡ã«ãModelã®ã¿ãGGUF Q8_0ã«å€æŽããŸããåºåãå°ãç°ãªããŸãããããã¯å€æïŒFP32âFP16ãFP16âFP8çïŒãè¡ã£ãéã«èµ·ããããšãªã®ã§ãæ°ã«ããå¿ èŠã¯ãããŸããã

ãããã«ãText EncoderãããŒã¹ã¢ãã«ã®ãã®ã«å€æŽãããšãåºåã倧ããå€åããŸããSeedãäœåã倿ŽããŠãããºãŒã ã€ã³ãããæ§å³ã«ã¯ãªããŸããã§ããã

ãæåŸã«ãText Encoderãæ»ããŠãVAEãããŒã¹ã¢ãã«ã®ãã®ã«å€æŽããŸãããåããã¥ããã§ãããå®ã¯åºåãå€åããŠããŸãã

ãäžèšã®ç»åã¯ãäžã倿å ã®ã¢ãã«ã«å èµãããVAEãäžãããŒã¹ã¢ãã«ã®VAEã§ããVAEãç°ãªããšã现ããæåãçºè²ãå€åããŸãã

ãäœè«ãªãããäžéšã®ç³»çµ±ã®SD 1.5ã¢ãã«ã«å èµãããVAEã¯æ§è³ªãç°ãªãããã䜿çšããVAEã誀ããšé©åãªåºåãè¡ããªããªãå ŽåããããŸãã
⌠4-3. Stable Diffusion 1.5
ãã¢ãã«ã®ãµã€ãºãããšããšå°ããããšïŒçŽ2GBïŒãããã¥ãŒãã³ã°ã¢ãã«ãç¬èªã®Text EncoderãVAEãæã€å¯èœæ§ãé«ãããšãããGGUFåã¯å¯èœã§ããéæšå¥šãšããŸãã
ããªããããŒã¹ã¢ãã«ïŒStable Diffusion v1-5ïŒãåé¢ããŠGGUF Q8_0ã«å€æããå Žåã®å èš³ã¯äžèšã®ãšããã§ãModelã®ãµã€ãºã765MBçž®å°ããŸããã
Model
1.6GBÂ - original (built into)
874MB - GGUF Q8_0Text Encoder
235MB - original (clip_l, built into)VAE
159MB - original (built into)
ãæ¯èŒã®ããã«äœ¿çšããã¢ãã«ã¯äžèšã®ãšããã§ããã¯ãŒã¯ãããŒã¯åé ãåç §ããŠãã ããã
ToraFurryMix
https://huggingface.co/tlano/ToraFurryMixÂ
ãå ã®ã¢ãã«ã®åºåãšãGGUFåããã¢ãã«ã®åºåãæ²èŒããŸãã


⌠4-4. SDXL
ãSDXLã®ãã¥ãŒãã³ã°ã¢ãã«ã¯ç¬èªã®Text Encoderãæã€å¯èœæ§ãé«ãã§ãããã®å Žåã¯GGUF圢åŒã«å€æããåŸããå ã®ã¢ãã«ãšåãText Encoderã䜿çšããå¿ èŠããããŸãããªããVAEã«ã€ããŠã¯ç¹æ®ãªäŸå€ã奜ã¿ã«ãã倿Žãé€ããéåžžã¯ããŒã¹ã¢ãã«ãšåããã®ã§å·®ãæ¯ããªããšæããŸãã
ãçµè«ãšããŠãäžèšã®ããã«ã¡ãªããã®æ¹ã倧ããæ¡ä»¶äžã§ããã°ãGGUFåã¯æå¹ãããããŸããã
ããšããšVRAMãäžè¶³ããŠããŠGGUFåã§æ¹åã§ããã
åãã¢ãã«ãå€çšããã®ã§åºæã®Text Encoderãä¿æããŠãæ§ããªã
ããªããããŒã¹ã¢ãã«ïŒSD-XL 1.0-baseïŒãåé¢ããŠGGUF Q8_0ã«å€æããå Žåã®å èš³ã¯äžèšã®ãšããã§ãModelã®ãµã€ãºã2.23GBçž®å°ããŸããã
Model
4.78GBÂ - original (built into)
2.54GB - GGUF Q8_0Text Encoder
1.29GB - original (clip_g, built into)
235MB - original (clip_l, built into)VAE
159MB - original (built into)
ãä»ã«èæ ®ãå¿ èŠãªäºé ãšããŠãLoRAé©çšæžã¿ã®ã¢ãã«ãä¿åããŠããGGUF圢åŒã«å€æããæ¹ããGGUF圢åŒã®ã¢ãã«ã«LoRAãé©çšãããããVRAM䜿çšéãå°ãªãããšãããã£ãŠããŸãã

ã䜿çšããã¢ãã«ã¯äžèšã®ãšããã§ããäœStepsã§çæããããã«PCM LoRAãé©çšããŠãVAEã¯ããŒã¹ã¢ãã«ãšåããã®ãå©çšããŸãã
SuimeiXL
https://civitai.com/models/1031193ÂPhased Consistency ModelïŒPCMïŒ
https://huggingface.co/wangfuyun/PCM_WeightsÂ
sdxl\pcm_sdxl_smallcfg_8step_converted.safetensorsSDXL - VAE
https://huggingface.co/stabilityai/sdxl-vae
sdxl_vae.safetensors
ããŸããå ã®ã¢ãã«ïŒ+PCM LoRAïŒã§åºåããŸãã


ãæ¬¡ã«ãGGUFåããã¢ãã«ã§åºåããŸããåè¿°ã®ãšããã倿å ã¯PCM LoRAãé©çšæžã¿ã§ããText Encoderã¯ãå ã®ã¢ãã«ããåé¢ãããã®ã䜿çšããŠããŸãïŒå ã®ã¢ãã«ããCLIPãã€ãªããŠãåºåã¯å€ãããŸããïŒã

ã现ããªçžéãããªããããModelã®ãµã€ãºãååè¿ãã«ãªã£ãŠããããšã«ã¯æ°ã¥ããªããšæããŸããQ6_K以äžã«äžããŠãããšãçžéã倧ãããªããšæããŸãã

ãããã§ãText EncoderãããŒã¹ã¢ãã«ã®ãã®ã«å€æŽãããšåºåãå£ããŸãïŒclip-gãšclip_lãã©ã¡ãã®åœ±é¿ãã¯æªç¢ºèªïŒããã®ããã«ç¬èªã®Text Encoderãæã€ã¢ãã«ã§ã¯ã倿åŸãåãText Encoderã䜿çšããå¿ èŠããããŸãã

ããã®å ã¯æ€èšŒããŠããªãã®ã§åãããŸããããåãç³»åã®ã¢ãã«ã§ããã°ãå èµããText Encoderã«äºææ§ããããããããŸããã
⌠4-5. SD 3 Medium
ãSD 3.5ã§ã¯ãªãSD 3ã§ãïŒå·çæç¹ã§ã¯SD 3.5ã«ã¯æªå¯Ÿå¿ã®æ§åïŒããã¥ãŒãã³ã°ã¢ãã«ã¯æªç¢ºèªã§ãããéåžžã¯å ±éã®Text EncoderãšVAEãå©çšãããšã¿ãããGGUFåã§åé¡ãçºçããå¯èœæ§ã¯ããããäœããšæããŸãã
ãããŒã¹ã¢ãã«ïŒStable Diffusion 3 MediumïŒãåé¢ããŠGGUF Q8_0ã«å€æããå Žåã®å èš³ã¯äžèšã®ãšããã§ãModelã®ãµã€ãºã1.75GBçž®å°ããŸãããããŒã¹ã¢ãã«ã¯ãText Encoderãå èµããŠãããã®ãšãããã§ãªããã®ããããŸããt5xxlã¯ããããã®ã¿ã䜿çšããŸãã
Model
3.88GBÂ - original (built into)
2.12GB - GGUF Q8_0Text Encoder
1.29GB - original (clip_g, built into)
235MB - original (clip_l, built into)
9.11GB - original (t5xxl_fp16, built into)
4.55GB - original (t5xxl_fp8_e4m3fn, built into)VAE
159MB - original (built into)
ãããŒã¹ã¢ãã«ãã倿æžã¿ã®åçš®GGUFã¢ãã«ã¯ãäžèšã®URLã«ãŠå ¬éããŠããŸãã
Stable Diffusion 3 Medium
https://huggingface.co/stabilityai/stable-diffusion-3-mediumÂ
â» ããŠã³ããŒãã«èš±å¯ãå¿ èŠcity96/stable-diffusion-3-medium-gguf
https://huggingface.co/city96/stable-diffusion-3-medium-ggufÂ
ããŸããå ã®ã¢ãã«ã§åºåããŸãã


ãæ¬¡ã«ãGGUFåããã¢ãã«ã§åºåããŸããããã»ã©å€åã¯ãããŸããã


⌠4-6. FLUX.1
ãFLUX.1ã®ã¢ãã«ã¯éåžžãå ±éã®Text EncoderãšVAEãå©çšãããšã¿ãããGGUFåã§åé¡ãçºçããå¯èœæ§ã¯äœããšæããŸããããããGGUF圢åŒã§çšæãããŠããå²åãæãé«ãã¢ãŒããã¯ãã£ãããããŸããã
ãããŒã¹ã¢ãã«ïŒFLUX.1 [dev]ïŒãGGUF Q8_0ã«å€æããå Žåã®å èš³ã¯äžèšã®ãšããã§ãModelã®ãµã€ãºã10.2GBçž®å°ããŸãããFLUX.1ã¯ãµã€ãºãæ¯èŒç倧ããã®ã§ã倿ã«ããæ©æµãåãããããããããããŸããã
Model
22.1GBÂ - original
11.9GB - GGUF Q8_0
ãåèãŸã§ãText EncoderãšVAEã®æ å ±ã§ããt5xxlã¯ããããã®ã¿ã䜿çšããŸãã
Text Encoder
235MB - original (clip_l)
9.11GB - original (t5xxl_fp16)
4.55GB - original (t5xxl_fp8_e4m3fn)VAE
319MB - original
ãããŒã¹ã¢ãã«ãã倿æžã¿ã®åçš®GGUFã¢ãã«ã¯ãäžèšã®URLã«ãŠå ¬éããŠããŸãã
FLUX.1 [dev]
https://huggingface.co/black-forest-labs/FLUX.1-devÂ
â» ããŠã³ããŒãã«èš±å¯ãå¿ èŠcity96/FLUX.1-dev-gguf
https://huggingface.co/city96/FLUX.1-dev-ggufÂ
ããŸããå ã®ã¢ãã«ã§åºåããŸãã


ãæ¬¡ã«ãGGUFåããã¢ãã«ã§åºåããŸããå€åã¯å°ãããã±ã£ãšèŠã§ã¯åããã«ããã§ãã


⌠4-7. AuraFlow
ãAuraFlowã«ã€ããŠç°¡åã«èª¬æããŠãããšãSD 3ã«ã€ã³ã¹ãã¬ãŒã·ã§ã³ãåããŠäœãããæåãªPony Diffusionã®æ¬¡æã¢ãã«V7ïŒéçºäžïŒã¯ããããã©ã€ããªããŒã¹ãšããŠéžæããŠããŸããAuraFlowã¯ãçæãµãŒãã¹ãè¡ã£ãŠããfalããªãªãŒã¹ããŠããŸãã
ãããŒã¹ã¢ãã«ãText EncoderãšVAEãå èµããŠããããšããåè¿°ã®äºæ ããå¯ããã«ããã¥ãŒãã³ã°ã¢ãã«ã¯ç¬èªã®Text EncoderãVAEãæã€å¯èœæ§ããããŸãã
ãããŒã¹ã¢ãã«ïŒAuraFlow v0.3ïŒãåé¢ããŠGGUF Q8_0ã«å€æããå Žåã®å èš³ã¯äžèšã®ãšããã§ãModelã®ãµã€ãºã6.08GBçž®å°ããŸãããåäœã§é åžãããŠããText EncoderãšVAEã®æ å ±ãå ããŠãããŸãã
Model
12.7GB - original (built into)
6.84GB - GGUF Q8_0Text Encoder
2.27GB - original (built into)
2.74GB - original (text_encoder/model.fp16.safetensors)
4.55GB - original (text_encoder/model.safetensors)VAE
159MB - original (built into)
159MB - original (vae/diffusion_pytorch_model.fp16.safetensors)
319MB - original (vae/diffusion_pytorch_model.safetensors)
ãããŒã¹ã¢ãã«ãã倿æžã¿ã®åçš®GGUFã¢ãã«ã¯ãäžèšã®URLã«ãŠå ¬éããŠããŸãã
AuraFlow v0.3
https://huggingface.co/fal/AuraFlow-v0.3Âcity96/AuraFlow-v0.3-gguf
https://huggingface.co/city96/AuraFlow-v0.3-ggufÂ
ããŸããå ã®ã¢ãã«ã§åºåããŸãã


ãæ¬¡ã«ãGGUFåããã¢ãã«ã§åºåããŸããæ¬äŸã§ã¯é¡ã®åœ¢ãéããŸãããå šäœçãªå€åã¯å°ããã§ãããªããã¢ãã«ã«å ¥ã£ãŠããText Encoderã§ã¯ãšã©ãŒãåºãŸããLoad CLIPã®typeã¯è©²åœãããã®ãç¡ããèšå®å 容ã¯ç¡èŠãããããã§ãã


â 5. ãã®ä»
ãç§ãæžããä»ã®èšäºã¯ãã¡ãã¥ãŒãããã©ã£ãŠãã ããã
ãèšäºã«é¢ããããšã§äœããããŸããããXã®@riddi0908ãŸã§ãé¡ãããŸãã