
FP8_scaled ãš MXFP8 ã®ã©ã£ã¡ãããããïŒ ç»åçæ AI ã¢ãã« ã®ç²ŸåºŠãšéããåŸ¹åºæ¯èŒïŒ ãæµ®åå°æ°ç¹ã»è»œéåã
2026.7.6 远èš
èšäºã®æåŸã«ã2026.7.1 ã« ComfyUI ãæ°ãã«å¯Ÿå¿ãã INT8_ConvRot 圢åŒÂ ãšã®æ¯èŒã远èšããŸãããINT8_ConvRot 圢åŒã¯ãæ¢åã®ãã¹ãŠã® FP8 ãš FP4 圢åŒããã粟床ã»é床ãšãã«åªããŠãã ãããä»åŸã¯ FP8 ã§ã¯ãªã INT8_ConvRot 圢åŒã®å©çšãããããããŸãã
ã¯ããã«
ããã«ã¡ã¯ãããŸãŸ / Easygoing ã§ãã
ä»åã¯ãç»åçæ AI ã¢ãã«ã®åœ¢åŒãšç²ŸåºŠãšéã ã«ã€ããŠã¿ãŠã¿ãŸãã

AI ã¢ãã« ã¯ãæµ®åå°æ°ç¹åœ¢åŒã§åŠçãè¡ã
ç»åçæ AI ãå«ã AI ã¢ãã«ã¯ãèšå€§ãªèšç®ã æµ®åå°æ°ç¹åœ¢åŒÂ ã§è¡ã£ãŠããŸãã
æµ®åå°æ°ç¹åœ¢åŒã«ã€ããŠ

æµ®åå°æ°ç¹åœ¢åŒã¯ããã€ãããã¯ã¬ã³ãž ãåºã ã®ã§åŠçãå®å®ããããã«ããŒã¿ãé »åºãã 0 ä»è¿ ã«ãããæ°ãå€ã䜿ãã®ã§ æ¯èŒç粟床ãè¯ã ãšããç¹åŸŽããããŸãã

æµ®åå°æ°ç¹æ¹åŒã¯ã1985å¹Žã«æšæºåãããŠä»¥éãäž»ã«Â 32bit æµ®åå°æ°ç¹æ¹åŒïŒFP32ïŒã䜿ãããŠããŸãããã2010幎代ã«å ¥ã AI ã®ç ç©¶ãé²ããšããã軜éãªÂ FP16 / BF16 圢åŒÂ ã䜿ãããããã«ãªããŸããã
GPU ã察å¿ããæµ®åå°æ°ç¹åœ¢åŒã®äžèЧïŒ
ããã§ã¯ãNVIDIAã»AMDã»Intel ã®ããããã® GPU ã察å¿ããæµ®åå°æ°ç¹åœ¢åŒãèŠãŠã¿ãŸãã


FP32ïŒé«ç²ŸåºŠã»é«ã³ã¹ã
FP16ïŒç²ŸåºŠãšé床ã®è¯ããã©ã³ã¹
BF16ïŒFP16 ããå®å®ãããã粟床ãå°ãèœã¡ã
FP8ïŒFP16 / BF16 ã®ååã®å®¹éã粟床ã¯ããªãèœã¡ã
FP8_scaledïŒã¹ã±ãŒãªã³ã°ãè¡ããFP8 ã®ç²ŸåºŠã®äœäžãæããæ¹åŒ
MXFP8ïŒ32åã®ããŒã¿æ¯ã«ãããã¯ã«åããŠã¹ã±ãŒãªã³ã°ã粟床ãããã«æ¹å
NVFP4ïŒ2段éã®ã¹ã±ãŒãªã³ã°ã§ãFP4 ã§ãæäœéã®ç²ŸåºŠãç¶æ
FP32 ã¯ãå šãŠã®ããã€ã¹ã§å®è¡å¯èœ ãªåœ¢åŒã§ãã
FP16 㯠FP32 ã®ååã®å®¹éã§ãå®çšäžåé¡ãªã粟床 ãç¶æã§ããŠããŸãã
BF16 ã¯ãFP16 ãã 粟床ãèœãšã代ããã«å®å®æ§ãåäž ããã圢åŒã§ãã¢ãã«ã®åŠç¿ã VAE ã®åŠçã§å©çšãããŠããŸãã
FP8 㯠FP16 / BF16 ã®ååã®å®¹éã§ããã粟床ã¯å€§ããäœäžããŠããŸããŸãã
ããã§ãã¢ãã«ã®å±€ããšã« 絶察æå€§å€ã䜿ã£ãŠã¹ã±ãŒãªã³ã° ãããããšã§ã粟床ã®äœäžãæããã®ã FP8_scaled ã§ããã㯠FP8 ãå®è¡å¯èœãªå šãŠã® GPU ã§å©çšããããšãã§ããŸãã

ããã«ãã¢ãã«ã®å±€ã 32å ãã€ã®ããŒã¿ã®Â ãããã¯ã«åããŠçްããã¹ã±ãŒãªã³ã° ãè¡ã£ãã®ã MXFP8 ã§ãå€ãå€ã®åœ±é¿ãæå°åã§ããã®ã§ç²ŸåºŠãããã«æ¹åããŸãããããŒããŠã§ã¢çã«å®è¡å¯èœãª GPU 㯠RTX 5000 ã·ãªãŒãº ã«éãããŸãã
NVFP4 㯠2025幎ã«ç»å Žããæ°ãã圢åŒã§ãïŒæ®µéã®ã¹ã±ãŒãªã³ã° ãè¡ãããšã§äœç²ŸåºŠã® 4 bit ã§ãæäœéã®ç²ŸåºŠãç¶æããŠããŸãã
å®éã®ã€ã©ã¹ããæ¯ã¹ãŠã¿ããïŒ
ããã§ã¯ãå®éã®ã€ã©ã¹ããæ¯ã¹ãŠã¿ãŸãããã
ä»åã¯ãå€éšã® Text Encoder ãš VAE ã䜿ããªããã·ã³ãã«ãª UiT ã¢ãŒããã¯ã㣠㮠HiDream-O1-Image_clear_v1 ã¢ãã«ãå©çšããŠæ¯èŒãè¡ããŸãã
HiDream-O1-Image_clear_v1 ã¢ãã« ã«ã€ããŠ
HiDream-O1-Image ã·ãªãŒãºã¯ãã¢ãã¡ã€ã©ã¹ãã®æåã¯ãŸã èŠæãªã®ã§ãä»å㯠å®åç³»ã®ã€ã©ã¹ã ãçæããŠã¿ãŸãã
å®éã®ã€ã©ã¹ã
ããã§ã¯å®éã®ã€ã©ã¹ããèŠãŠã¿ãŸãããã
FP32

ãŸãã¯ãæã粟床ã®è¯ã FP32 åœ¢åŒ ã®ã€ã©ã¹ãã§ãã
HiDream-O1-Image ã¢ãã«ã¯ãVAE ã䜿ããªã UiT ã¢ãŒããã¯ãã£ãªã®ã§ãåŸæ¥ã®ã¢ãã«ãšæ¯ã¹ãŠ èªç¶ãªè²è¡šçŸ ã«ãªã£ãŠããŸãã
ãã® FP32 圢åŒãåºæºã«ãå·ŠåŽã«è©²åœã®åœ¢åŒã§çæããã€ã©ã¹ããå³åŽã« FP32 åœ¢åŒ ãšæ¯ã¹ãå Žåã®å·®åãããã䞊ã¹ãŠã¿ãŸãã
FP16

æåã«æ¯èŒããã®ã¯ãFP16 圢åŒÂ ã§ãã
FP16 åœ¢åŒ ã¯ãFP32 åœ¢åŒ ãšæ¯ã¹ãŠ äººç©ã®èŒªé ãš æã®æš¡æ§Â ã«éããçããŠããŸãããè²ã®è¡šçŸãè¯ãé«ãã¯ãªãªãã£ãä¿ãããŠããŸãã
BF16

ç¶ããŠÂ BF16 åœ¢åŒ ã§ãã
å ã»ã©ã® FP16 åœ¢åŒ ãšåæ§ã«ã人ç©ã®èŒªéãšæã®æš¡æ§ã«éããçããŠããŸããããã¡ããé«ãã¯ãªãªãã£ã«ãªã£ãŠããŸãã
MXFP8

次ã«ã8 bit ã®äžã§ã¯æã粟床ã®è¯ã MXFP8 åœ¢åŒ ãèŠãŠã¿ãŸãã
MXFP8 圢åŒã¯ãå ã»ã©ã® BF16 åœ¢åŒ ãšæ¯ã¹ãŠ èæ¯ã®è±Â ãå€åããŠããŸãããå šäœã®ã¯ãªãªãã£ã¯æ¯èŒçä¿ãããŠããŸãã
FP8_scaled

ç¶ã㊠FP8_scaled åœ¢åŒ ã§ãã
FP8_scaled ã¯å ã»ã©ã® MXFP8 ãããå£åã匷ããè²ã®æ·±ã¿ã倱ãã㊠ç°è²ã£ãœãè¡šçŸ ã«ãªã£ãŠããŸããŸããã
FP8

次ã¯ãåçŽãªÂ FP8 åœ¢åŒ ã§ãã
FP8 圢åŒã¯ãä»ãŸã§ãšã¯å šãéã£ã åçŽãªæ§å³Â ã«ãªããããã«Â ãããã¯ãã€ãºÂ åºçŸããŠæªå®æã®ã€ã©ã¹ãã«ãªã£ãŠããŸãã
NVFP4

æåŸã« NVFP4 åœ¢åŒ ãèŠãŠã¿ãŸãã
NVFP4 圢åŒã¯ãå ã»ã©ã® FP8 圢åŒãšæ¯ã¹ãŠæ§é ã¯ä¿ãããŠããäžæ¹ã§ãè²ã®ããŒã³Â ã匷ãå€åããŠãã€ã©ã¹ãã®å°è±¡ãå€ãã£ãŠããŸãã
MAE ãš SSIM ã§æ°å€åããŠæ¯èŒïŒ
ããã§ã¯ãããããã®ã€ã©ã¹ãã®éããæ°å€ã§æ¯èŒããŠã¿ãŸãããã
ä»åã¯ãFP32 åœ¢åŒ ããã®å€åã MAE ãš SSIM ã®é¡äŒŒåºŠã§è©äŸ¡ããŸãã

Mean Absolute Error (MAE)ïŒäž»ã«ã«ã©ãŒã®éããæ€åº
Structural Similarity Index (SSIM)ïŒçœé»ã®æ§é ã®éããæ€åº
ããããã®ã€ã©ã¹ãããæã粟床ã®è¯ã FP32 圢åŒãšæ¯èŒããŠãMAE ãš SSIM ã ïŒå枬å®ããŠäžå€®å€ ãæ±ããŠã¿ãŸãã
ç»åçæ AI ã¢ãã«ã®å®¹éãšç²ŸåºŠ


ã¢ãã«ã® 容éãšç»è³ªÂ ã¯æ¯äŸãã
FP16 ãš BF16 ã¯ãã»ãŒåã粟床
FP8 ã¯ç»è³ªãå£åããããMXFP8 ãš FP8_scaled ã¯ç²ŸåºŠãããªãç¶æ
NVFP4 ã¯ãåçŽãª FP8 ããã粟床ãè¯ã
ç»åçæ AI ã¢ãã«ã® 容éãšç»è³ªÂ ã¯ãæŠãæ¯äŸããŠããŸãã
ã°ã©ããèŠããšãFP8 åœ¢åŒ ã¯ç²ŸåºŠã倧ããäœäžããŠããŸãããMXFP8 ãš FP8_scaled ã¯ã¹ã±ãŒãªã³ã°ãè¡ã£ãŠ éèŠéšåã®æ å ±ãä¿æÂ ããããšã«ãããããªãã®ç²ŸåºŠãç¶æããŠããŸãã
NVFP4 ã¯ã4 bit çžåœã®ç»è³ªã«ãªããŸãããããã§ãã¹ã±ãŒãªã³ã°ã®å¹æã§åçŽãª FP8 ããç»è³ªã¯ä¿ãããŠããŸãã
æµ®åå°æ°ç¹åœ¢åŒãšç²ŸåºŠ
ä»åã®æž¬å®ã§ã®ç²ŸåºŠã¯ã次ã®é çªã«ãªããŸããã
FP32 > FP16 â BF16 > MXFP8 > FP8_scaled > NVFP4 > FP8

çææéã®æ¯èŒ
åŸåã¯ãçæã«ããã£ãæéãæ¯èŒããŸãã
ãŸããä»åã®æž¬å®ã®ç°å¢ã¯æ¬¡ã®ãšããã§ãã
枬å®ç°å¢
Linux (Pop!_OS 24.04)
ComfyUI 0.24.0
RTX 4060 Ti 16GB
2048 x 2048, 24 Steps
Windows ãš Linux ã®çæéåºŠã®æ¯èŒ
GPU ã察å¿ããæµ®åå°æ°ç¹åœ¢åŒ

ä»åã®æ€èšŒã§å©çšãã RTX 4060 Ti ã¯ãFP32 ãã FP8_scaled ãŸã§ ã®åœ¢åŒã«å¯Ÿå¿ããŠããŸãããMXFP8 ãš NVFP4 ã«ã¯éå¯Ÿå¿ ãªã®ã§ã BF16  㫠ãã©ãŒã«ãã㯠ããŠåäœããŸãã
å®éã®çææé
ããã§ã¯ãå®éã®çµæã§ãã
ä»åããããããã®åœ¢åŒã§ïŒå枬å®ããŠäžå€®å€ã瀺ããŠããŸãã
ã€ã©ã¹ãçæã®æèŠæé


ãŸããç»åã®çæé床㯠ã¢ãã«ã VRAM ã«ããŒãã§ãããã©ãã ã§ã»ãŒæ±ºãŸããŸãã
HiDream-O1-Image ã¢ãã«ã¯ãFP16 / BF16 以äžã®åœ¢åŒã VRAM ã«å®å šããŒã ã§ããã®ã§ãåŠçãé«éã«è¡ãããšãã§ããŸãã

次ã«ãRTX 4000 ã·ãªãŒãºã察å¿ããŠããªã MXFP8 ãš NVFP4 ã¯ãBF16 ã«ãã©ãŒã«ããã¯ããŠåŠçãããããçæé床ã¯ãããé ããªã£ãŠããŠã察å¿ããŠããªã GPU ã§ææ°åœ¢åŒãå®è¡ããã¡ãªããã¯ã»ãŒãããŸããã
ãŸããä»åã® FP8_scaled 㯠ComfyUI å°çšåœ¢åŒ ã®ãããåŠçãé«éã«è¡ãããŸããããå€éšããŒã«ã§å€æãã FP8 㯠ComfyUI ã§ã¯ããŸãèªèããããBF16 ã«ãã©ãŒã«ããã¯ããŠåäœãé ããªã£ãŠããŸããŸããã
ComfyUI å°çšã® FP8_scaled ãå©çšå¯èœãªå Žåã¯ããªãã¹ã FP8_scaled ã¢ãã« ãå©çšãããšè¯ãã§ãããã
æé©ãªåœ¢åŒã¯ GPU ã«ãã£ãŠç°ãªã
ä»å RTX 4060 Ti 16GB ã§ã¯ãFP16 ãš FP8_scaled ãç»è³ªãšé床ã®ãã©ã³ã¹ã«åªããŠããããšãåãããŸããã

ã€ã©ã¹ãã®çæé床ã¯ãVRAM ã®å®¹é ãš GPU ã察å¿ããæµ®åå°æ°ç¹åœ¢åŒÂ ã§å šãéã£ãŠããã®ã§ãè€æ°ã®åœ¢åŒãå ¬éãããŠããå Žåã¯ããããã詊ããŠã¿ãªããã®æé©è§£ãèŠã€ããŠã¿ãŠãã ããã
UiT ã¢ãŒããã¯ãã£ã¯å€åã倧ãã
ä»å㯠UiT ã¢ãŒããã¯ãã£ã® HiDream-O1-ImageÂ ã§æ€èšŒãè¡ããŸãããã以åã«æ€èšŒãã Flux.1 [dev]Â ãšæ¯ã¹ãŠãã¢ãã«ã®åœ¢åŒã«ããã€ã©ã¹ãã®å€åã倧ããçµæã«ãªããŸããã
HiDream-O1-ImageïŒUiTãããŒã¹ã¢ãã«
Flux.1 [dev]ïŒViTãèžçã¢ãã«
Flux.1 [dev] ã®ã¢ãã«åœ¢åŒãšç²ŸåºŠã«ã€ããŠ
ããã¯ãHiDream-O1-Image ã UiT ã¢ãŒããã¯ã㣠㮠ããŒã¹ã¢ãã« ã§ããã®ã«å¯ŸããŠãFlux.1 [dev] 㯠ViT ã¢ãŒããã¯ã㣠㮠èžçã¢ãã« ã§ãããFlux.1 [dev] 㯠VAE ã®åŸåŠçã§ã®ç Žç¶»ãæããããã«ãèžçã®æ®µéã§Â åºåãäžå®ç¯å²ã«æããèª¿æŽ ããããŠããã®ã§ã¯ãªãããšèããŠãŸãã
UiT ã¢ãŒããã¯ã㣠ã¯ãã·ã³ãã«ãªæ§é ãªåããŸããŸãªèª¿æŽãã§ããã®ã§ãæè»ãªè³ãæã£ãã¢ãã«Â ãšèšããã§ãããã
ãŸãšãïŒå®¹éãšç»è³ªã¯æ¯äŸãã
ç»è³ªïŒFP32 > FP16 â BF16 > MXFP8 > FP8_scaled > NVFP4 > FP8
VRAM ã«ããŒãã§ãããšéã
GPU ã察å¿ãã圢åŒãå©çšãã
ä»åã¯ãã¢ãã«ã®æµ®åå°æ°ç¹åœ¢åŒãšç»è³ªãšçæéåºŠãæ¯èŒããŸããã
æµ®åå°æ°ç¹ã«ã¯ãããããªåœ¢åŒããããéžæã«è¿·ãã±ãŒã¹ãå€ãã§ãããä»å ã¢ãã«ã®å®¹éãšç»è³ªã¯æ¯äŸãã ããšã確èªã§ããŸããã

MXFP8 ã NVFP4 ãªã©ã®æ°ãã圢åŒã¯ãææ°ã® GPU ã§é«éã«çæ ããçšéã§ã¯ãè¯ãéžæè¢ã«ãªããšæããŸãã
ããããããç»åçæ AI ã®ç»è³ªãšé床ã«ã€ããŠãç¬èªã®æ€èšŒãè¡ã£ãŠãããããšæããŸãã
æåŸãŸã§ãèªã¿ããã ãããããšãããããŸãïŒ
2026.7.6 远èšïŒINT8_ConvRot ãšã®æ¯èŒ
2026.7.1ãComfyUI ãæ°ãã« INT8_ConvRot åœ¢åŒ ã«æ£åŒå¯Ÿå¿ããŸãããINT8_ConvRot 圢åŒããããŸã§ã®æµ®åå°æ°ç¹åœ¢åŒãšæ¯èŒããŠã¿ãŸãã
ã²ããã²ããã® INT8_ConvRot ã«ã€ããŠã®è§£èª¬èšäº
FP32 vs INT8_ConvRot_HQ

粟床ïŒMAE ãš SSIMïŒ


çæé床


INT8_ConvRot_HQ ã¯ãéåžžã«å ããŠãç»è³ªã«äžãã圱é¿ã倧ããæåãšæåŸã®å±€ã FP16 ã§ä¿æããçè ã®ã«ã¹ã¿ã ã¢ãã«ã§ãã
INT8_ConvRot 圢åŒã¯ãæ¢åã®ãã¹ãŠã® FP8 ãš FP4 圢åŒããã粟床ã»é床ãšãã«åªããŠãã ãããä»åŸã¯ FP8 ã§ã¯ãªã INT8_ConvRot 圢åŒã®å©çšãããããããŸãã
倿ã«å©çšããã©ã€ãã©ãª
倿æã®ã³ãã³ã
ctq -i HiDream-O1-Image_clear_v1_FP16.safetensors \
-o HiDream-O1-Image_clear_v1_INT8_ConvRot_HQ.safetensors \
--int8 --scaling_mode row \
--convrot --convrot-group-size 64 \
--calib_samples 8192 \
--comfy_quant --save-quant-metadata --verbose VERBOSE \
--exclude-layers "norm|bias|embed_tokens|pos_embed|patch_embed|t_embedder|x_embedder|lm_head|final_layer2|language_model\.layers\.(0|1|2|33|34|35)\.|visual\.blocks\.(0|1|2|24|25|26)\.|visual\.blocks\.\d+\.mlp\.linear_fc2"ã¯ãŒã¯ãããŒ ïŒ æž¬å®ããŒã¿
ã¯ãŒã¯ãããŒ
ä»åã®æž¬å®ã«å©çšããã¯ãŒã¯ãããŒã¯ãã¡ãã§ãã

枬å®ããŒã¿
ãŸããå®éã®æž¬å®ããŒã¿ã¯æ¬¡ã®ããŒãžã«ãŸãšããŠããŸãã