Instructions to use AnticPan/Anima-Role-Ref-KV with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use AnticPan/Anima-Role-Ref-KV with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("circlestone-labs/Anima", dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("AnticPan/Anima-Role-Ref-KV") prompt = "Turn this cat into a dog" input_image = load_image("https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/cat.png") image = pipe(image=input_image, prompt=prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
Anima Role Ref KV
v2.0 Β· Character-reference generation for Anima Base v1.0
δΈζ Β· Examples Β· Evaluation Β· v1.0 archive
Generate new poses, outfits, expressions, and scenes from one character reference and a text prompt. No per-character training or trigger word is required.
BF16 weights only (v2.0 and v1.0). Update the included Python runtime or ComfyUI custom node before loading β older FP32-only loaders reject BF16 files. Both versions live side-by-side by filename.
What changed in v2.0
| Development evaluation (3,008 images/model) | v1.0 | v2.0 |
|---|---|---|
| Normalized head similarity β | 1.23 | 1.72 |
| Low-color rate, natural-language prompts β | 31.1% | 3.2% |
| Prompt tag hits β | 91.2% | 90.3% |
v2.0 improves character resemblance and markedly reduces unintended washed-out outputs on natural-language prompts, with slightly lower overall tag adherence. Automated metrics, single training seed β see Evaluation.
Files
| Version | ComfyUI (models/loras/) |
Diffusers |
|---|---|---|
| v2.0 (default) | comfy/anima-role-ref-kv-v2.0.safetensors |
diffusers/anima-role-ref-kv-v2.0.safetensors |
| v1.0 (BF16) | comfy/anima-role-ref-kv-v1.0.safetensors |
diffusers/anima-role-ref-kv-v1.0.safetensors |
ComfyUI
- Put the desired weight file (
anima-role-ref-kv-v2.0.safetensorsoranima-role-ref-kv-v1.0.safetensors) inComfyUI/models/loras/. - Replace
ComfyUI/custom_nodes/anima-role-ref-kv/with the included comfyui folder and restart ComfyUI. - Install the base components from Anima (
anima-base-v1.0.safetensors,qwen_3_06b_base.safetensors,qwen_image_vae.safetensors). - Load workflows/anima-role-ref-kv-v2.0.json (or
v1.0.json), upload a reference image, edit the prompt, and Queue. You can switch betweenv2.0andv1.0directly in the Anima Role Ref KV node'sadapterdropdown.
Diffusers
Use Python 3.12 with Anima Base v1.0 Diffusers:
pip install -r requirements-diffusers.txt
python infer.py \
--base-model /path/to/Anima-Base-v1.0-Diffusers \
--adapter diffusers/anima-role-ref-kv-v2.0.safetensors \
--reference reference.png \
--prompt "highres, safe, 1girl, solo, upper body, sitting, bench, park, tree" \
--seed 20261106 --output result.png
Pass --adapter diffusers/anima-role-ref-kv-v1.0.safetensors to run v1.0. Both require the included reference runtime and are not standalone ordinary LoRA files.
Settings and prompt format
- Sampling: 28 steps, CFG 4, BF16, around 1 MP (
832 Γ 1216,1024 Γ 1024, or1216 Γ 832, multiples of 16). Use a clear single-character reference. - Tag prompts (training format): start with
highres, safe, 1girl, solo, ...(or1boy), then desired framing, pose, expression, outfit, background, and medium/style tags. Do not describe the reference character's existing hair/eye traits unless you want to override them. - Natural-language prompts (training format): start with
safe, 1girl.followed by concise sentences for framing, action, outfit, and scene (e.g.safe, 1girl. Upper body shot from the waist up. She is sitting on a bench in a park with trees.). - Negative prompt:
worst quality, low quality, score_1, score_2, score_3, artist name, blurry, jpeg artifacts, chromatic aberration.
License
An independent modified derivative of Anima, subject to the CircleStone model license; not an official CircleStone Labs product. Code licenses and attribution are in NOTICE.txt.
- Downloads last month
- -
Model tree for AnticPan/Anima-Role-Ref-KV
Base model
nvidia/Cosmos-Predict2-2B-Text2Image