Add files using upload-large-folder tool
Browse files- README.md +44 -0
- checkpoint.safetensors +3 -0
README.md
ADDED
|
@@ -0,0 +1,44 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
datasets:
|
| 4 |
+
- lerobot/libero
|
| 5 |
+
base_model:
|
| 6 |
+
- Wan-AI/Wan2.2-TI2V-5B
|
| 7 |
+
---
|
| 8 |
+
|
| 9 |
+
# Wan2.2-5B-Libero
|
| 10 |
+
|
| 11 |
+
This repository provides a Wan2.2 TI2V 5B checkpoint finetuned on the full LIBERO dataset for robotics video generation.
|
| 12 |
+
|
| 13 |
+
## Model Summary
|
| 14 |
+
|
| 15 |
+
- Base model: `Wan-AI/Wan2.2-TI2V-5B`
|
| 16 |
+
- Finetuning data: full LIBERO training set
|
| 17 |
+
- Training steps: `85000`
|
| 18 |
+
- Learning rate: `1e-5`
|
| 19 |
+
- Video length: `49` frames
|
| 20 |
+
- Frame rate: `10 FPS`
|
| 21 |
+
- Task setting: image-to-video generation for LIBERO-style robot trajectories
|
| 22 |
+
|
| 23 |
+
## Files
|
| 24 |
+
|
| 25 |
+
- `checkpoint.safetensors`: finetuned DiT checkpoint
|
| 26 |
+
|
| 27 |
+
## Intended Use
|
| 28 |
+
|
| 29 |
+
This checkpoint is intended to be used together with the original Wan2.2 TI2V 5B text encoder, tokenizer, and VAE.
|
| 30 |
+
|
| 31 |
+
In LightEWM, inference can be launched by keeping the standard `examples/LIBERO/infer_ti2v_5b.yaml` config and overriding the DiT checkpoint path with:
|
| 32 |
+
|
| 33 |
+
```bash
|
| 34 |
+
bash scripts/infer.sh \
|
| 35 |
+
--config examples/LIBERO/infer_ti2v_5b.yaml \
|
| 36 |
+
--dataset-base-path data/libero_i2v_train \
|
| 37 |
+
--metadata-path data/libero_i2v_train/metadata_dense_prompt.csv \
|
| 38 |
+
--ckpt checkpoints/Wan2.2-5B-Libero/checkpoint.safetensors
|
| 39 |
+
```
|
| 40 |
+
|
| 41 |
+
## Notes
|
| 42 |
+
|
| 43 |
+
- This repository stores only the finetuned DiT weights.
|
| 44 |
+
- The original Wan2.2 TI2V 5B base checkpoint is still required at inference time.
|
checkpoint.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fa43375ad0ec3435ad2000cb2641e395a342d5c8abb496559cd514aa85839075
|
| 3 |
+
size 9999659704
|