qijiv2000 commited on
Commit
75f453d
·
verified ·
1 Parent(s): 119a35a

docs: full English model card from Index-Translate technical report

Browse files
Files changed (1) hide show
  1. README.md +84 -6
README.md CHANGED
@@ -1,16 +1,94 @@
1
  ---
2
- license: other
3
  tags:
4
  - translation
5
  - index
6
  ---
7
 
8
- # Index-MT-2B
9
 
10
- 通用翻译模型(英/日/中互译),网页 translate 页默认 2B。
 
 
11
 
12
- 在线体验:https://index-translate.bilibili.com (B站 Index-Translate 系列线上服务同款权重)。
13
 
14
- Base: Qwen3.5 系列。推理:vLLM 直接 `vllm serve` 本目录即可(safetensors + tokenizer 齐全)。
 
 
15
 
16
- > Model card 草稿,待补充评测数据与详细训练信息。
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ license: apache-2.0
3
  tags:
4
  - translation
5
  - index
6
  ---
7
 
8
+ # Index-Translate-2B
9
 
10
+ [![Demo](https://img.shields.io/badge/Demo-Online-orange.svg)](https://index-translate.bilibili.com/)
11
+ [![Code](https://img.shields.io/badge/GitHub-Index--Translate-yellow.svg)](https://github.com/bilibili/Index-Translate)
12
+ [![License](https://img.shields.io/badge/License-Apache--2.0-lightgrey.svg)](https://github.com/bilibili/Index-Translate/blob/main/LICENSE)
13
 
14
+ **Index-Translate-2B** is the 2B-parameter multilingual text translation model of the **Index-Translate** family, built on the Qwen3.5 backbone. It supports **148 languages** with multilingual instruction following — terminology, formatting, style, structure, and output-length constraints — and powers the translate page of the [online demo](https://index-translate.bilibili.com/).
15
 
16
+ > 📄 Technical report: *Index-Translate: A Multilingual Translation Model Family — Text, Speech, Controlled Dubbing, and Long-Document Translation* (Index LLM Team, September 2026)
17
+ >
18
+ > 💻 Code, quickstarts, browser extension & video-dubbing pipeline: [github.com/bilibili/Index-Translate](https://github.com/bilibili/Index-Translate)
19
 
20
+ ## Highlights
21
+
22
+ - **148 languages** with instruction following: general translation, constrained translation (terminology, structure, style, context), and meme/internet-culture translation in a single checkpoint.
23
+ - **Training recipe**: multilingual mid-training (general + monolingual + parallel + pivot-organized data) → specialist SFT (general / instruction / meme experts) → RL with judged rewards (GRPO; XCOMET-XXL + adequacy gates for general translation, Rubric-as-Reward for instruction following) under RIVAL adversarial judge supervision → **parameter interpolation** (model soup, general : instruction : meme = 0.8 : 0.1 : 0.1) → targeted **multi-teacher on-policy distillation (MOPD)** for remaining weaknesses.
24
+ - **262,144-token context window**, greedy decoding recommended.
25
+ - Larger sibling: [IndexTeam/Index-Translate-9B](https://huggingface.co/IndexTeam/Index-Translate-9B).
26
+
27
+ ## Benchmarks
28
+
29
+ Text translation (Table 4 of the report; WMT26 judge on a 0–100 scale, others 0–1):
30
+
31
+ | Model | FLORES COMET-22 | WMT24++ COMET-22 | WMT26 Judge | instTrans IFscore | IFMTBench IFscore | Vertical mean | MEME |
32
+ |---|---|---|---|---|---|---|---|
33
+ | **Index-Translate-2B** | 0.8655 | 0.8489 | 60.26 | 0.7569 | 0.7584 | 0.8377 | 0.6443 |
34
+ | Index-Translate-9B | **0.8789** | 0.8601 | 75.35 | **0.8209** | 0.8760 | 0.8451 | **0.7387** |
35
+ | Hy-MT2-7B | 0.8747 | 0.8593 | 60.51 | 0.6079 | 0.8741 | 0.8335 | 0.5139 |
36
+ | Hy-MT2-30B-A3B | 0.8787 | **0.8624** | 66.81 | 0.6415 | 0.9029 | **0.8459** | 0.5812 |
37
+ | TranslateGemma-12B | 0.8732 | 0.8524 | — | 0.3068 | 0.2892 | 0.8347 | 0.4281 |
38
+ | Qwen3.5-2B (base) | 0.6983 | 0.6933 | 32.11 | 0.2431 | 0.3836 | 0.7557 | 0.2062 |
39
+
40
+ The 2B model outperforms Hy-MT2-1.8B on all metrics available for both models.
41
+
42
+ Vertical-domain translation (COMET-22; GuoFeng uses document-COMET):
43
+
44
+ | Model | OPUS-Books | Biomedical | MTNT | MuST-Cinema | GuoFeng |
45
+ |---|---|---|---|---|---|
46
+ | **Index-Translate-2B** | 0.7845 | 0.8635 | 0.8132 | 0.8930 | **0.8345** |
47
+ | Index-Translate-9B | 0.8010 | 0.8674 | 0.8246 | **0.8979** | **0.8345** |
48
+
49
+ General capabilities (answer accuracy %): C-Eval 42.6 / GPQA-Diamond 27.4 / INCLUDE 39.1 / MMMLU 42.7.
50
+
51
+ ## Usage
52
+
53
+ ```bash
54
+ vllm serve IndexTeam/Index-Translate-2B --served-model-name Index-Translate-2B --port 8000
55
+ ```
56
+
57
+ ```python
58
+ from openai import OpenAI
59
+
60
+ client = OpenAI(base_url="http://localhost:8000/v1", api_key="EMPTY")
61
+ resp = client.chat.completions.create(
62
+ model="Index-Translate-2B",
63
+ messages=[{"role": "user", "content": "Translate the following text into English:\n\n你好,世界!"}],
64
+ temperature=0,
65
+ )
66
+ print(resp.choices[0].message.content)
67
+ ```
68
+
69
+ Transformers and SGLang quickstarts: [inference/llm](https://github.com/bilibili/Index-Translate/tree/main/inference/llm).
70
+
71
+ ## Model family
72
+
73
+ | Model | Sizes | Task |
74
+ |---|---|---|
75
+ | **Index-Translate** | [2B](https://huggingface.co/IndexTeam/Index-Translate-2B) / [9B](https://huggingface.co/IndexTeam/Index-Translate-9B) | Multilingual text translation & translation instructions |
76
+ | Index-Echo S2TT | [2B](https://huggingface.co/IndexTeam/Index-Echo-S2TT-2B) / [9B](https://huggingface.co/IndexTeam/Index-Echo-S2TT-9B) | Speech-to-text translation |
77
+ | Index-Echo S2ST | [2B](https://huggingface.co/IndexTeam/Index-Echo-S2ST-2B) / [9B](https://huggingface.co/IndexTeam/Index-Echo-S2ST-9B) | Speech-to-speech translation with voice conditioning |
78
+ | Index-Homura | [2B](https://huggingface.co/IndexTeam/Index-Homura-2B) / [9B](https://huggingface.co/IndexTeam/Index-Homura-9B) | Syllable-controlled translation (dubbing) |
79
+ | Index-NaitiveLong (NaiLong) | [2B](https://huggingface.co/IndexTeam/Index-Nailong-2B) / [9B](https://huggingface.co/IndexTeam/Index-Nailong-9B) | Long-document translation |
80
+
81
+ ## Citation
82
+
83
+ ```bibtex
84
+ @techreport{indextranslate2026,
85
+ title={Index-Translate: A Multilingual Translation Model Family --- Text, Speech, Controlled Dubbing, and Long-Document Translation},
86
+ author={Index LLM Team},
87
+ year={2026},
88
+ month={September}
89
+ }
90
+ ```
91
+
92
+ ## License
93
+
94
+ Apache-2.0.