thomasjvu commited on
Commit
879ed7a
·
verified ·
1 Parent(s): b81b29c

Finalize Lisper E2B full model card

Browse files
Files changed (1) hide show
  1. README.md +33 -16
README.md CHANGED
@@ -7,32 +7,49 @@ tags:
7
  - audio
8
  - merged
9
  - unsloth
 
10
  - lisper
11
  ---
12
 
13
  # Lisper Gemma 4 E2B Audio Full Checkpoint
14
 
15
- This is the v16 merged Lisper checkpoint: `google/gemma-4-E2B-it` with the trained Lisper LoRA adapter folded into a standalone `safetensors` model.
16
 
17
- ## Validation
18
 
19
- - Source run: Kaggle notebook `thomasjvu/lisper-gemma-4-audio-unsloth-training`, v16
20
- - Merge method: `merged_16bit`
 
21
  - Weight file: `model.safetensors`
22
- - Safetensors validation: complete
23
- - Size: `10,246,621,886` bytes
24
- - Tensor count: `2011`
25
 
26
- ## Training Summary
27
 
28
- - Method: supervised fine-tuning with Unsloth QLoRA / LoRA, then merged export
29
- - Training steps: `4000`
30
- - Selected checkpoint: `checkpoint-2500`
31
- - Final training loss: `0.7217483117580413`
32
- - Best validation metric: `4.851842880249023`
33
 
34
- This artifact is the canonical full-model checkpoint for export and evaluation. It is not a dense full-parameter fine-tune; it is a merged base+LoRA checkpoint.
35
 
36
- ## Deployment Notes
 
 
 
 
 
 
37
 
38
- Use this checkpoint as the correctness reference. For browser and consumer-device deployment, derive a 4-bit ONNX/WebGPU artifact and evaluate that quantized runtime before wiring it into the app.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7
  - audio
8
  - merged
9
  - unsloth
10
+ - speech
11
  - lisper
12
  ---
13
 
14
  # Lisper Gemma 4 E2B Audio Full Checkpoint
15
 
16
+ This is the merged Lisper checkpoint: `google/gemma-4-E2B-it` with the trained Lisper LoRA adapter folded into a standalone `safetensors` model.
17
 
18
+ ## Model Lineage
19
 
20
+ - Base model: `google/gemma-4-E2B-it`
21
+ - Training: Unsloth supervised fine-tuning with QLoRA / LoRA
22
+ - Merge method: base + LoRA adapter merged into a 16-bit checkpoint
23
  - Weight file: `model.safetensors`
24
+ - Training rows: `16,000`
25
+ - Validation rows: `2,000`
26
+ - Held-out test rows: `2,000`
27
 
28
+ This is not a dense full-parameter fine-tune. It is a merged base+LoRA checkpoint for easier deployment.
29
 
30
+ ## Evaluation
 
 
 
 
31
 
32
+ The release-quality evaluation is the v18 hybrid acoustic+Gemma path:
33
 
34
+ - Held-out rows: `2,000`
35
+ - Hard errors: `0`
36
+ - Verdict: `pass`
37
+ - Class match: `0.976`
38
+ - Clear/non-clear match: `0.989`
39
+ - Exact four-line format: `1.0`
40
+ - Reason/cue/encouragement present: `1.0`
41
 
42
+ The evaluated pipeline uses acoustic features for the lisp-class hint and Gemma for structured coaching text and tone. Do not interpret these metrics as a pure direct-Gemma raw-audio classification result.
43
+
44
+ ## Deployment
45
+
46
+ - Browser/WebGPU demo: `thomasjvu/lisper-gemma4-e2b-audio-onnx-q4f16`
47
+ - Server-side ZeroGPU fallback: `thomasjvu/lisper-zerogpu`
48
+ - Adapter-only package: `thomasjvu/lisper-gemma4-e2b-audio-lora`
49
+
50
+ Use the q4f16 ONNX/WebGPU package for browser demos. Use this merged checkpoint as the server-side correctness reference.
51
+
52
+ ## Limitations
53
+
54
+ - The lisp dataset is synthetically generated from speaker-disjoint source speech.
55
+ - This is a practice assistant, not a medical diagnosis tool or a replacement for a speech-language pathologist.