AlexWortega commited on
Commit
a7f6ff8
·
verified ·
1 Parent(s): aee4df5

update make_card.py

Browse files
Files changed (1) hide show
  1. code/make_card.py +16 -1
code/make_card.py CHANGED
@@ -49,7 +49,22 @@ language:
49
  - en
50
  ---
51
 
52
- # openjev — Qwen3.5 as an NLI cross-encoder
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
53
 
54
  A Qwen3.5 decoder turned into a 3-way NLI cross-encoder in the spirit of
55
  [dleemiller's "NLI cross encoders: ways to use them"](https://huggingface.co/blog/dleemiller/nli-xenc-ways-to-use).
 
49
  - en
50
  ---
51
 
52
+ # openjev — Qwen3.5 trained as jev model
53
+
54
+ Zero-shot Doom, played by the cross-encoder from the text state (hypotheses "the nearest enemy is left of / right of /
55
+ exactly on the crosshair" → turn left / turn right / attack; 11 kills on average, oracle 18.8, ~57 ms per decision):
56
+
57
+ <video controls src="https://huggingface.co/AlexWortega/openjev/resolve/main/videos/doom_zs_position.mp4" width="720"></video>
58
+
59
+ From pixels (the frame goes in as image tokens through the Qwen3.5 vision tower, hypotheses about the monster's
60
+ x-position; 5.2 kills, still zero-shot):
61
+
62
+ <video controls src="https://huggingface.co/AlexWortega/openjev/resolve/main/videos/doom_vision_zeroshot_pixels.mp4" width="720"></video>
63
+
64
+ Zero-shot multiple-choice accuracy against Jev and Terra (their numbers read off their published chart; Chess and
65
+ GSM8K-k-choice are our constructions):
66
+
67
+ ![radar](assets/radar_openjev.png)
68
 
69
  A Qwen3.5 decoder turned into a 3-way NLI cross-encoder in the spirit of
70
  [dleemiller's "NLI cross encoders: ways to use them"](https://huggingface.co/blog/dleemiller/nli-xenc-ways-to-use).