Scrabble LLM Benchmark

Immediate-score benchmark for model move quality.

Nemotron 3 Ultra (free)low

nvidia/nemotron-3-ultra-550b-a55b · completed · released Jun 4, 2026

Export this runExport all

Score 0.0% · 0/241 points · avg tokens 0.0 · estimated OpenRouter-equivalent cost unavailable

pos-129-6

model 0 / optimal 12 · retry yes

TW
DL
TW
B
O
O
TW
DW
TL
R
DW
DW
DL
DL
E
DW
DL
DW
DL
C
A
L
V
E
DL
DW
C
DW
TL
TL
H
TL
DL
DL
A
E
DL
TW
DL
A
M
U
S
E
DL
TW
DL
N
T
DL
TL
TL
E
O
TL
TL
DW
DW
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
AIIILNQ
Attempt trace
attempt 1 · invalid

HTTP Error 404: Not Found

No timing trace.

No reasoning text captured.

attempt 2 · invalid

HTTP Error 404: Not Found

No timing trace.

No reasoning text captured.

pos-153-6

model 0 / optimal 39 · retry yes

TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
DW
DW
TL
TL
TL
TL
DL
DL
DL
DL
TW
DL
A
N
A
DL
TW
DL
L
DL
G
DL
DL
TL
G
E
TL
C
TL
DW
A
U
N
T
I
E
DL
DW
E
E
D
DW
DL
DW
DL
S
DL
I
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
?AEIPRU
Attempt trace
attempt 1 · invalid

HTTP Error 404: Not Found

No timing trace.

No reasoning text captured.

attempt 2 · invalid

HTTP Error 404: Not Found

No timing trace.

No reasoning text captured.

pos-154-6

model 0 / optimal 83 · retry yes

TW
DL
TW
A
D
TW
DW
TL
TL
N
DW
DW
DL
DL
I
DW
DL
DW
DL
L
DL
DW
B
E
TL
TL
TL
U
TL
DL
DL
DL
H
DL
TW
DL
A
R
V
A
L
DL
TW
DL
G
DL
Z
DL
TL
TL
I
O
TL
DW
N
DW
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
AEEMRSU
Attempt trace
attempt 1 · invalid

HTTP Error 404: Not Found

No timing trace.

No reasoning text captured.

attempt 2 · invalid

HTTP Error 404: Not Found

No timing trace.

No reasoning text captured.

pos-109-6

model 0 / optimal 24 · retry yes

TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
A
W
A
DW
TL
X
A
V
O
TL
DL
O
DL
DL
A
DL
TW
B
A
N
N
E
T
S
DL
TW
DL
I
E
DL
DL
DL
TL
K
TL
TL
TL
I
DW
DW
DL
E
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
?CIIOTU
Attempt trace
attempt 1 · invalid

HTTP Error 404: Not Found

No timing trace.

No reasoning text captured.

attempt 2 · invalid

HTTP Error 404: Not Found

No timing trace.

No reasoning text captured.

pos-1-6

model 0 / optimal 40 · retry yes

TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
DW
DW
TL
TL
TL
TL
DL
DL
A
E
R
I
E
TW
A
B
L
A
T
E
D
DL
TW
G
N
DL
D
DL
TL
I
E
TL
TL
N
DW
DW
DL
A
G
DW
DL
DW
DL
V
DW
DL
DL
DW
O
TL
TL
DW
TW
S
DL
TW
DL
TW
DHJNSUW
Attempt trace
attempt 1 · invalid

HTTP Error 404: Not Found

No timing trace.

No reasoning text captured.

attempt 2 · invalid

HTTP Error 404: Not Found

No timing trace.

No reasoning text captured.

pos-135-6

model 0 / optimal 43 · retry yes

TW
DL
TW
DL
TW
DW
TL
A
T
A
M
A
N
DW
DL
J
N
L
DL
DW
DL
A
Y
DW
I
DL
DW
A
R
DW
Y
TL
TL
U
TL
A
B
DL
DL
G
DL
DL
O
TW
DL
U
DL
O
TW
DL
DL
R
DL
DL
T
TL
TL
TL
I
DW
DW
E
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
AFIIINW
Attempt trace
attempt 1 · invalid

HTTP Error 404: Not Found

No timing trace.

No reasoning text captured.

attempt 2 · invalid

HTTP Error 404: Not Found

No timing trace.

No reasoning text captured.