Scrabble LLM Benchmark

Immediate-score benchmark for model move quality.

Glm 5.3low

cli2api/zai-coding-plan/glm-5.3 · cancelled · released Unknown

Export this runExport all

Score 0.0% · 0/958 points · avg tokens 0.0 · estimated OpenRouter-equivalent cost unavailable

pos-1-6

model 0 / optimal 40 · retry yes

TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
DW
DW
TL
TL
TL
TL
DL
DL
A
E
R
I
E
TW
A
B
L
A
T
E
D
DL
TW
G
N
DL
D
DL
TL
I
E
TL
TL
N
DW
DW
DL
A
G
DW
DL
DW
DL
V
DW
DL
DL
DW
O
TL
TL
DW
TW
S
DL
TW
DL
TW
DHJNSUW
Attempt trace
attempt 1 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

attempt 2 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

pos-109-6

model 0 / optimal 24 · retry yes

TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
A
W
A
DW
TL
X
A
V
O
TL
DL
O
DL
DL
A
DL
TW
B
A
N
N
E
T
S
DL
TW
DL
I
E
DL
DL
DL
TL
K
TL
TL
TL
I
DW
DW
DL
E
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
?CIIOTU
Attempt trace
attempt 1 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

attempt 2 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

pos-129-6

model 0 / optimal 12 · retry yes

TW
DL
TW
B
O
O
TW
DW
TL
R
DW
DW
DL
DL
E
DW
DL
DW
DL
C
A
L
V
E
DL
DW
C
DW
TL
TL
H
TL
DL
DL
A
E
DL
TW
DL
A
M
U
S
E
DL
TW
DL
N
T
DL
TL
TL
E
O
TL
TL
DW
DW
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
AIIILNQ
Attempt trace
attempt 1 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

attempt 2 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

pos-135-6

model 0 / optimal 43 · retry yes

TW
DL
TW
DL
TW
DW
TL
A
T
A
M
A
N
DW
DL
J
N
L
DL
DW
DL
A
Y
DW
I
DL
DW
A
R
DW
Y
TL
TL
U
TL
A
B
DL
DL
G
DL
DL
O
TW
DL
U
DL
O
TW
DL
DL
R
DL
DL
T
TL
TL
TL
I
DW
DW
E
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
AFIIINW
Attempt trace
attempt 1 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

attempt 2 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

pos-153-6

model 0 / optimal 39 · retry yes

TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
DW
DW
TL
TL
TL
TL
DL
DL
DL
DL
TW
DL
A
N
A
DL
TW
DL
L
DL
G
DL
DL
TL
G
E
TL
C
TL
DW
A
U
N
T
I
E
DL
DW
E
E
D
DW
DL
DW
DL
S
DL
I
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
?AEIPRU
Attempt trace
attempt 1 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

attempt 2 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

pos-154-6

model 0 / optimal 83 · retry yes

TW
DL
TW
A
D
TW
DW
TL
TL
N
DW
DW
DL
DL
I
DW
DL
DW
DL
L
DL
DW
B
E
TL
TL
TL
U
TL
DL
DL
DL
H
DL
TW
DL
A
R
V
A
L
DL
TW
DL
G
DL
Z
DL
TL
TL
I
O
TL
DW
N
DW
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
AEEMRSU
Attempt trace
attempt 1 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

attempt 2 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

pos-19-6

model 0 / optimal 77 · retry yes

TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
C
DW
DL
DW
A
R
I
A
TL
TL
N
TL
T
TL
DL
DL
T
DL
O
DL
TW
DL
E
M
DL
TW
DL
A
D
DL
I
DL
TL
TL
R
TL
S
TL
A
W
E
T
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
BCILMPU
Attempt trace
attempt 1 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

attempt 2 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

pos-202-6

model 0 / optimal 33 · retry yes

TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
B
DL
DW
A
DW
U
TL
TL
V
R
TL
DL
DL
A
E
R
Y
DL
TW
DL
A
Z
O
T
H
I
TW
DL
L
DL
E
N
DL
TL
O
TL
M
TL
G
TL
U
DW
DL
DW
D
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
AEIINRV
Attempt trace
attempt 1 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

attempt 2 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

pos-219-6

model 0 / optimal 20 · retry yes

TW
DL
A
I
T
S
DL
TW
DW
TL
T
TL
DW
DW
A
E
DL
DW
DL
DW
R
DL
DW
DL
DW
I
DW
TL
TL
G
TL
TL
DL
H
DL
DL
TW
A
G
A
T
E
DL
TW
DL
D
D
DL
DL
DL
TL
O
Z
TL
TL
W
DW
DW
DL
N
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
BFHLNPS
Attempt trace
attempt 1 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

attempt 2 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

pos-223-6

model 0 / optimal 74 · retry yes

TW
DL
TW
A
DL
TW
DW
TL
J
TL
DW
DW
DL
I
DW
DL
DW
DL
V
A
N
T
E
DW
C
A
R
O
L
TL
TL
H
TL
TL
DL
DL
A
F
F
DL
TW
DL
R
DL
TW
DL
A
S
DL
DL
TL
TL
L
TL
TL
DW
O
DW
DL
DW
N
DL
DW
DL
DW
E
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
?EHINNO
Attempt trace
attempt 1 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

attempt 2 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

pos-230-6

model 0 / optimal 42 · retry yes

TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
DW
DW
A
W
TL
TL
B
B
A
I
R
N
DL
B
O
D
Y
DL
T
TW
DL
D
DL
A
E
TW
DL
DL
Y
DL
V
TL
TL
TL
E
TL
DW
DW
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
ACELMQU
Attempt trace
attempt 1 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

attempt 2 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

pos-235-6

model 0 / optimal 48 · retry yes

TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
DW
DW
TL
TL
B
I
T
TL
DL
DL
A
G
O
DL
TW
DL
A
N
Y
DL
TW
A
V
I
D
DL
DL
DL
TL
D
TL
TL
DW
DW
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
FGHOQTU
Attempt trace
attempt 1 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

attempt 2 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

pos-307-6

model 0 / optimal 29 · retry yes

TW
DL
TW
DL
TW
DW
TL
TL
B
DW
DL
DL
DW
E
DL
DW
DL
DW
A
I
DW
DW
V
TL
TL
TL
A
N
E
DL
DL
A
G
G
E
R
DL
R
TW
DL
V
M
TW
DL
DL
O
DL
E
DL
TL
TL
TL
T
TL
DW
DW
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
ACDEILO
Attempt trace
attempt 1 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

attempt 2 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

pos-33-6

model 0 / optimal 83 · retry yes

TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
DW
DW
TL
TL
A
B
J
U
R
E
TL
DL
DL
I
DL
DL
TW
DL
R
DL
TW
DL
DL
E
DL
DL
TL
TL
T
TL
TL
B
E
W
R
A
P
T
DW
DL
DW
A
B
E
L
I
A
DL
DW
DL
H
DW
DW
TL
U
TL
DW
TW
DL
A
F
T
E
R
S
TW
?DEGIOT
Attempt trace
attempt 1 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

attempt 2 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

pos-344-6

model 0 / optimal 24 · retry yes

TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
DW
DW
TL
TL
A
TL
TL
DL
S
DL
DL
TW
DL
C
E
P
E
S
DL
TW
DL
O
DL
DL
TL
A
T
TL
TL
A
R
T
S
DW
DL
I
O
DL
DW
DL
DW
R
N
DL
DL
DW
DW
N
E
TL
DW
TW
DL
TW
DL
TW
ENRTTUV
Attempt trace
attempt 1 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

attempt 2 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

pos-361-6

model 0 / optimal 34 · retry yes

TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
DW
DW
TL
TL
TL
TL
DL
DL
DL
DL
TW
DL
A
D
D
I
C
T
DL
TW
DL
U
DL
E
DL
TL
T
TL
T
TL
TL
B
O
X
E
DW
DL
O
DL
DW
DL
A
G
DL
DL
DW
DW
N
TL
TL
DW
TW
D
DL
TW
DL
TW
EGILLMV
Attempt trace
attempt 1 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

attempt 2 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

pos-420-6

model 0 / optimal 39 · retry yes

TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
A
N
T
DL
DW
C
A
W
L
DL
DW
B
R
E
E
D
S
TL
O
N
TL
TL
DL
A
D
DL
T
DL
DL
TW
DL
D
S
DL
TW
DL
Z
DL
DL
DL
TL
TL
TL
TL
DW
DW
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
ACLPRUW
Attempt trace
attempt 1 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

attempt 2 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

pos-422-6

model 0 / optimal 22 · retry yes

TW
DL
TW
DL
TW
DW
TL
TL
A
L
A
DW
DL
DL
G
DW
N
DL
DW
DL
G
DL
DW
A
R
P
E
N
T
TL
TL
TL
R
TL
DL
DL
C
E
T
E
S
DL
TW
DL
E
DL
TW
DL
DL
L
DL
DL
TL
TL
TL
TL
DW
DW
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
AEIIOOR
Attempt trace
attempt 1 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

attempt 2 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

pos-432-6

model 0 / optimal 34 · retry yes

TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
DW
DW
TL
TL
A
X
TL
DL
DL
C
DL
P
DL
TW
DL
C
A
M
E
L
DL
TW
DL
A
W
DL
DL
TL
TL
T
TL
TL
DW
DW
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
EIOOOUV
Attempt trace
attempt 1 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

attempt 2 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

pos-452-6

model 0 / optimal 65 · retry yes

TW
DL
TW
B
I
T
E
DW
TL
TL
E
DW
DW
DL
DL
L
DW
DL
DW
DL
I
DL
DW
A
D
A
G
E
TL
TL
R
Z
F
TL
DL
DL
T
DL
O
S
DL
TW
DL
S
DL
TW
DL
DL
Y
DL
DL
TL
TL
TL
TL
DW
DW
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
AILOPRT
Attempt trace
attempt 1 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

attempt 2 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

pos-464-6

model 0 / optimal 19 · retry yes

TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
B
DL
DW
DL
DW
O
DW
TL
A
X
I
S
TL
TL
DL
L
DL
DL
DL
TW
DL
C
E
P
E
DL
TW
DL
B
I
DL
DL
DL
TL
A
D
TL
TL
R
DW
DL
DW
M
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
AAIOOSU
Attempt trace
attempt 1 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

attempt 2 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

pos-477-6

model 0 / optimal 14 · retry yes

TW
DL
TW
DL
TW
DW
TL
TL
C
DW
DL
DL
DW
A
E
DL
DW
DL
DW
A
T
DL
DW
B
O
W
S
TL
TL
TL
I
L
TL
DL
DL
DL
Z
DL
TW
DL
A
R
M
E
T
TW
DL
DL
DL
DL
TL
TL
TL
TL
DW
DW
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
ILRRTUU
Attempt trace
attempt 1 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

attempt 2 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

pos-49-6

model 0 / optimal 22 · retry yes

TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
DW
DW
TL
TL
TL
TL
DL
DL
B
U
D
DL
TW
DL
R
DL
TW
DL
DL
E
DL
DL
TL
C
A
G
O
TL
DW
A
R
T
DW
DL
DW
N
H
DW
DL
DW
A
X
E
DL
DW
DW
L
TL
DW
TW
DL
TW
DL
TW
AEIOOTY
Attempt trace
attempt 1 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

attempt 2 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

pos-510-6

model 0 / optimal 38 · retry yes

TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
B
O
O
B
DL
DW
I
TL
TL
TL
R
TL
DL
DL
DL
S
DL
TW
DL
A
W
A
R
E
DL
TW
DL
A
I
D
M
S
DL
TL
TL
E
TL
TL
DW
N
DW
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
AEFLOTT
Attempt trace
attempt 1 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.

attempt 2 · invalid

HTTP Error 502: Bad Gateway

No timing trace.

No reasoning text captured.