Scrabble LLM Benchmark

Immediate-score benchmark for model move quality.

Dataset

Existing tiles are grey. Each position shows the canonical optimal move in green.

Showing 49-60 of 100 positions.

pos-344-10

10 plies · optimal 25
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
P
DW
DL
DW
U
TL
C
A
V
E
R
N
TL
DL
S
DL
A
X
E
TW
DL
C
E
P
E
S
DL
TW
DL
O
DL
DL
TL
A
T
TL
TL
A
R
T
S
DW
DL
I
O
DL
DW
DL
DW
R
N
DL
DL
DW
DW
N
E
TL
DW
B
U
M
S
TW
DL
TW
ADNPTTU

rack ADNPTTU · tied moves 4

pos-361-10

10 plies · optimal 29
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
DW
DW
TL
TL
L
I
V
E
TL
DL
DL
DL
A
L
L
Y
TW
DL
A
D
D
I
C
T
DL
TW
DL
U
DL
E
DL
TL
T
TL
T
TL
TL
B
O
X
E
DW
DL
O
DL
DW
DL
A
G
G
I
E
S
DL
DW
DW
N
TL
TL
DW
TW
D
DL
TW
DL
TW
?ILMNNV

rack ?ILMNNV · tied moves 1

pos-420-10

10 plies · optimal 18
TW
DL
TW
DL
TW
DW
TL
A
R
T
Y
W
DW
DW
DL
C
DL
A
N
T
DL
DW
C
A
W
L
DL
DW
B
R
E
E
D
S
K
TL
O
N
TL
U
TL
DL
A
D
DL
T
DL
P
TW
DL
D
A
S
DL
TW
DL
Z
M
DL
DL
TL
TL
P
TL
TL
DW
DW
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
FKLPUUW

rack FKLPUUW · tied moves 1

pos-422-10

10 plies · optimal 104
TW
DL
O
X
I
D
A
T
E
TW
DW
TL
TL
A
L
A
DW
DL
DL
G
DW
N
DL
DW
DL
G
DL
DW
A
R
P
E
N
T
TL
TL
TL
R
TL
DL
DL
C
E
T
E
S
DL
TW
DL
E
DL
TW
DL
A
L
I
Y
A
DL
TL
TL
I
TL
R
TL
DW
D
O
DL
DW
E
DL
I
DW
DL
DW
DL
DL
D
DW
DW
TL
TL
S
DW
TW
DL
TW
DL
TW
?AEIOTX

rack ?AEIOTX · tied moves 1

pos-432-10

10 plies · optimal 32
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
DW
T
A
O
TL
TL
A
X
E
D
TL
DL
DL
C
A
P
DL
TW
DL
C
A
M
E
L
DL
TW
DL
A
W
DL
DL
TL
TL
T
TL
TL
DW
I
DW
DL
DW
O
DL
DW
DL
DW
N
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
AOOTTUV

rack AOOTTUV · tied moves 4

pos-452-10

10 plies · optimal 24
TW
DL
TW
B
I
T
E
DW
TL
TL
E
DW
DW
DL
DL
L
DW
DL
DW
DL
A
I
T
DL
DW
A
D
A
G
E
TL
TL
R
Z
F
TL
DL
DL
T
DL
O
S
DL
TW
DL
S
DL
TW
DL
W
A
Y
DL
DL
TL
A
T
TL
TL
A
I
R
Y
DW
DL
DW
L
I
DL
DW
DL
DW
P
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
ALOORTW

rack ALOORTW · tied moves 2

pos-464-10

10 plies · optimal 21
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
A
DW
DL
DW
B
O
W
DW
DL
DW
O
E
DW
TL
A
X
I
S
TL
TL
DL
L
DL
DL
DL
TW
DL
C
E
P
E
DL
TW
DL
B
I
DL
DL
DL
TL
A
D
I
TL
TL
R
G
DW
DL
A
M
O
U
N
T
DW
DL
DW
I
DL
O
DL
DW
DW
S
TL
R
TL
DW
TW
DL
E
DL
TW
EGIOORU

rack EGIOORU · tied moves 1

pos-477-10

10 plies · optimal 29
TW
DL
TW
DL
TW
DW
TL
A
U
R
I
C
DW
DL
DL
DW
A
E
DL
DW
DL
DW
A
T
DL
DW
B
O
W
S
E
TL
TL
TL
I
L
TL
DL
DL
DL
Z
DL
TW
DL
A
R
M
E
T
TW
DL
DL
R
DL
DL
TL
P
U
T
L
O
G
TL
DW
A
N
Y
DW
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
GLOPRRU

rack GLOPRRU · tied moves 1

pos-49-10

10 plies · optimal 20
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
G
DW
DL
DW
DL
N
A
Y
DL
DW
A
I
TL
TL
A
T
R
I
P
DL
DL
B
U
D
Y
DL
TW
DL
R
DL
TW
DL
DL
E
DL
DL
TL
C
A
G
O
TL
DW
A
R
T
DW
DL
DW
N
H
DW
DL
DW
A
X
E
DL
DW
DW
L
TL
DW
TW
DL
TW
DL
TW
AEEGNOO

rack AEEGNOO · tied moves 1

pos-510-10

10 plies · optimal 40
TW
DL
TW
DL
A
N
T
DW
TL
TL
L
DW
DW
DL
DL
O
DL
DW
DL
B
O
O
B
DL
DW
I
F
TL
TL
TL
R
TL
DL
DL
DL
S
DL
TW
DL
A
W
A
R
E
DL
TW
J
A
I
D
M
S
DL
C
E
I
L
TL
E
TL
TL
T
O
N
DW
DL
E
DW
I
DL
DW
DL
S
N
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
EJOSTTV

rack EJOSTTV · tied moves 1

pos-512-10

10 plies · optimal 36
TW
DL
J
U
G
A
B
O
N
Y
DW
TL
W
U
DW
DW
DL
A
D
O
R
N
E
R
S
DL
DW
N
L
K
DL
DW
O
DW
TL
TL
D
TL
TL
DL
A
X
E
L
S
DL
TW
DL
I
S
DL
TW
DL
R
DL
DL
DL
TL
A
T
R
I
A
TL
TL
DW
DW
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
DGIIJUV

rack DGIIJUV · tied moves 1

pos-521-10

10 plies · optimal 15
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
O
DW
DL
DW
U
DW
TL
TL
C
TL
DL
DL
A
H
DL
TW
B
I
J
O
U
X
DL
TW
A
Y
E
DL
L
DL
K
A
A
B
E
G
TL
C
E
L
O
M
I
DW
A
E
DW
G
DW
DL
F
DW
DL
O
DL
DW
E
DW
TL
T
TL
DW
TW
DL
TW
DL
TW
CNNNOQU

rack CNNNOQU · tied moves 3