Scrabble LLM Benchmark

Immediate-score benchmark for model move quality.

Dataset

Existing tiles are grey. Each position shows the canonical optimal move in green.

Showing 37-48 of 100 positions.

pos-129-10

10 plies · optimal 13
TW
DL
TW
B
O
O
N
S
TW
DW
TL
R
DW
DW
DL
DL
E
A
L
DL
DW
DL
C
A
L
V
E
DL
DW
C
DW
TL
TL
H
TL
DL
DL
A
E
DL
TW
DL
A
M
U
S
E
R
TW
DL
N
I
T
DL
TL
A
E
R
O
TL
TL
DW
G
I
DW
DL
DW
I
DL
DW
DL
DW
O
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
IIINNQR

rack IIINNQR · tied moves 1

pos-135-10

10 plies · optimal 29
TW
DL
TW
DL
A
N
DW
TL
A
T
A
M
A
N
DW
DL
J
N
L
DL
DW
DL
A
Y
DW
I
DL
DW
A
R
DW
Y
TL
TL
U
TL
A
B
DL
DL
G
DL
DL
O
TW
DL
U
DL
O
F
DL
A
R
DL
DL
T
A
TL
TL
W
TL
A
I
DW
L
DW
B
E
DL
DW
DL
DW
I
DL
DW
DL
DL
D
DW
TL
TL
E
DW
TW
DL
TW
DL
TW
AFIIIPV

rack AFIIIPV · tied moves 1

pos-153-10

10 plies · optimal 29
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
DW
DW
TL
TL
TL
TL
DL
DL
DL
DL
TW
DL
C
A
N
A
L
DL
A
DL
L
DL
G
DL
DL
E
X
TL
G
E
TL
C
A
R
P
I
DW
A
U
N
T
I
E
O
S
DL
DW
E
E
D
DW
D
DL
DW
DL
S
DL
I
DW
E
DW
TL
TL
S
TW
DL
TW
DL
TW
ADEEOSU

rack ADEEOSU · tied moves 1

pos-154-10

10 plies · optimal 33
TW
DL
TW
A
D
B
DW
TL
TL
N
DW
A
DW
DL
DL
A
I
M
E
R
DL
DW
DL
L
F
DW
B
E
E
P
S
TL
TL
TL
U
TL
DL
DL
DL
H
DL
TW
DL
A
R
V
A
L
DL
TW
DL
G
DL
Z
DL
TL
TL
I
O
TL
B
E
N
D
Y
DW
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
?AEEFUU

rack ?AEEFUU · tied moves 7

pos-19-10

10 plies · optimal 40
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
C
DW
DL
DW
A
R
I
A
TL
B
I
N
TL
T
TL
DL
U
DL
T
DL
B
O
R
T
Z
TW
DL
G
E
M
DL
TW
E
DL
A
D
DL
I
DL
K
TL
R
TL
S
TL
U
A
W
E
T
C
E
L
O
M
DL
DW
DL
L
DW
DL
DL
DW
E
TL
TL
DW
TW
DL
TW
DL
TW
EEKLPTU

rack EEKLPTU · tied moves 1

pos-202-10

10 plies · optimal 27
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
R
DW
DL
DW
DL
E
B
DL
DW
A
DW
U
TL
TL
V
R
TL
DL
DL
A
E
R
Y
DL
TW
DL
A
Z
O
T
H
S
I
TW
DL
L
DL
E
N
DL
TL
O
TL
A
M
TL
A
G
TL
U
L
F
DL
A
V
I
D
I
N
S
T
DW
DL
I
DW
DL
O
DL
DW
D
TL
TL
DW
TW
DL
TW
DL
TW
AERRSTU

rack AERRSTU · tied moves 2

pos-219-10

10 plies · optimal 18
TW
DL
A
I
T
S
DL
TW
DW
TL
T
TL
DW
DW
A
E
DL
C
DW
DL
DW
R
DL
L
A
N
K
DL
B
L
I
N
I
S
DW
TL
TL
G
H
TL
DL
H
DL
O
DL
TW
A
G
A
T
E
O
DL
TW
DL
D
D
DL
DL
DL
TL
O
Z
TL
TL
W
DW
DW
DL
N
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
FGKLNNP

rack FGKLNNP · tied moves 2

pos-223-10

10 plies · optimal 51
TW
A
E
O
N
I
A
N
DL
C
M
I
L
T
Y
J
TL
DW
H
DW
T
DL
I
DW
E
DL
H
DL
V
A
N
T
E
O
DW
C
A
R
O
L
K
TL
TL
H
TL
TL
DL
DL
A
F
F
I
N
E
TW
DL
R
DL
TW
DL
A
S
DL
DL
TL
TL
L
TL
TL
DW
O
DW
DL
DW
N
DL
DW
DL
DW
E
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
IMOPTUY

rack IMOPTUY · tied moves 1

pos-230-10

10 plies · optimal 28
TW
DL
TW
A
T
O
M
DW
TL
TL
C
DW
DW
DL
DL
Q
U
E
L
L
DL
DW
DL
L
DL
DW
DW
E
A
W
TL
TL
B
B
A
I
R
N
DL
B
O
D
Y
DL
T
TW
DL
D
DL
A
E
TW
DL
DL
Y
DL
V
TL
TL
TL
A
E
TL
DW
DW
R
DL
DW
DL
M
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
DEEJLLQ

rack DEEJLLQ · tied moves 1

pos-235-10

10 plies · optimal 32
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
A
DL
DW
DL
DW
D
DL
DW
DW
Y
TL
J
U
N
B
I
T
T
TL
DL
DL
A
G
O
U
TW
DL
A
N
Y
O
DL
M
TW
A
V
I
D
DL
DL
Z
DL
TL
G
D
E
TL
O
DW
DW
DL
G
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
EFHJNQU

rack EFHJNQU · tied moves 1

pos-307-10

10 plies · optimal 33
TW
DL
TW
DL
TW
DW
TL
TL
B
E
DW
DL
A
E
D
I
L
E
DL
DW
DL
R
DW
A
I
DW
F
DW
V
TL
TL
TL
A
N
E
DL
DL
A
G
G
E
R
DL
R
TW
DL
V
M
TW
DL
DL
O
DL
T
E
DL
TL
TL
W
A
T
TL
DW
O
F
DL
DW
DL
T
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
CIORTUW

rack CIORTUW · tied moves 2

pos-33-10

10 plies · optimal 20
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
DW
DW
A
TL
TL
A
B
J
U
R
E
D
TL
DL
DL
I
DL
O
TW
DL
R
DL
TW
DL
DL
E
DL
A
D
Z
E
TL
TL
T
TL
W
TL
B
E
W
R
A
P
T
O
DL
DW
N
A
B
E
L
I
A
DL
T
I
N
G
L
Y
DL
H
DW
DW
TL
U
TL
DW
TW
DL
A
F
T
E
R
S
TW
GIIILNT

rack GIIILNT · tied moves 1