Scrabble LLM Benchmark

Immediate-score benchmark for model move quality.

Dataset

Existing tiles are grey. Each position shows the canonical optimal move in green.

Showing 1-12 of 100 positions.

pos-1-6

6 plies · optimal 40
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
DW
DW
TL
TL
TL
TL
DL
DL
A
E
R
I
E
TW
A
B
L
A
T
E
D
DL
TW
G
N
DL
D
DL
TL
I
E
TL
TL
N
DW
DW
J
A
G
S
DL
DW
DL
V
DW
DL
DL
DW
O
TL
TL
DW
TW
S
DL
TW
DL
TW
DHJNSUW

rack DHJNSUW · tied moves 1

pos-109-6

6 plies · optimal 24
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
A
W
A
DW
TL
X
A
V
O
TL
DL
O
DL
DL
A
DL
TW
B
A
N
N
E
T
S
DL
TW
DL
I
E
DL
DL
DL
TL
K
S
T
O
I
C
TL
I
DW
DW
DL
E
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
?CIIOTU

rack ?CIIOTU · tied moves 1

pos-129-6

6 plies · optimal 12
TW
DL
TW
B
O
O
TW
DW
TL
R
DW
DW
DL
DL
E
DW
DL
DW
DL
C
A
L
V
E
DL
DW
C
DW
TL
TL
H
TL
DL
DL
A
E
DL
TW
DL
A
M
U
S
E
DL
TW
DL
A
N
T
DL
TL
N
E
O
TL
TL
DW
I
DW
DL
DW
L
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
AIIILNQ

rack AIIILNQ · tied moves 2

pos-135-6

6 plies · optimal 43
TW
DL
TW
DL
TW
DW
TL
A
T
A
M
A
N
DW
DL
J
N
L
DL
DW
DL
A
Y
DW
I
DL
DW
A
R
DW
Y
F
TL
TL
U
TL
A
B
A
DL
DL
G
DL
DL
O
W
TW
DL
U
DL
O
N
DL
DL
R
DL
DL
T
TL
TL
TL
I
DW
DW
E
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
AFIIINW

rack AFIIINW · tied moves 1

pos-153-6

6 plies · optimal 39
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
DW
P
DW
TL
TL
A
TL
TL
DL
DL
R
DL
DL
TW
DL
A
N
A
DL
TW
DL
L
DL
G
DL
DL
TL
G
E
TL
C
TL
DW
A
U
N
T
I
E
DL
DW
E
E
D
DW
DL
DW
DL
S
DL
I
DW
DW
TL
E
TL
DW
TW
DL
S
DL
TW
?AEIPRU

rack ?AEIPRU · tied moves 2

pos-154-6

6 plies · optimal 83
TW
DL
M
A
D
TW
DW
TL
E
TL
N
DW
DW
DL
A
DL
I
DW
DL
DW
S
L
DL
DW
U
B
E
TL
TL
R
TL
U
TL
DL
DL
E
DL
H
DL
TW
DL
A
R
V
A
L
DL
TW
DL
G
DL
Z
DL
TL
TL
I
O
TL
DW
N
DW
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
AEEMRSU

rack AEEMRSU · tied moves 1

pos-19-6

6 plies · optimal 77
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
P
DL
DL
DW
DL
DW
L
C
DW
DL
DW
U
A
R
I
A
TL
M
N
TL
T
TL
DL
B
DL
T
DL
O
DL
TW
DL
I
E
M
DL
TW
DL
C
A
D
DL
I
DL
TL
TL
R
TL
S
TL
A
W
E
T
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
BCILMPU

rack BCILMPU · tied moves 1

pos-202-6

6 plies · optimal 33
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
B
DL
DW
A
DW
U
TL
V
V
R
TL
DL
I
DL
A
E
R
Y
DL
TW
DL
A
Z
O
T
H
I
TW
DL
L
I
DL
E
N
DL
TL
O
R
M
TL
G
TL
U
DW
DL
DW
D
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
AEIINRV

rack AEIINRV · tied moves 1

pos-219-6

6 plies · optimal 20
TW
DL
A
I
T
S
DL
TW
DW
TL
T
TL
DW
DW
A
E
DL
DW
DL
DW
R
DL
DW
DL
F
L
I
P
S
DW
TL
TL
G
TL
TL
DL
H
DL
DL
TW
A
G
A
T
E
DL
TW
DL
D
D
DL
DL
DL
TL
O
Z
TL
TL
W
DW
DW
DL
N
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
BFHLNPS

rack BFHLNPS · tied moves 1

pos-223-6

6 plies · optimal 74
TW
DL
TW
A
DL
F
TW
DW
TL
J
TL
E
DW
DL
I
DW
N
DL
DW
DL
V
A
N
T
E
DW
C
A
R
O
L
H
TL
TL
H
TL
I
DL
DL
A
F
F
DL
O
TW
DL
R
DL
N
TW
DL
A
S
DL
DL
TL
TL
L
TL
TL
DW
O
DW
DL
DW
N
DL
DW
DL
DW
E
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
?EHINNO

rack ?EHINNO · tied moves 1

pos-230-6

6 plies · optimal 42
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
DW
DW
A
W
TL
TL
B
B
A
I
R
N
DL
B
O
D
Y
DL
T
TW
DL
D
DL
A
E
TW
DL
DL
Y
DL
V
TL
TL
TL
E
M
DW
DW
A
DL
DW
DL
DW
C
DL
DW
DL
DL
DW
U
DW
TL
TL
L
TW
DL
TW
DL
E
TW
ACELMQU

rack ACELMQU · tied moves 1

pos-235-6

6 plies · optimal 48
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
Q
DL
DW
DL
DW
U
DL
DW
DW
O
TL
TL
B
I
T
T
TL
DL
DL
A
G
O
H
TW
DL
A
N
Y
DL
TW
A
V
I
D
DL
DL
DL
TL
D
TL
TL
DW
DW
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
FGHOQTU

rack FGHOQTU · tied moves 1