Scrabble LLM Benchmark

Immediate-score benchmark for model move quality.

Dataset

Existing tiles are grey. Each position shows the canonical optimal move in green.

Showing 25-36 of 100 positions.

pos-512-6

6 plies · optimal 17
TW
DL
TW
A
B
O
N
Y
DW
TL
W
U
DW
DW
DL
A
D
O
R
N
E
R
DL
DW
N
L
K
DL
DW
O
DW
TL
TL
I
D
TL
TL
DL
R
E
DL
DL
TW
DL
I
S
DL
TW
DL
D
DL
DL
TL
TL
S
TL
TL
DW
DW
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
DIIIRSU

rack DIIIRSU · tied moves 1

pos-521-6

6 plies · optimal 31
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
DW
DW
TL
TL
TL
TL
DL
DL
DL
DL
TW
B
I
J
O
U
X
DL
TW
A
Y
E
DL
DL
DL
K
A
A
TL
TL
C
E
L
O
M
DW
A
E
H
A
N
G
DL
DW
DL
F
DW
DL
DL
DW
E
DW
TL
TL
DW
TW
DL
TW
DL
TW
AGHNNQU

rack AGHNNQU · tied moves 2

pos-577-6

6 plies · optimal 40
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
DW
DW
TL
TL
B
E
T
H
TL
DL
DL
DL
R
DL
TW
DL
A
Z
O
DL
TW
DL
A
W
L
DL
I
DL
E
K
E
D
I
D
TL
A
L
O
F
T
E
DW
DL
DW
DL
R
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
DDEEKLQ

rack DDEEKLQ · tied moves 1

pos-58-6

6 plies · optimal 30
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
DW
DW
A
TL
TL
TL
TL
P
DL
B
A
DL
DL
N
DL
A
A
H
DL
TW
O
DL
A
K
DL
DL
DL
E
TL
I
E
TL
TL
A
I
D
M
E
N
DW
L
F
E
DL
DW
DL
DW
U
DL
DL
DW
A
T
L
A
T
L
TL
DW
TW
DL
TW
DL
TW
AEELNOP

rack AEELNOP · tied moves 1

pos-59-6

6 plies · optimal 30
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
Y
E
U
K
DL
DW
DL
DW
A
V
O
DW
TL
TL
N
TL
TL
DL
A
B
DL
DL
TW
DL
R
DL
TW
DL
A
R
M
DL
TL
A
W
E
TL
TL
I
DW
DL
DW
R
DL
DW
DL
DW
E
DL
DL
DW
DW
D
TL
TL
DW
TW
DL
TW
DL
TW
EIIKUWY

rack EIIKUWY · tied moves 1

pos-603-6

6 plies · optimal 30
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
B
R
I
T
S
DL
A
D
I
E
U
DW
A
G
E
E
TL
R
TL
TL
DL
R
DL
A
I
D
DL
G
A
B
Y
N
DL
TW
DL
DL
DL
DL
TL
TL
TL
TL
DW
DW
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
ABGRTTU

rack ABGRTTU · tied moves 1

pos-623-6

6 plies · optimal 60
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
A
DL
DL
DW
DL
DW
N
DL
DW
DL
DW
E
DW
TL
U
TL
TL
DL
R
DL
DL
DL
TW
DL
I
C
DL
TW
DL
A
N
DL
H
DL
DL
A
V
I
D
TL
A
L
F
A
TL
O
R
DW
DL
A
Z
O
T
E
S
DW
DL
A
N
I
L
E
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
?AENNRU

rack ?AENNRU · tied moves 2

pos-85-6

6 plies · optimal 34
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
C
DW
DL
DW
E
DW
TL
TL
D
TL
TL
DL
DL
A
E
A
DL
TW
DL
N
A
R
G
U
E
DL
A
Z
O
DL
F
DL
D
O
E
T
H
A
M
I
S
S
TL
DW
DW
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
DEFHOTT

rack DEFHOTT · tied moves 1

pos-87-6

6 plies · optimal 83
TW
DL
TW
DL
TW
DW
TL
TL
DW
H
C
A
N
T
D
O
G
DL
E
DW
X
DW
DL
R
DW
I
DW
TL
N
A
C
H
E
S
TL
TL
I
A
DL
E
DL
DL
TW
A
DL
R
D
DL
TW
L
O
DL
DL
DL
TL
L
TL
TL
TL
E
DW
A
V
O
I
D
DL
DW
DL
L
DW
DL
DL
DW
E
DW
TL
TL
DW
F
DL
TW
DL
TW
?AHILNR

rack ?AHILNR · tied moves 1

pos-94-6

6 plies · optimal 63
TW
H
O
N
G
S
DL
TW
DW
TL
A
TL
DW
DW
DL
W
DL
DW
DL
DW
E
DW
DL
A
M
I
D
I
C
DW
TL
U
TL
TL
TL
DL
G
A
DL
DL
TW
A
H
O
R
S
E
DL
TW
DL
T
K
DL
DL
TL
A
S
TL
TL
DW
I
DW
DL
DW
L
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
GHNORSV

rack GHNORSV · tied moves 2

pos-1-10

10 plies · optimal 36
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
B
O
R
I
C
DW
TL
U
TL
TL
TL
DL
H
DL
A
E
R
I
E
S
TW
A
B
L
A
T
E
D
DL
TW
G
N
DL
D
DL
TL
I
E
TL
TL
N
DW
DW
DL
A
G
A
DL
DW
DL
V
DW
X
DL
DL
DW
J
O
TL
TL
DW
O
S
DL
TW
DL
TW
?DJLNTW

rack ?DJLNTW · tied moves 1

pos-109-10

10 plies · optimal 33
TW
DL
D
DL
B
DW
TL
A
I
TL
DW
R
DW
E
M
DL
DW
O
DL
DW
R
E
B
I
G
S
A
W
A
Y
DW
I
TL
X
A
V
O
TL
DL
O
DL
DL
A
T
DL
TW
B
A
N
N
E
T
S
I
TW
DL
I
E
DL
DL
C
DL
TL
K
TL
TL
TL
I
DW
DW
DL
E
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
DEILLMU

rack DEILLMU · tied moves 1