Scrabble LLM Benchmark

Immediate-score benchmark for model move quality.

Dataset

Existing tiles are grey. Each position shows the canonical optimal move in green.

Showing 61-72 of 100 positions.

pos-577-10

10 plies · optimal 24
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
A
V
O
S
DL
DW
Y
TL
TL
B
E
T
H
TL
DL
DL
DL
R
DL
TW
DL
A
Z
O
DL
TW
DL
A
W
L
DL
I
DL
TL
I
G
D
TL
A
L
O
F
T
O
E
DW
DL
K
I
D
R
R
DW
DL
E
DW
DL
DL
DW
E
TL
TL
DW
TW
DL
TW
DL
TW
DDEILQT

rack DDEILQT · tied moves 1

pos-58-10

10 plies · optimal 51
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
DW
DW
A
W
TL
TL
TL
P
DL
B
A
N
G
DL
N
DL
A
A
H
DL
TW
O
DL
A
K
DL
DL
DL
E
X
I
E
TL
TL
A
I
D
M
E
N
DW
DL
S
F
E
DL
DW
DL
DW
U
DL
DL
DW
A
T
L
A
T
L
TL
DW
TW
DL
TW
DL
TW
EEGLRSX

rack EEGLRSX · tied moves 1

pos-59-10

10 plies · optimal 32
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
DW
A
V
O
W
DW
TL
TL
N
TL
TL
DL
A
B
U
S
E
DL
TW
DL
R
DL
TW
DL
A
R
M
Y
DL
TL
A
W
E
TL
TL
I
O
DW
DL
B
R
I
N
K
DW
DL
DW
E
DL
DL
DW
DW
D
TL
TL
DW
TW
DL
TW
DL
TW
BEIIKUU

rack BEIIKUU · tied moves 1

pos-603-10

10 plies · optimal 28
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
B
R
I
T
S
DL
A
D
I
E
U
DW
A
G
E
E
TL
R
A
T
O
N
Y
B
DL
R
DL
A
I
D
DL
A
R
Y
N
DL
TW
DL
A
S
H
DL
TL
TL
A
X
TL
DW
DW
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
?DGTTUX

rack ?DGTTUX · tied moves 5

pos-85-10

10 plies · optimal 32
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
C
E
P
DW
DL
DW
E
DW
TL
TL
D
TL
TL
DL
DL
A
E
A
DL
TW
DL
N
A
R
G
U
E
DL
A
Z
O
DL
F
DL
TL
T
A
M
I
S
S
TL
DW
T
DW
DL
A
R
I
L
E
D
DW
DL
DW
R
DL
DL
DW
DW
E
TL
DW
TW
DL
D
I
V
A
DL
TW
ADFHIOV

rack ADFHIOV · tied moves 1

pos-87-10

10 plies · optimal 33
TW
DL
B
L
A
W
N
TW
DW
TL
P
A
DW
C
A
N
T
D
O
G
S
DL
DW
X
DW
S
DL
DW
I
DW
TL
A
C
H
E
S
TL
TL
DL
A
DL
E
DL
DL
C
H
A
R
R
D
DL
TW
I
O
DL
DL
DL
TL
R
L
TL
TL
TL
E
DW
A
V
O
I
D
DL
DW
DL
L
DW
DL
DL
DW
E
DW
TL
TL
DW
F
DL
TW
DL
TW
ABILNUW

rack ABILNUW · tied moves 2

pos-94-10

10 plies · optimal 42
TW
DL
V
E
T
DL
TW
DW
TL
A
R
V
O
S
DW
DW
DL
W
DL
DW
A
U
L
I
C
E
DW
DL
A
M
I
D
I
C
DW
TL
U
TL
TL
TL
DL
G
A
DL
DL
TW
A
H
O
R
S
E
DL
TW
A
L
A
N
T
K
DL
DL
TL
N
A
S
TL
TL
T
DW
I
DW
DL
H
DW
L
DL
DW
DL
E
DL
DL
DW
DW
R
TL
TL
DW
TW
DL
TW
DL
TW
EGGQTTV

rack EGGQTTV · tied moves 1

pos-1-14

14 plies · optimal 30
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
B
O
R
I
C
DW
TL
U
TL
TL
TL
DL
H
DL
A
E
R
I
E
S
T
TW
A
B
L
A
T
E
D
DL
A
G
N
DL
D
DL
J
TL
I
E
TL
TL
N
A
W
N
Y
DW
DL
A
G
A
R
DL
DW
DL
V
DW
X
DL
DL
DW
O
TL
TL
DW
TW
S
DL
TW
DL
TW
ADJLLNN

rack ADJLLNN · tied moves 1

pos-109-14

14 plies · optimal 26
TW
DL
E
H
DL
B
DW
TL
A
N
I
L
A
I
R
DW
E
DL
DW
O
DL
DW
R
DL
B
I
G
S
A
W
A
Y
DW
I
TL
X
A
V
O
TL
DL
O
DL
DL
A
T
DL
TW
B
A
N
N
E
T
S
I
TW
DL
I
E
DL
DL
C
DL
TL
K
M
TL
TL
I
DW
E
DW
DL
E
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
DEHLNUU

rack DEHLNUU · tied moves 2

pos-129-14

14 plies · optimal 22
TW
DL
TW
B
O
O
N
S
TW
DW
TL
R
I
DW
DL
DL
E
A
L
DL
DW
DL
C
A
L
V
E
D
DL
DW
C
DW
R
TL
TL
H
I
TL
DL
DL
A
E
E
TW
DL
A
M
U
S
E
R
TW
DL
N
T
DL
TL
A
E
R
O
TL
TL
DW
G
DW
DL
DW
I
DL
DW
DL
B
U
N
K
O
DL
DL
DW
U
TL
TL
DW
TW
N
DL
TW
DL
TW
DIIINPQ

rack DIIINPQ · tied moves 1

pos-154-14

14 plies · optimal 43
TW
DL
TW
A
D
A
DW
TL
TL
N
DW
U
DW
DL
DL
A
I
M
E
R
DL
DW
DL
L
E
DW
B
E
E
P
S
TL
TL
TL
U
TL
DL
DL
DL
H
DL
TW
DL
A
R
V
A
L
DL
TW
DL
G
DL
Z
DL
TL
TL
I
B
O
R
E
R
TL
B
E
N
D
Y
DW
DL
DW
O
DL
DW
DL
DW
O
DL
DL
DW
DW
N
TL
TL
DW
L
O
O
F
S
TW
DL
TW
EFLOOSU

rack EFLOOSU · tied moves 1

pos-19-14

14 plies · optimal 18
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
C
DW
DL
DW
A
R
I
A
TL
B
I
N
TL
T
TL
DL
U
DL
T
DL
B
O
R
T
Z
TW
DL
G
E
M
DL
TW
DL
A
D
DL
I
DL
TL
TL
R
A
S
K
S
TL
A
W
E
T
A
C
E
L
O
M
DL
T
DL
E
DW
P
DL
DL
A
DW
N
DW
L
TL
TL
DW
T
DL
E
TW
DL
TW
AAEITUU

rack AAEITUU · tied moves 2