Scrabble LLM Benchmark

Immediate-score benchmark for model move quality.

Dataset

Existing tiles are grey. Each position shows the canonical optimal move in green.

Showing 85-96 of 100 positions.

pos-577-14

14 plies · optimal 34
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
A
V
O
S
DL
DW
Y
TL
TL
B
E
T
H
TL
DL
DL
DL
R
DL
TW
DL
A
Z
O
T
E
D
TW
DL
A
W
L
DL
I
I
TL
B
I
G
D
N
TL
A
L
O
F
T
O
E
DW
G
DL
K
D
R
R
DW
L
DL
E
DW
DL
A
S
E
E
TL
I
TL
DW
TW
DL
TW
S
DL
TW
DEGILNQ

rack DEGILNQ · tied moves 1

pos-58-14

14 plies · optimal 51
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
DW
DW
A
W
E
E
TL
TL
TL
P
DL
B
A
N
G
L
E
S
N
DL
A
A
H
DL
TW
O
DL
A
U
K
DL
DL
DL
E
X
I
E
TL
TL
A
I
D
M
E
N
DW
DL
S
F
E
DL
DW
DL
DW
U
DL
DL
DW
A
T
L
A
T
L
TL
DW
TW
DL
TW
DL
TW
EEGIRSX

rack EEGIRSX · tied moves 1

pos-59-14

14 plies · optimal 39
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
DW
A
V
O
W
E
R
TL
TL
N
TL
TL
DL
A
B
U
S
E
DL
TW
DL
R
DL
TW
DL
A
R
M
Y
DL
TL
A
W
E
TL
TL
I
O
DW
DL
B
R
I
N
E
DW
DL
DW
A
E
DL
DL
DW
DW
A
D
O
TL
DW
TW
DL
X
I
S
DL
TW
EIKSUUX

rack EIKSUUX · tied moves 1

pos-603-14

14 plies · optimal 72
TW
DL
TW
Q
U
A
G
DW
TL
TL
M
DW
DL
DL
DW
I
DL
DW
B
R
I
T
S
K
A
DL
A
D
I
E
U
DW
A
G
E
E
TL
R
A
T
O
N
Y
B
DL
R
DL
A
I
D
DL
A
R
Y
N
DL
TW
T
DL
A
S
H
DL
E
TL
TL
W
TL
TL
D
DW
L
DW
DL
DW
S
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
EGMQTUX

rack EGMQTUX · tied moves 1

pos-623-14

14 plies · optimal 64
TW
DL
TW
O
DL
TW
DW
TL
U
DW
DW
DL
DL
T
DW
DL
DW
DL
G
DW
DL
DW
U
DW
TL
TL
I
TL
DL
DL
DL
D
DL
TW
DL
C
E
E
DL
TW
DL
A
T
DL
H
DL
DL
A
A
V
I
D
TL
A
L
F
A
C
TL
R
O
R
A
N
E
N
T
DL
A
Z
O
T
E
S
DW
R
Y
A
N
I
L
E
DL
DL
O
I
DW
O
TL
TL
U
DW
L
E
TW
DL
S
TW
DGIOTUU

rack DGIOTUU · tied moves 1

pos-639-14

14 plies · optimal 15
TW
DL
TW
O
DL
TW
DW
TL
O
DW
DW
DL
DL
Z
DW
DL
DW
DL
C
E
R
E
DL
DW
E
DW
TL
TL
T
TL
A
TL
DL
DL
A
E
O
N
DL
TW
DL
C
A
D
S
O
DL
TW
A
I
A
L
DL
I
DL
TL
P
B
O
D
Y
TL
N
TL
E
DW
U
T
DL
A
L
A
N
D
S
DW
DL
K
W
DL
DL
DW
DW
O
TL
TL
DW
TW
DL
L
TW
DL
TW
GGOOTVZ

rack GGOOTVZ · tied moves 2

pos-641-14

14 plies · optimal 31
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
A
I
N
DL
DW
DL
B
O
T
H
Y
DL
DW
O
DW
TL
B
I
O
F
TL
DL
E
DL
A
M
I
N
E
DL
TW
DL
E
R
S
DL
TW
A
V
O
T
DL
I
DL
H
DL
Q
L
O
TL
TL
U
B
E
E
S
DW
DL
A
W
E
E
E
DW
DL
DW
A
N
I
DL
DW
DW
U
TL
TL
DW
TW
DL
X
TW
DL
TW
FHJKMPS

rack FHJKMPS · tied moves 1

pos-673-14

14 plies · optimal 51
TW
DL
TW
DL
A
N
DW
TL
TL
C
I
DW
DL
DL
A
I
L
DL
DW
A
R
I
L
S
E
DL
DW
X
DW
Q
R
TL
A
R
K
I
TL
U
O
DL
E
B
O
P
S
E
DL
N
TW
R
A
N
DL
TW
DL
A
M
I
D
S
DL
DL
TL
T
TL
D
TL
TL
I
DW
I
DW
DL
O
E
H
DW
DL
A
N
O
N
DL
E
DL
DW
DW
T
TL
F
TL
DW
TW
T
DL
T
DL
TW
EFHJPTW

rack EFHJPTW · tied moves 1

pos-686-14

14 plies · optimal 212
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
A
W
N
S
DW
DW
G
TL
TL
TL
A
G
U
E
S
DL
DL
A
L
T
E
R
DL
TW
DL
P
O
TW
DL
A
X
E
D
A
S
T
I
R
TL
Z
D
TL
F
TL
A
E
O
N
T
DL
DW
L
DL
DW
DL
C
E
T
E
DL
DL
DW
DW
E
TL
TL
DW
F
U
L
M
I
N
I
C
DL
TW
CFIIMNU

rack CFIIMNU · tied moves 1

pos-688-14

14 plies · optimal 47
TW
DL
TW
DL
TW
DW
TL
TL
A
DW
DW
DL
B
I
F
A
C
E
DL
DW
DL
U
DW
N
DL
DW
N
DW
A
E
O
N
TL
Q
U
A
S
H
E
R
TL
DL
DL
DL
K
DL
TW
DL
A
U
T
O
S
TW
DL
A
N
Y
DL
DL
TL
P
TL
TL
B
E
G
O
T
DW
DL
DW
E
DL
DW
DL
A
Z
I
D
O
DL
DL
DW
I
I
TL
TL
DW
A
N
T
DL
M
TW
DL
TW
AAEHOQU

rack AAEHOQU · tied moves 1

pos-729-14

14 plies · optimal 30
TW
DL
TW
DL
C
DW
TL
TL
DW
A
DW
DL
DL
DW
L
DL
DW
DL
A
G
I
O
DW
A
R
M
TL
TL
V
P
TL
M
DL
DL
DL
E
A
N
I
TW
DL
A
G
R
E
E
S
O
DL
DL
T
DL
R
H
T
TL
TL
I
E
E
TL
I
A
W
O
L
D
DW
N
C
DL
DW
N
T
DW
DL
A
W
E
E
DL
DL
DW
S
TL
TL
DW
TW
K
DL
TW
DL
TW
CEIMOTU

rack CEIMOTU · tied moves 1

pos-749-14

14 plies · optimal 68
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
DW
B
DW
D
U
V
E
T
I
N
E
TL
TL
DL
DL
E
DL
TW
DL
A
R
C
I
N
G
TW
DL
DL
P
DL
A
DL
TL
A
B
E
E
F
S
TL
L
DW
E
X
K
DW
DL
A
T
N
DL
E
DW
DL
A
G
O
N
E
DL
DL
T
DW
H
TL
TL
DW
A
S
C
I
TW
DL
TW
DEINTUV

rack DEINTUV · tied moves 2