Scrabble LLM Benchmark

Immediate-score benchmark for model move quality.

Dataset

Existing tiles are grey. Each position shows the canonical optimal move in green.

Showing 13-24 of 100 positions.

pos-307-6

6 plies · optimal 29
TW
DL
TW
DL
TW
DW
TL
TL
B
DW
DL
DL
DW
E
DL
DW
DL
C
DW
A
I
DW
O
V
TL
TL
TL
L
A
N
E
DL
DL
A
G
G
E
R
DL
R
TW
DL
V
A
M
TW
DL
DL
O
DL
D
E
DL
TL
TL
TL
T
TL
DW
DW
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
ACDEILO

rack ACDEILO · tied moves 2

pos-33-6

6 plies · optimal 83
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
DW
DW
TL
TL
A
B
J
U
R
E
TL
DL
DL
I
DL
DL
S
T
O
D
G
I
E
R
DL
TW
DL
DL
E
DL
DL
TL
TL
T
TL
TL
B
E
W
R
A
P
T
DW
DL
DW
A
B
E
L
I
A
DL
DW
DL
H
DW
DW
TL
U
TL
DW
TW
DL
A
F
T
E
R
S
TW
?DEGIOT

rack ?DEGIOT · tied moves 1

pos-344-6

6 plies · optimal 24
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
DW
DW
TL
TL
A
TL
TL
DL
S
DL
DL
TW
DL
C
E
P
E
S
DL
TW
DL
O
DL
DL
TL
A
T
TL
TL
A
R
T
S
DW
DL
I
O
DL
DW
DL
DW
R
N
DL
DL
DW
DW
N
E
TL
DW
TW
DL
R
E
V
DL
TW
ENRTTUV

rack ENRTTUV · tied moves 1

pos-361-6

6 plies · optimal 34
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
DW
DW
TL
TL
TL
TL
DL
DL
DL
DL
TW
DL
A
D
D
I
C
T
DL
TW
DL
U
DL
E
DL
G
T
TL
T
TL
TL
L
B
O
X
E
DW
DL
I
O
DL
DW
DL
M
A
G
DL
DL
DW
E
N
TL
TL
DW
TW
D
DL
TW
DL
TW
EGILLMV

rack EGILLMV · tied moves 2

pos-420-6

6 plies · optimal 39
TW
DL
TW
DL
TW
DW
TL
C
U
L
P
A
DW
DL
DL
A
N
T
DL
DW
C
A
W
L
DL
DW
B
R
E
E
D
S
TL
O
N
TL
TL
DL
A
D
DL
T
DL
DL
TW
DL
D
S
DL
TW
DL
Z
DL
DL
DL
TL
TL
TL
TL
DW
DW
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
ACLPRUW

rack ACLPRUW · tied moves 1

pos-422-6

6 plies · optimal 22
TW
DL
TW
DL
TW
DW
TL
TL
A
L
A
DW
DL
O
R
E
G
A
N
O
DL
DW
DL
G
DL
DW
A
R
P
E
N
T
TL
TL
TL
R
TL
DL
DL
C
E
T
E
S
DL
TW
DL
E
DL
TW
DL
DL
L
DL
DL
TL
TL
TL
TL
DW
DW
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
AEIIOOR

rack AEIIOOR · tied moves 1

pos-432-6

6 plies · optimal 34
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
V
DW
DL
DW
E
TL
TL
A
X
TL
DL
DL
C
DL
P
I
DL
TW
DL
C
A
M
E
L
DL
TW
DL
A
W
DL
DL
TL
TL
T
TL
TL
DW
DW
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
EIOOOUV

rack EIOOOUV · tied moves 1

pos-452-6

6 plies · optimal 65
TW
DL
TW
B
I
T
E
DW
TL
TL
E
DW
DW
DL
DL
L
DW
DL
DW
DL
I
DL
DW
A
D
A
G
E
TL
TL
R
Z
F
TL
DL
DL
T
DL
O
S
DL
TW
DL
S
DL
TW
P
O
L
A
R
I
T
Y
DL
DL
TL
TL
TL
TL
DW
DW
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
AILOPRT

rack AILOPRT · tied moves 1

pos-464-6

6 plies · optimal 19
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
B
DL
DW
DL
DW
O
DW
TL
A
X
I
S
TL
TL
DL
L
DL
DL
DL
TW
DL
C
E
P
E
DL
TW
DL
B
I
DL
DL
DL
TL
S
A
D
TL
TL
A
R
DW
DL
U
M
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
AAIOOSU

rack AAIOOSU · tied moves 2

pos-477-6

6 plies · optimal 14
TW
DL
TW
DL
TW
DW
TL
TL
T
C
DW
DL
DL
I
DW
A
E
DL
DW
DL
R
A
T
DL
DW
B
O
W
S
TL
TL
TL
I
L
TL
DL
DL
DL
Z
DL
TW
DL
A
R
M
E
T
TW
DL
DL
DL
DL
TL
TL
TL
TL
DW
DW
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
ILRRTUU

rack ILRRTUU · tied moves 1

pos-49-6

6 plies · optimal 22
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
DW
DL
DW
DW
TL
TL
TL
TL
DL
DL
B
U
D
DL
TW
DL
R
DL
TW
DL
DL
E
DL
DL
TL
C
A
G
O
TL
DW
A
R
T
DW
DL
DW
N
H
O
O
E
Y
DL
DW
A
X
E
DL
DW
DW
L
TL
DW
TW
DL
TW
DL
TW
AEIOOTY

rack AEIOOTY · tied moves 2

pos-510-6

6 plies · optimal 38
TW
DL
TW
DL
TW
DW
TL
TL
DW
DW
DL
DL
DW
DL
DW
DL
B
O
O
B
DL
DW
I
TL
TL
TL
R
TL
DL
DL
DL
S
DL
A
L
O
F
T
A
W
A
R
E
DL
TW
DL
A
I
D
M
S
DL
TL
TL
E
TL
TL
DW
N
DW
DL
DW
DL
DW
DL
DW
DL
DL
DW
DW
TL
TL
DW
TW
DL
TW
DL
TW
AEFLOTT

rack AEFLOTT · tied moves 1