CSM_tokenizer / vocab.txt
lhallee's picture
Upload tokenizer
35384a1 verified
raw
history blame contribute delete
356 Bytes
<cls>
<pad>
<eos>
<unk>
<mask>
[L]
[A]
[G]
[V]
[S]
[E]
[R]
[T]
[I]
[D]
[P]
[K]
[Q]
[N]
[F]
[Y]
[M]
[H]
[W]
[C]
[X]
[B]
[U]
[Z]
[O]
[*]
a
A
@
b
B
#
$
%
r
R
n
N
d
D
c
C
e
E
q
Q
^
G
&
g
h
H
i
I
j
+
M
m
l
J
L
k
K
(
f
F
p
P
o
O
=
s
z
Z
w
S
X
T
t
x
W
y
Y
u
v
U
V
]
}
)