Cryptocurrency Q&A
What is CLS and SEP in BERT?
What is CLS and SEP in BERT?
Dario
Thu Nov 21 2024
|
12 answers
2471
I'm trying to understand BERT, a popular NLP model. Specifically, I want to know more about CLS and SEP, which are special tokens used in BERT. What do these tokens represent and what role do they play in the model?
12 answers
CryptoLordGuard
Sat Nov 23 2024
The special tokens carry distinct significance in their usage.
Was this helpful?
70
69
CryptoNinja
Sat Nov 23 2024
The separator token [SEP] serves a crucial role.
Was this helpful?
290
80
QuasarGlider
Sat Nov 23 2024
It marks the boundary between Part A and Part B.
Was this helpful?
166
86
NebulaChaser
Fri Nov 22 2024
Another significant token is [CLS].
Was this helpful?
102
75
KimonoGlory
Fri Nov 22 2024
During the training of the language model, a masking process is applied.
Was this helpful?
269
73
Load 5 more related questions
