end_of_sentence_token_id
Get the identifier of the last token in the sentence.
Method call format
end_of_sentence_token_id()
Type of return value
int
Example
from catboost.text_processing import Dictionary
dictionary = Dictionary(occurence_lower_bound=0)\
.fit(["his", "tender", "heir", "whatever"])
print(dictionary.end_of_sentence_token_id)
Output:
5