---
metadata:
  - name: generator
    content: Diplodoc Platform v5.52.0
alternate:
  - https://catboost.ai/docs/en/concepts/output-data_frequency-based-dict.md
  - href: en/concepts/output-data_frequency-based-dict.md
    type: text/markdown
    title: Markdown version
  - href: ../llms.txt
    type: text/markdown
    title: llms.txt
---
> **Documentation Index:** Fetch the complete configuration index at https://catboost.ai/docs/en/llms.txt

# Frequency Based Dictionary

#### Contains
The trained Frequency Based Dictionary.
#### Header format

The first row in the output file contains information regarding the training parameters.

Format:

```
{"key_1":"value_1","key_2":"value_2",.., "key_N":"value_N"}
```

#### Format

The second row contains the number of tokens in the dictionary.

Each row starting from the second contains information regarding a single token.

Format:
```
<token_ID><\t><number_of_occurrences><\t><token>
```

- `token ID` — A zero-based token identifier. Tokens are sorted case sensitive ordering.

- <!-- source: en/_includes/work_src/reusage-tokenizer/number-of-occurrences-desc.md -->
  `number_of_occurrences` — The number of times that a token is found in the input text.
  <!-- endsource: en/_includes/work_src/reusage-tokenizer/number-of-occurrences-desc.md -->

- `token` — The value of the token.


#### Example

```
{"end_of_word_token_policy":"Insert","skip_step":"0","start_token_id":"0","token_level_type":"Word","dictionary_format":"id_count_token","end_of_sentence_token_policy":"Skip","gram_order":"1"}
11
0       1	How
1       1	It's
2       1	Today
3       1	and
4       1	forever
5       1	high
6       1	moon
7       1	snowing
8       1	the
9       1	today
10      1	tomorrow
```