sentencepiece (Q89656)
From MaRDI portal
Text Tokenization using Byte Pair Encoding and Unigram Modelling
| Language | Label | Description | Also known as |
|---|---|---|---|
| English | sentencepiece |
Text Tokenization using Byte Pair Encoding and Unigram Modelling |
Statements
13 November 2022
0 references
