tokenizers

swMATH16425CRANtokenizersMaRDI QIDQ28295FDOQ28295

Fast, Consistent Tokenization of Natural Language Text

Lincoln Mullen

Last update: 22 December 2022

Copyright license: MIT license, File License

Software version identifier: 0.3.0

Source code repository: https://github.com/cran/tokenizers

Cited In (13)

• tidytext
• DOLDA: a regularized supervised topic model for high-dimensional multi-class regression
• textrecipes
• deeplr
• DramaAnalysis
• rslp
• wactor
• textfeatures
• tidypmc
• pdfsearch
• proustr
• covfefe
• WhatsR

This page was built for software: tokenizers