tokenizers

swMATH16425CRANtokenizersMaRDI QIDQ28295FDOQ28295

Fast, Consistent Tokenization of Natural Language Text

Lincoln Mullen

Last update: 22 December 2022

Copyright license: MIT license, File License

Software version identifier: 0.3.0

Official website: https://cran.r-project.org/web/packages/tokenizers/index.html

Source code repository: https://github.com/cran/tokenizers

Cited In (19)

• lda
• topicmodels
• Medlda
• tidytext
• spacyr
• DOLDA: a regularized supervised topic model for high-dimensional multi-class regression
• textrecipes
• Twitmo
• TTLocVis
• deeplr
• DramaAnalysis
• rslp
• wactor
• textfeatures
• tidypmc
• pdfsearch
• proustr
• covfefe
• WhatsR

This page was built for software: tokenizers