tokenizers (Q28295): Difference between revisions

From MaRDI portal
Created claim: source code repository (P339): https://github.com/cran/tokenizers, #quickstatements; #temporary_batch_1711027662947
Swh import (talk | contribs)
SWHID from Software Heritage
 
Property / Software Heritage ID
 
Property / Software Heritage ID: swh:1:snp:43004e785899e4f9e8e106a61765668d8b880d29 / rank
 
Normal rank
Property / Software Heritage ID: swh:1:snp:43004e785899e4f9e8e106a61765668d8b880d29 / qualifier
 
Property / Software Heritage ID: swh:1:snp:43004e785899e4f9e8e106a61765668d8b880d29 / qualifier
 
point in time: 10 January 2023
Timestamp+2023-01-10T00:00:00Z
Timezone+00:00
CalendarGregorian
Precision1 day
Before0
After0

Latest revision as of 18:15, 21 March 2024

Fast, Consistent Tokenization of Natural Language Text
Language Label Description Also known as
English
tokenizers
Fast, Consistent Tokenization of Natural Language Text

    Statements

    Identifiers