piecemaker (Q111109): Difference between revisions

← Older edit

@@ Property / programmed in @@
-R
@@ Property / programmed in: R / rank @@
-Normal rank
@@ Property / last update @@
-March 2022Timestamp +2022-03-03T00:00:00Z
Timezone +00:00
Calendar Gregorian
Precision 1 day
Before 0
After 0
-Timestamp
++2022-03-03T00:00:00Z
-Timezone
++00:00
-Calendar
+Gregorian
-Precision
+day
 Before
 After
@@ Property / last update: 3 March 2022 / rank @@
-Normal rank
@@ Property / author @@
-Jon Harmon
@@ Property / author: Jon Harmon / rank @@
-Normal rank
@@ Property / author @@
-Jonathan Bratt
@@ Property / author: Jonathan Bratt / rank @@
-Normal rank
@@ Property / copyright license @@
-Apache License
@@ Property / copyright license: Apache License / rank @@
-Normal rank
@@ Property / copyright license: Apache License / qualifier @@
-edition/version: ≥ 2 (English)
@@ Property / depends on software @@
-R
@@ Property / depends on software: R / rank @@
-Normal rank
@@ Property / depends on software: R / qualifier @@
-software version identifier: ≥ 2.10
@@ Property / imports @@
-rlang
@@ Property / imports: rlang / rank @@
-Normal rank
@@ Property / imports: rlang / qualifier @@
-software version identifier: ≥ 0.4.2
@@ Property / imports @@
-stringi
@@ Property / imports: stringi / rank @@
-Normal rank
@@ Property / imports @@
-stringr
@@ Property / imports: stringr / rank @@
-Normal rank
@@ Property / software version identifier @@
+.0.0
@@ Property / software version identifier: 1.0.0 / rank @@
+Normal rank
@@ Property / software version identifier: 1.0.0 / qualifier @@
+publication date: 6 August 2021Timestamp +2021-08-06T00:00:00Z
Timezone +00:00
Calendar Gregorian
Precision 1 day
Before 0
After 0
-Timestamp
++2021-08-06T00:00:00Z
-Timezone
++00:00
-Calendar
+Gregorian
-Precision
+day
 Before
 After
@@ Property / software version identifier @@
+.0.2
@@ Property / software version identifier: 1.0.2 / rank @@
+Normal rank
@@ Property / software version identifier: 1.0.2 / qualifier @@
+publication date: 2 June 2023Timestamp +2023-06-02T00:00:00Z
Timezone +00:00
Calendar Gregorian
Precision 1 day
Before 0
After 0
-Timestamp
++2023-06-02T00:00:00Z
-Timezone
++00:00
-Calendar
+Gregorian
-Precision
+day
 Before
 After
@@ Property / programmed in @@
+R
@@ Property / programmed in: R / rank @@
+Normal rank
@@ Property / last update @@
+June 2023Timestamp +2023-06-02T00:00:00Z
Timezone +00:00
Calendar Gregorian
Precision 1 day
Before 0
After 0
-Timestamp
++2023-06-02T00:00:00Z
-Timezone
++00:00
-Calendar
+Gregorian
-Precision
+day
 Before
 After
@@ Property / last update: 2 June 2023 / rank @@
+Normal rank
@@ Property / description @@
+Tokenizers break text into pieces that are more usable by    machine learning models. Many tokenizers share some preparation steps.    This package provides those shared steps, along with a simple    tokenizer.
+Normal rank
@@ Property / author @@
+Jon Harmon
@@ Property / author: Jon Harmon / rank @@
+Normal rank
@@ Property / author @@
+Jonathan Bratt
@@ Property / author: Jonathan Bratt / rank @@
+Normal rank
@@ Property / copyright license @@
+Apache License
@@ Property / copyright license: Apache License / rank @@
+Normal rank
@@ Property / copyright license: Apache License / qualifier @@
+edition/version: ≥ 2 (English)
@@ Property / depends on software @@
+R
@@ Property / depends on software: R / rank @@
+Normal rank
@@ Property / depends on software: R / qualifier @@
+software version identifier: ≥ 2.10
@@ Property / imports @@
+cli
@@ Property / imports: cli / rank @@
+Normal rank
@@ Property / imports @@
+glue
@@ Property / imports: glue / rank @@
+Normal rank
@@ Property / imports @@
+rlang
@@ Property / imports: rlang / rank @@
+Normal rank
@@ Property / imports: rlang / qualifier @@
+software version identifier: ≥ 0.4.2
@@ Property / imports @@
+stringi
@@ Property / imports: stringi / rank @@
+Normal rank
@@ Property / imports @@
+stringr
@@ Property / imports: stringr / rank @@
+Normal rank
@@ Property / MaRDI profile type @@
+MaRDI software profile
@@ Property / MaRDI profile type: MaRDI software profile / rank @@
+Normal rank
@@ links / mardi / name / links / mardi / name @@
+Software:111109

Latest revision as of 18:56, 12 March 2024

Tools for Preparing Text for Tokenizers

Language	Label	Description	Also known as
English	piecemaker	Tools for Preparing Text for Tokenizers

Statements

instance of

R package

0 references

software version identifier

1.0.1

publication date

3 March 2022

0 references

1.0.0

publication date

6 August 2021

0 references

1.0.2

publication date

2 June 2023

0 references

0 references

0 references

2 June 2023

0 references

description

Tokenizers break text into pieces that are more usable by machine learning models. Many tokenizers share some preparation steps. This package provides those shared steps, along with a simple tokenizer.

0 references

0 references

0 references

≥ 2 (English)

0 references

depends on software