Parameter to determine number of tokens in ngram

Source: R/param_num_tokens.R

Used in textrecipes::step_ngram().

num_tokens(range = c(1, 3), trans = NULL)

Arguments

range

A two-element vector holding the defaults for the smallest and largest possible values, respectively.
trans

A trans object from the scales package, such as scales::log10_trans() or scales::reciprocal_trans(). If not provided, the default is used which matches the units used in range. If no transformation, NULL.

Examples

num_tokens()

#> Number of tokens (quantitative)
#> Range: [1, 3]