Package index

All functions

as_tokens()

Create a list of tokens

create_tagger()

Create a tagger function

get_dict_features()

Get dictionary features

is_blank()

Check if scalars are blank

ngram_tokenizer()

Ngrams tokenizer

pack()

Pack a data.frame of tokens

prettify()

Prettify tokenized output

tokenize()

Tokenize sentences using a tagger