serialize_tokens {quanteda} | R Documentation |
Function to serialize list-of-character tokens
Description
Creates a serialized object of tokens, called by tokens()
.
Usage
serialize_tokens(x, types_reserved = NULL, ...)
Arguments
x |
a list of character vectors |
types_reserved |
optional pre-existing types for mapping of tokens |
... |
additional arguments |
Value
a list the serialized tokens found in each text
[Package quanteda version 4.3.0 Index]