.process_mp_vocab {morphemepiece} | R Documentation |
Process a Morphemepiece Vocabulary for Tokenization
Description
Process a Morphemepiece Vocabulary for Tokenization
Usage
.process_mp_vocab(v)
## Default S3 method:
.process_mp_vocab(v)
## S3 method for class 'morphemepiece_vocabulary'
.process_mp_vocab(v)
## S3 method for class 'integer'
.process_mp_vocab(v)
## S3 method for class 'character'
.process_mp_vocab(v)
Arguments
v |
An object of class |
Value
A character vector of tokens for tokenization.
[Package morphemepiece version 1.2.3 Index]