piecemaker-package {piecemaker}R Documentation

piecemaker: Tools for Preparing Text for Tokenizers

Description

Tokenizers break text into pieces that are more usable by machine learning models. Many tokenizers share some preparation steps. This package provides those shared steps, along with a simple tokenizer.

Author(s)

Maintainer: Jon Harmon jonthegeek@gmail.com (ORCID)

Authors:

Other contributors:

See Also

Useful links:


[Package piecemaker version 1.0.2 Index]