Uses of Record Class
opennlp.dl.Tokens
Packages that use Tokens
-
Uses of Tokens in opennlp.dl
Methods in opennlp.dl that return TokensModifier and TypeMethodDescriptionprotected final TokensAbstractDL.encodeTokens(CharSequence text) Encodes text as the inputs consumed by a BERT model: the piece strings, their vocabulary ids, an attention mask of ones, and single-segment token types.