ORBiS Tree

SEARCH · ENGLISH EDITION

Find an AI concept.

Search titles, summaries, article text, source-language titles, and known aliases.

Results for “Tokenization”
EN

BERT

Bidirectional Encoder Representations from Transformers, an encoder-based language representation model.

EN

Context Window

The amount of tokenized input and generated text a model can consider within one inference context.

EN

Embedding

A numerical vector representation used to encode semantic or structural properties of data.

EN

Tokenization

The process of converting text or other input into discrete units that a model can process.