← Back to glossary
Browse letter T hub
Token
A unit of text processed by a model, such as a word, subword, or punctuation mark.
Definition
A unit of text processed by a model, such as a word, subword, or punctuation mark.
How It Works
Token helps teams build predictable AI and translation workflows by setting clear expectations for quality, consistency, and decision-making.
In production environments, this concept is applied with process controls such as human review, terminology alignment, and repeatable quality checks across multilingual content.
Key Concepts
- core principle of token
- workflow-level implementation
- terminology and quality consistency
- human validation before publication
Where It Is Used
- localisation workflows
- AI translation pipelines
- multilingual content production
- cross-referencing related concepts such as Terminology Extraction