Token
The fundamental unit of text processing in LLMs, typically representing a word, part of a word, or punctuation mark.
Why Token matters
Understanding token economics helps optimize content for AI consumption and manage API costs when deploying AI agents at scale.
Token in context
As AI-powered discovery replaces traditional search, understanding Token is a core competency for modern brands. It sits in the AI & GenAI family of concepts and directly influences how language models like ChatGPT, Gemini, Claude, and Perplexity surface, cite, and recommend brands.
Related Terms
Large Language Model (LLM)
A neural network trained on massive text datasets to understand and generate human-like language, powering tools like ChatGPT, Claude, and Gemini.
Generative AI (GenAI)
AI systems that create new content - text, images, video, code - by learning patterns from training data rather than following explicit rules.
Prompt Engineering
The art and science of crafting instructions to AI models that consistently produce desired outputs through careful wording, context, and examples.