AI cost glossary.
Plain-language definitions of the terms behind your AI bill.
- AI API
- A way for software to send a request to an AI model run by a provider such as OpenAI, Anthropic or Google, and receive an answer. Providers charge for each request.
- Token
- The unit AI providers use to measure text and bill for it. A token is a small piece of a word. Longer prompts and longer answers use more tokens and cost more.
- Input tokens and output tokens
- Input tokens are the text you send to the model. Output tokens are the text it writes back. Most providers price them separately, and output tokens usually cost more.
- Prompt
- The instructions and context an app sends to an AI model with each request, such as a customer question plus guidance on how to answer.
- AI gateway
- A service that sits between your applications and AI providers. Apps send their requests to the gateway, which forwards them to the provider and records usage and cost.
- Base URL
- The web address an app uses to reach an AI provider. Switching to a gateway usually means changing this one address.
- Provider API key
- A secret code that identifies your account with an AI provider. It lets the provider charge usage to you.
- Verified savings
- The difference between what a request would have cost without optimization and what it actually cost, recorded request by request so it can be audited.