01.03
One token at a time
Models generate one token at a time by predicting the next one, and how text, images, and audio are turned into tokens is what decides the bill.
- Making AI Product Decisions
- 12 min
- Free
Who's hiring for this skill
17 companies have live AI-PM roles that ask for skills taught in this lesson.
- Glean
- Nebius
- Anthropic
- Okta
- Fireworks
- Mistral
- Scale AI
- Coursera
- Harvey
- Deepgram
- 1Password
- Eve
- Klaviyo
- LangChain
- Luma AI
- Plaid
- Rogo
Concepts in this subchapter
- Token
- Tokenizer
- Transformer
- Inference
- Multimodal Model
- Cost per Token
- Large Language Model
- Foundation Model
- Training Data
Source video: Let's build the GPT Tokenizer, Andrej Karpathy.