✂️

Language models

Tokenizer

Type any text and see how a language model chops it into tokens.

Used in the lesson✂️ Tokens: how AI reads text · Large Language Models

🌌Word galaxy (embeddings)🔦Attention visualizer 🔮Next-word predictor