LLM token counter
Count text tokens with a selected tokenizer.
LLM token counter
LLM token counterの使い方
LLM token counter encodes your text with a GPT-style tokenizer and reports the number of tokens alongside the character count. Choose o200k_base or cl100k_base in the Tokenizer setting. The count covers the source text only, so chat message wrappers, images, tool definitions and provider-specific formatting can add tokens to a real request.
- Paste the source into the input editor, or load the built-in example.
- Set tokenizer.
- Run llm token counter, review the output, then use the available copy or download controls.
このツールの機能
Count text tokens with a selected tokenizer.
- Tokenizer
- o200k_base · cl100k_base
制限と処理方法
Text operations generally accept up to 2,000,000 characters. Individual parsers, generators and formulas apply additional limits shown by their controls.
入力例
Explain a complex topic using a concrete example and three practical steps.
よくある質問
What is the difference between o200k_base and cl100k_base?
They are two different tokenizer encodings, so the same text can produce different token counts. Pick the one your model uses; o200k_base is the default here. The results show the tokenizer name next to the count so you know which was applied.
Why does my API usage show more tokens than this counter?
The counter measures only the text you paste. Chat formatting, system messages, images, tool definitions and other provider-specific additions are not included, so billed usage can be higher. Also confirm which tokenizer your model actually uses.
Does the token counter also count characters?
Yes. Alongside Tokens it shows Characters, counted as Unicode code points, plus the tokenizer name. Comparing the two numbers shows how many characters each token covers on average for your language or format.
Where is my input processed?
This operation processes its source in your browser. Copy and download are explicit actions; source input is not saved in an account or history.
What are the input limits?
Text operations generally accept up to 2,000,000 characters. Individual parsers, generators and formulas apply additional limits shown by their controls.