AI Dev Impact Lab JA
← Topics ranking · 2026-11
GITHUB TOPIC

#llm-tokenizer

GitHub repositories that have self-applied the topic "llm-tokenizer" — a creator-tagged metadata that surfaces how AI projects describe themselves.

1
tagged repos
0
top 1 stars
0
with tool sigs
1
shown

REPOS Repos for #llm-tokenizer (top 1 by stars)

s3bastiankoch/tiktoken-fast

Drop-in replacement for OpenAI's tiktoken in Python, JavaScript and Go, plus a Rust crate. Same token ids, 3 to 11x faster.

Rust ★ 0 AI 60

RELATED Other topics · full topics ranking →

#claude-code

3,787

#ai-agents

3,201

#llm

2,090

#mcp

1,866

#claude

1,854

#python

1,678

#developer-tools

1,530

#codex

1,376

#ai

1,181

Aggregated by case-insensitive match against topics_json of each repo's latest content snapshot. methodology