tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.

★ 19,424 stars, verified 2026-10-10Category: AI Agents & LLM PlatformsGitHub repository ↗

tiktoken is a fast BPE tokeniser for use with OpenAI's models.

Frameworks and platforms for building autonomous AI agents and LLM apps.

Similar open-source projects

superpowers

★ 294,114

An agentic skills framework & software development methodology that works.

AI Agents & LLM PlatformsGitHub ↗

skills

★ 274,171

Skills for Real Engineers. Straight from my .agents directory.

AI Agents & LLM PlatformsGitHub ↗