Skip to content

agynio/token-counting

Repository files navigation

Token Counting Service

The Token Counting service provides per-message token counts for LLM messages.

Architecture: Token Counting

Local Development

Full setup: Local Development

Prepare environment

git clone https://github.com/agynio/bootstrap.git
cd bootstrap
chmod +x apply.sh
./apply.sh -y

See bootstrap for details.

Run from sources

# Deploy once (exit when healthy)
devspace dev

# Watch mode (streams logs, re-syncs on changes)
devspace dev -w

Run tests

devspace run test:e2e

See E2E Testing.

About

Token counting gRPC service for the Agyn platform

Resources

License

Stars

Watchers

Forks

Packages

 
 
 

Contributors