Open-source LLM observability platform and gateway for production AI applications.
- Granular token cost and latency monitoring per model
- Response caching to minimize redundant API calls
- Lightweight SDK integration for backend services
6.3kstars on GitHub