ThunderAgent-org
Popular repositories Loading
-
ThunderAgent
ThunderAgent PublicA simple, fast and robust program-aware agentic inference system.
-
smg
smg PublicForked from smg-project/smg
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat histor…
Rust
Repositories
Showing 2 of 2 repositories
- smg Public Forked from smg-project/smg
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
Top languages
Loading…
Most used topics
Loading…