Show HN: Agentpanel – Universal LLM API Written in Rust

github.com

9 points by hackintoshrao 2 years ago

Agentpanel is an observability platform for optimizing the control flow, performance, token usage, and correctness of LLM/AI agents!

Built-in @rustlang, the first release of Agent Panel currently features an AI gateway that provides seamless access to 100+ LLMs across 20+ platforms, including OpenAI GPT-4o, Gemini 1.5 Pro latest, AnthropicAI Claude 3.5, MistralAI, Cohere, Groq,Perplexity AI, and more.

hamasho 2 years ago

Interesting! And it looks much sane compared to LangChain.

Question: do almost all LLM APIs have the same roles "user", "assistant", and "system"?

  • hackintoshrao 2 years ago

    Thank you. Yes, almost all LLM APIs have the same roles. Let me know your thoughts once you try the project.

    • mathnmusic 2 years ago

      Gemini models don't have "system" roles.