Feature Request: Simplify Integration of Litellm with OpenAI-Compatible APIs #43
Labels
C-feature-request
Category: feature request issue. Implementations of feature requests use `C-enhancement` instead.
E-easy
Effort: This is easy.
Describe the solution you'd like
Litellm is a widely used tool in the AI community that allows deploying a proxy and providing access via HTTP API. Additionally, the Litellm API is compatible with the OpenAI API protocol. It would be beneficial to simplify the process of creating a LitellmModel using the existing implementation available at:
https://github.com/cloudwego/eino-ext/tree/main/libs/acl/openai.
Additional Context:
litellm proxy doc: https://docs.litellm.ai/docs/simple_proxy
litellm api: https://litellm-api.up.railway.app/#/
The text was updated successfully, but these errors were encountered: