Skip to content

Add support for other LLMs #7

Description

@AlexIchenskiy

The main idea is to enhance ODIN's flexibility by adding support for any other models supported by LangChain. These models are listed here.

To achieve this, modifications need to be made in the QueryAgents.py and TextAnalizer.py files in the BOR project to allow users to change the model used. Furthermore, environment variables for Docker, Docker Compose, and Python should be modified to allow users to provide specific keys for other models. For instance, configuration for Azure would look like:

OPENAI_API_TYPE=azure
OPENAI_API_BASE=https://<your-endpoint.openai.azure.com>/
OPENAI_API_KEY=your_AzureOpenAI_key
OPENAI_API_VERSION=2023-05-15

While implementing this feature, thorough testing is crucial, despite the current instability of ODIN. This enhancement will significantly increase ODIN's flexibility and user-friendliness.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions