Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Does it work with other LLM models: Claude/anthropic #12

Open
mahamatnoumai opened this issue Sep 24, 2024 · 1 comment
Open

Does it work with other LLM models: Claude/anthropic #12

mahamatnoumai opened this issue Sep 24, 2024 · 1 comment

Comments

@mahamatnoumai
Copy link

Hi there,

I found your llmgraph looks interesting, I would like to use it, just wondering if it would work with other LLM models beside current defauts one.

I am trying to test it using CLAUDE google LLM model.

Thank you

@dylanhogg
Copy link
Owner

You can specify a different LLM provider, including running with a local https://github.com/jmorganca/ollama model.

You should be able to specify (via the --llm-model argument, see docs here) anything supported by LiteLLM as described here: https://docs.litellm.ai/docs/providers

You'll find Claude models under the Anthropic provider: https://docs.litellm.ai/docs/providers/anthropic

Note that the prompts to extract related entities were tested with OpenAI and may not work as well with other models.

Thanks for your interest in the project.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants