Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🚀 Feature Allow our AI's to eat images. #1451

Open
1 task done
fadingNA opened this issue Nov 23, 2024 · 1 comment
Open
1 task done

🚀 Feature Allow our AI's to eat images. #1451

fadingNA opened this issue Nov 23, 2024 · 1 comment
Assignees
Labels
application Application backend enhancement New feature or request help wanted Extra attention is needed python Pull requests that update Python code

Comments

@fadingNA
Copy link
Contributor

🔖 Feature description

@dartpain Basically allow our AI's to eat images. good place to start is just open ai llms, even docsgpt free service should work

🎤 Why is this feature needed ?

Accept image and encoded base64

  • Maybe user wants to send a message with an image when chatting with AI

✌️ How do you aim to achieve this?

  • When a source has an image, for example there is a link (publicly accessible) in markdown file that was ingested, we can pass it to llm inside classic rag retriever when its generating an answer.

🔄️ Additional Information

No response

👀 Have you spent some time to check if this feature request has been raised before?

  • I checked and didn't find similar issue

Are you willing to submit PR?

Yes I am willing to submit a PR!

@fadingNA
Copy link
Contributor Author

@dartpain

@dartpain dartpain moved this to In Progress in DocsGPT Roadmap Dec 22, 2024
@dartpain dartpain added enhancement New feature or request help wanted Extra attention is needed python Pull requests that update Python code application Application backend labels Dec 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
application Application backend enhancement New feature or request help wanted Extra attention is needed python Pull requests that update Python code
Projects
Status: In Progress
Development

No branches or pull requests

2 participants