Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[07/01/2024 - 14/01/2024] New Models/Endpoints/Providers/Improvements #1362

Closed
6 of 9 tasks
krrishdholakia opened this issue Jan 8, 2024 · 7 comments
Closed
6 of 9 tasks

[07/01/2024 - 14/01/2024] New Models/Endpoints/Providers/Improvements #1362

krrishdholakia opened this issue Jan 8, 2024 · 7 comments

Comments

@krrishdholakia
Copy link
Contributor

krrishdholakia commented Jan 8, 2024 •
edited
Loading

@krrishdholakia krrishdholakia pinned this issue Jan 8, 2024
@krrishdholakia
Copy link
Contributor Author

krrishdholakia commented Jan 8, 2024 •
edited
Loading

Known Backlog:

  1. OpenMeter spend tracking support - [Feature]: Add openmeter support for spend tracking across llm providers #1268
  2. tracking - [Feature]: Support AirLLM #997
  3. tracking - [Feature]: Integrate with mlx #1188 cc: @r1cc4rd0m4zz4
  4. tracking - [Feature]: Support exllama v2  #1192
  5. yandexgpt support requested by 2 users - [Feature]: Add support for YandexGPT  #1254
  6. Aphrodite engine endpoint - https://github.com/PygmalionAI/aphrodite-engine, feat: add aphrodite support #1153
  7. TheBloke/NexusRaven-V2-13B-GGUF function calling support [Feature]: Support Nexusflow/NexusRaven-V2-13B function calling  #1060 cc: @homanp
  8. Predibase lorax support - [Feature]: Add support for Predibase Lorax apis [Feature]: Add support for Predibase Lorax apis  #1253
  9. Deepsparse CPU inference support - docker access denied error neuralmagic/deepsparse#1452
  10. Gemini Pro - VertexAI function calling when streaming support - [Feature]: Support vertex ai function calling w/ streaming #1263
  11. Consistent format for model prices and context window - [Feature]: Consistent format for model_prices_and_context_window file  #1375

@krrishdholakia
Copy link
Contributor Author

Initial pr for expanded time window for latency based routing made - https://github.com/BerriAI/litellm/pulls

@krrishdholakia
Copy link
Contributor Author

Tracking - #1373

@krrishdholakia
Copy link
Contributor Author

Tracking - #1374

@krrishdholakia
Copy link
Contributor Author

PR for DynamoDB support made - #1382

Pending additional testing before merging

@krrishdholakia
Copy link
Contributor Author

PR for bumping httpx pool limits (solves high-traffic timeout issue) - #1415

@ishaan-jaff ishaan-jaff unpinned this issue Jan 22, 2024
@ishaan-jaff
Copy link
Contributor

closing

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@krrishdholakia @ishaan-jaff