Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update the GGUF usage with llama.cpp doc page #1277

Closed
julien-c opened this issue Apr 26, 2024 · 6 comments
Closed

Update the GGUF usage with llama.cpp doc page #1277

julien-c opened this issue Apr 26, 2024 · 6 comments
Labels
good first issue Good for newcomers

Comments

@julien-c
Copy link
Member

there's now way cleaner syntax than https://huggingface.co/docs/hub/en/gguf-llamacpp to load a model from HF in llama.cpp

@julien-c julien-c added the good first issue Good for newcomers label Apr 26, 2024
@cakiki
Copy link
Contributor

cakiki commented Jul 1, 2024

This is resolved by #1280 right?

@julien-c
Copy link
Member Author

julien-c commented Jul 2, 2024

hmm no only partly i think

https://huggingface.co/docs/hub/en/gguf-llamacpp is still sub-optimal imo.

cc @Vaibhavs10, and also cc @ngxson who opened huggingface/huggingface.js#778 which is the same command(s) but "in-product" (on the Hub) vs. in a doc

@Vaibhavs10
Copy link
Member

Good catch, will open a PR today to update and ask for everyone's reviews! 👍

@Vaibhavs10
Copy link
Member

Opened a PR to discuss: #1326

cc: @ngxson - I wasn't able to add you as a reviewer, but please feel free to review

@cakiki
Copy link
Contributor

cakiki commented Sep 18, 2024

@julien-c now it can be closed I guess 😺

@julien-c
Copy link
Member Author

yes we can close but @Vaibhavs10 @ngxson i would still add how to install (recommend brew etc) to that doc page WDYT?

Closing in the meantime

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
good first issue Good for newcomers
Projects
None yet
Development

No branches or pull requests

3 participants