Skip to content

Issues: foundation-model-stack/fms-fsdp

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

14 Open 21 Closed
14 Open 21 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Dataset format restrictions
#124 opened Dec 19, 2024 by 401qingkong
Support for loading arbitrary huggingface models (llama, mixtral, gpt_bigcode) for speculative training enhancement New feature or request
#117 opened Sep 25, 2024 by JRosenkranz
Support for chat templates in speculative training enhancement New feature or request
#116 opened Sep 25, 2024 by JRosenkranz
out-of-memory when specu-training a llama2-13b model
#113 opened Aug 28, 2024 by YunChen1227
1
tokenization on-the-fly for long documents
#106 opened Jul 31, 2024 by dangxuanhong
@daviswer
2
FMS-FSDP running on A100 8GPU machine failed with NCCL error messages
#94 opened Jun 11, 2024 by htang2012
The default model variant is 7b but it is not supported.
#93 opened Jun 11, 2024 by htang2012
2
Repeatability of Small Model Training Script with fixed seed(s) and same dataset
#92 opened Jun 6, 2024 by pad9153
@daviswer @lchu6
1
A revisit on improving the performance of Data Loader
#70 opened Apr 5, 2024 by lchu6
2
[speculator training] Support for loading different HF checkpoints for speculator training speculator training
#66 opened Mar 28, 2024 by pavi2707
1
A write-up on Meta Device Init x Pretraining
#64 opened Mar 26, 2024 by lchu6
@lchu6
maximize mistral throughput
#63 opened Mar 25, 2024 by aldopareja
2
revert "raise Dynamo accumulated cache size limit"
#53 opened Mar 19, 2024 by lchu6
@lchu6
add FLOP counter enhancement New feature or request
#29 opened Feb 23, 2024 by lchu6
@lchu6
ProTip! Find all open issues with in progress development work with linked:pr.