You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hello everyone. When running the facebook_opt-66b GPT model, I encountered the following error:
ValueError: The current device_map had weights offloaded to the disk. Please provide an offload_folder for them. Alternatively, make sure you have safetensors installed if the model you are using offers the weights in this format.
A search of the topics on the forum did not give much result... Because in each of the topics it is suggested either to look at the answers in https://huggingface.co/blog/accelerate-large-models or to add lines of code in .py files... but the problem is that I just do not know where and what code to add... Therefore, if someone writes a step-by-step description of how to fix this problem, I will be very grateful!!!
The text was updated successfully, but these errors were encountered:
Hello everyone. When running the facebook_opt-66b GPT model, I encountered the following error:
ValueError: The current
device_map
had weights offloaded to the disk. Please provide anoffload_folder
for them. Alternatively, make sure you havesafetensors
installed if the model you are using offers the weights in this format.A search of the topics on the forum did not give much result... Because in each of the topics it is suggested either to look at the answers in https://huggingface.co/blog/accelerate-large-models or to add lines of code in .py files... but the problem is that I just do not know where and what code to add... Therefore, if someone writes a step-by-step description of how to fix this problem, I will be very grateful!!!
The text was updated successfully, but these errors were encountered: