Questions tagged [safe-tensors]
5 questions
1
vote
0 answers
Loading a safetensors format model using Hugging Face Transformers
I try to load the 'notstoic/pygmalion-13b-4bit-128g' model using Hugging Face's Transformers library. I am encountering an issue when trying to load the model, which is saved in the new safetensors format.
Here's the code I'm using:
from…

Max Hager
- 536
- 4
- 13
0
votes
1 answer
Unable to download Huggingface API Transformers
After downloading tensorflow and PyTorch, and running pip install -q transformers, I get this error:
ERROR: Failed building wheel for safetensors
ERROR: Could not build wheels for safetensors, which is required to install pyproject.toml-based…

eklavyaisabird
- 25
- 1
- 1
- 5
0
votes
0 answers
facing OS error trying to download the model in openLLM
I am trying to run the openLLM but i am facing this error.
I ran 3 commands.
!pip3 install openllm
!openllm -h
!openllm start opt
but the 3rd commands output is generating this error
OSError: model.safetensors or model.safetensors.index.json and…

mirdul agarwal
- 9
- 1
0
votes
1 answer
Error in deploy LLM model in sagemaker endpoint. pls provide the solution any one known
#033[2m2023-07-31T06:58:11.298494Z#033[0m #033[31mERROR#033[0m #033[2mtext_generation_launcher#033[0m#033[2m:#033[0m Download encountered an error: Traceback (most recent call last):
File "/opt/conda/bin/text-generation-server", line 8, in…
-1
votes
0 answers
loading stable diffusion model: JSONDecodeError
I'm getting an error when starting sd-webui
Python 3.10.6 (tags/v3.10.6:9c7b4bd, Aug 1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)]
Version: v1.4.1
Commit hash: f865d3e11647dfd6c7b2cdf90dde24680e58acd8
Installing requirements
Launching Web UI with…

Aurangzeb
- 1,537
- 13
- 9