Questions tagged [safe-tensors]

5 questions
1
vote
0 answers

Loading a safetensors format model using Hugging Face Transformers

I try to load the 'notstoic/pygmalion-13b-4bit-128g' model using Hugging Face's Transformers library. I am encountering an issue when trying to load the model, which is saved in the new safetensors format. Here's the code I'm using: from…
0
votes
1 answer

Unable to download Huggingface API Transformers

After downloading tensorflow and PyTorch, and running pip install -q transformers, I get this error: ERROR: Failed building wheel for safetensors ERROR: Could not build wheels for safetensors, which is required to install pyproject.toml-based…
0
votes
0 answers

facing OS error trying to download the model in openLLM

I am trying to run the openLLM but i am facing this error. I ran 3 commands. !pip3 install openllm !openllm -h !openllm start opt but the 3rd commands output is generating this error OSError: model.safetensors or model.safetensors.index.json and…
0
votes
1 answer

Error in deploy LLM model in sagemaker endpoint. pls provide the solution any one known

#033[2m2023-07-31T06:58:11.298494Z#033[0m #033[31mERROR#033[0m #033[2mtext_generation_launcher#033[0m#033[2m:#033[0m Download encountered an error: Traceback (most recent call last): File "/opt/conda/bin/text-generation-server", line 8, in…
-1
votes
0 answers

loading stable diffusion model: JSONDecodeError

I'm getting an error when starting sd-webui Python 3.10.6 (tags/v3.10.6:9c7b4bd, Aug 1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)] Version: v1.4.1 Commit hash: f865d3e11647dfd6c7b2cdf90dde24680e58acd8 Installing requirements Launching Web UI with…
Aurangzeb
  • 1,537
  • 13
  • 9