Questions tagged [huggingface-hub]

22 questions
0
votes
0 answers

Tokenizer won't load from Huggingface hub

from transformers import AutoConfig, AutoTokenizer, AutoModelForSequenceClassification, AutoModelForCausalLM, AutoModelForSeq2SeqLM from transformers import GPT2Tokenizer tok1 =…
user67275
  • 1
  • 9
  • 38
  • 64
0
votes
0 answers

Why Seq2SeqTrainer does not have a predict_dataset argument?

I am using Seq2SeqTrainer for my experiments. But it only takes train_dataset & eval_dataset. To only do prediction without calculating eval metrics, how can I input predict_datadset (test data) ?
0
votes
1 answer

Download huggingface table / DataFrame?

I was looking at: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard It's a valuable data table and I wanted to download it in a machine readable format. There is no static file that is rendered out of the repo, but app.py is executed…
miku
  • 181,842
  • 47
  • 306
  • 310
0
votes
1 answer

How can I use/load the downloaded Hugging Face models from snapshot_download?

I have downloaded the model from Hugging Face using snapshot_download, e.g., from huggingface_hub import snapshot_download snapshot_download(repo_id="facebook/nllb-200-distilled-600M", cache_dir="./") And when I list the directory, I see: ls…
0
votes
0 answers

Custom python package: No matching distribution found for huggingface-hub>=0.4.0

I am creating a simple python package with the setup.py file that looks like this: setup( name="foo", version="0.692", description="A nice package", author="foo", license="MIT", long_description=README, …
0
votes
3 answers

Sentence Transformers no more on HuggingFace?

I'm trying to download Sentence Transformer but they seem to have been wiped from HuggingFace. Does anyone know why ? https://huggingface.co/sentence-transformers
0
votes
1 answer

Couldn't find 'my_dataset' on the Hugging Face Hub

I was following this huggingface tutorial on uploading my dataset (a json file) to the Hub. In the link they mention: or text data extensions like .csv, .json, .jsonl, and .txt, we recommend compressing them before uploading to the Hub (to .zip or…
Penguin
  • 1,923
  • 3
  • 21
  • 51
1
2