Questions tagged [roberta-language-model]
64 questions
0
votes
1 answer
Error Running "config = RobertaConfig.from_pretrained( "/Absolute-path-to/BERTweet_base_transformers/config.json""
I'm trying to run the code 'transformers' version of this code to use the new pre-trained BERTweet model and I'm getting an error.
The following lines of code ran successfully in my Google Colab notebook:
!pip install fairseq
import fairseq
!pip…
code_to_joy
- 569
- 1
- 9
- 27
-1
votes
1 answer
RuntimeError: Expected target size [32, 2], got [32]
i am traing to buld bert model text clasifiction by using bert and distilbert and roberta in the same time.
this is model arch
class BERT_Arch(nn.Module):
def __init__(self, bert):
super(BERT_Arch, self).__init__()
self.bert = bert
…
-1
votes
2 answers
FileNotFound error downloading roberta-model sentence transformers
I've already downloaded the "roberta-large-nli-stsb-mean-tokens" model, but it starts downloading again and again.
Note: This is not related to space, the machine has space.
And this error comes...FileNotFoundError
from sentence_transformers import…
Arjit Yadav
- 1
- 2
-2
votes
0 answers
RuntimeError: element 0 of tensors does not require grad and does not have a grad_fn with roberta model
i am trying fiting this model
class FakeNews_Classifier(pl.LightningModule):
def __init__(self, config: dict):
super().__init__()
self.config = config
self.pretrained_model = AutoModel.from_pretrained(config['model_name'], return_dict…