1

I fine-tuned a bert (or roberta) model for sequence classification. Can I fine-tune the same model for a different task (QA or Sentiment Analysis)?

Nilou
  • 145
  • 2
  • 10
  • Sure, but you will need to add another head and your model will (start to) forget what it has learned for sequence classification. An alternative is a multitask learning approach. – cronoik Feb 15 '21 at 08:45

0 Answers0