I am trying to calculate the time it would take to train a Distill GPT2 model on BookCorpus dataset using multiple EC2 instances for the purpose of language modeling.
What is the method for calculating training time of language models?
Asked
Active
Viewed 49 times
