Questions tagged [1.3b]

When I try to use DeepSpeed example to finetune a OPT 1.3b model on my local machine, I have an unexpected error, which related to following code snippet: template __global__ void moe_res_matmul(T* residual, T* coef, T* mlp_out, int…