I want to use this vocab and then tokenize and normalize my text inputs. I am new to scala and hence was not able add vocab to tokenizer api. The default tokenizer works very well. How do I build custom tokenizer and normalize stages?
Asked
Active
Viewed 16 times
