How do I implement a knowledge base in a Huggingface model?

Question

I made a knowledge base using COMET on the Atomic knowledge graph, using this tutorial.

I would like to include this knowledge in a regular pre-trained BERT model from HuggingFace to see how the model with access to this knowledge performs on a different task (sentiment analysis).

I saved the generated tuples from COMET in a pickle file.

Thanks!