Is there an open-source generative question-answering model on huggingface where we can provide a large document as KB (Knowledge Base) such that given a question related to that KB, the model outputs a relevant answer?
Asked
Active
Viewed 166 times
1
-
Define large. The [EleutherAI](https://huggingface.co/EleutherAI/gpt-j-6B) models are able to process up to 2048 tokens. – cronoik Mar 10 '23 at 20:09
-
Is the length of the Knowledge base bound by max token length supported? I was under the impression that only question length is bounded by token length. Please correct me if I am wrong. Thank you. – user3303020 Mar 21 '23 at 01:41
-
1All of your input and the generated output need to be smaller than the supported max_length of the model. – cronoik Mar 22 '23 at 04:04