FARMReader is timeout

Asked Jun 26 '23 at 06:00

Active Jun 26 '23 at 07:22

Viewed 43 times

It get stuck in FARMReader for long (30+ mins) and time out. Any reason?

reader = FARMReader(model_name_or_path="deepset/roberta-base-squad2",use_gpu=True)

retriever = ElasticsearchRetriever(document_store= document_store)
 
pipe = ExtractiveQAPipeline(reader, retriever)

# predict n answers
prediction = pipe.run(query=question, top_k_retriever=10, top_k_reader=3)`

I try to run it local on pycharm & farm-haystack==1.15.1 & elasticsearch-8.7.0

edited Jun 26 '23 at 07:22

Stefano Fiorucci - anakin87

3,143
7
26

asked Jun 26 '23 at 06:00

Mohamed Ahmed

Some tips and considerations: 1) Currently Haystack does not support Elasticsearch 8 2) Why don't you install the latest version of Haystack, 1.17.2? 3) Do you have any GPU? – Stefano Fiorucci - anakin87 Jun 26 '23 at 07:25
Also, please run the following tutorial in Colab: https://haystack.deepset.ai/tutorials/03_scalable_qa_system and see if it works – Stefano Fiorucci - anakin87 Jun 26 '23 at 07:27

FARMReader is timeout

0 Answers0