Questions tagged [haystack]

Use this tag for questions related to Haystack NLP framework.

Haystack is an end-to-end open source framework for creating NLP powered search systems. The pipelines that you create with it are customizable, production ready and well integrated with cutting edge projects like HuggingFace, Milvus and Elasticsearch. On top of keyword search, Haystack provides all the tools necessary to perform tasks like question answering or semantic document search so that your users can start querying in natural language.

To learn more about the framework follow the documentation link, or have a look at the GitHub repository.

46 questions
1
vote
1 answer

Deepset Haystack Secure Connection to Elasticsearch

I am trying to create a Haystack document store with Elasticsearch (run on Docker with security) but I am getting the following errors. I know I need to tell Haystack to use https but I couldn't find a how in the docs. I did try specifying port…
eboraks
  • 167
  • 1
  • 9
1
vote
1 answer

What might cause a memory error in haystack search when tried in python flask application?

I have indexed around 1000 document in elastic search. When I try to query with haystack search it returns files as output but after continuously using for 5 times memory error occurs. and the execution of program stops. I have attached the code…
1
vote
1 answer

Installing from github (with extras) via a requirements.txt file

I am trying to add the Haystack library as a dependency of a python project. The installation instructions that Haystack provides are as follows git clone https://github.com/deepset-ai/haystack.git cd haystack pip install -e .[all] I am trying to…
1
vote
0 answers

How should i implement tagging module with help of haystack open source library

I have haystack library in place. Now i want to do Auto tagging for all the tags which are mentioned for particular entity on haystack.org. Means whenever that entity will populate all associated tags should get applied to it.
1
vote
2 answers

ValueError: You must include at least one label and at least one sequence

I'm using this Notebook, where section Apply DocumentClassifier is altered as below. Jupyter Labs, kernel: conda_mxnet_latest_p37. Error appears to be an ML standard practice response. However, I pass/ create the same parameter and the variable…
StressedBoi69420
  • 1,376
  • 1
  • 12
  • 40
1
vote
1 answer

How do I compute and add meta data to an existing Elasticsearch index?

I loaded over 38 million documents (text strings) to an Elasticsearch index on my local machine. I would like to compute the length of each string and add that value as meta data in the index. Should I have computed the string lengths as meta data…
1
vote
1 answer

ImportError: cannot import name 'BigBirdTokenizer' from 'transformers' (/usr/local/lib/python3.7/dist-packages/transformers/__init__.py)

In my env(colab) I need the following library. Here is the list : !pip install --quiet transformers==4.1.1 !pip install --quiet pytorch-lightning==1.1.3 #!pip install pytorch-lightning !pip install --quiet tokenizers==0.9.4 !pip install --quiet…
Sht
  • 179
  • 1
  • 1
  • 9
1
vote
0 answers

How to use old schema of weaviate in haystack?

I want to use weaviate as a database for haystack using: from haystack.document_store import WeaviateDocumentStore document_store = WeaviateDocumentStore(port= "", host="", username="", password="", index="document") But each time it creates a new…
helpdoc
  • 1,910
  • 14
  • 36
1
vote
1 answer

Deploying haystack model/workflow

I'm trying to deploy a haystack model for Question Answering for my application as a REST API /API. I want to query and get my answers directly and I need to do it soon so I'm finding a way to do it on Algorithmia. Any suggestions, tutorials,…
avats
  • 437
  • 2
  • 10
1
vote
1 answer

Using RTX3090 with Haystack

The current release of Haystack (deepset.ai) supports GPU's but it is not using a new enough CUDA support (>= 11.1) to work with my RTX3090. Can I just uninstall the current version of torch and reinstall with cu111 support? Or are other…
Michael Wade
  • 202
  • 2
  • 12
1
vote
1 answer

Haystack Tutorial 1 - Libraries Incompetalibity

I am trying Haystack tutorial 1 - https://github.com/deepset-ai/haystack/blob/master/tutorials/Tutorial1_Basic_QA_Pipeline.ipynb on Google Colab and I am getting the following incompatibility errors during the installation Command !pip install…
eboraks
  • 167
  • 1
  • 9
1
vote
1 answer

How to integrate a chat bot with a pre-trained question answering model?

Introduction I have recently worked on building a question answering model using Haystack. The model takes as input, a question and returns an answer based on the closed domain data, which in my case is, Information about Machine Learning. I want to…
1
vote
1 answer

get error 'NoneType' object has no attribute 'dumps' when load model in HAYSTACK

I trying to load 'bert-base-multilingual-uncased' in haystack FARMReader and get the error: (huyenv) PS D:\study\DUANCNTT2\HAYSTACK\haystack_demo>…
lcdhuy
  • 31
  • 1
  • 3
1
vote
1 answer

ElasticSearch, FarmHaystack, Django connection Refused

I'm trying to make this https://haystack.deepset.ai/docs/latest/tutorial5md into a Dockerized Django App, the problem is when I implement the code locally it works but when I make a dockerized version of it it gives me a connection refused, my guess…
azerELweed
  • 67
  • 1
  • 11
0
votes
0 answers

Haystack pipeline YAML with multiple ElasticsearchDocumentStore components seems impossible

I'm trying to specify a Haystack pipeline using the YAML declarative syntax. I want to run a pipeline with two "lanes" whose answers will be merged - one using an EmbeddingRetriever to fetch answers from a query embedding, and one using a (sparse)…