Stack Overflow
Stack Overflow

Questions tagged [nlp-question-answering]

Question Answering is the computer task of mechanically answering questions posed in natural language. (Please do not use this tag to indicate that you have a question and want an answer. That's already implied.)

For more information, see: https://en.wikipedia.org/wiki/Question_answering

243 questions
3
votes
1 answer

Losing data of vector store Chromadb using Langchain

I am writing a question-answering bot using langchain. For storing my data in a database, I have chosen Chromadb. I have written the code below and it works fine persist_directory = "./db" embeddings = OpenAIEmbeddings() vectordb =…
kheirq
  • 31
  • 2
3
votes
1 answer

How can I find the cosine similarity between two song lyrics represented as strings?

My friends and I are doing an NLP project on song recommendation. Context: We originally planned on giving the model a recommended song playlist that has the most similar lyrics based on the random input corpus(from the literature etc), however we…
yyy818
  • 33
  • 2
3
votes
1 answer

What is better custom training the bert model or use the model with pretrained data?

I am coding my own models for a time but I saw huggingface and started using it. I wanted to know whether I should use the pretrained model or train model (the same hugging face model) with my own dataset. I am trying to make a question answering…
Naman
  • 64
  • 9
3
votes
1 answer

How to map token indices from the SQuAD data to tokens from BERT tokenizer?

I am using the SQuaD dataset for answer span selection. After using the BertTokenizer to tokenize the passages, for some samples, the start and end indices of the answer don't match the real answer span position in the passage tokens anymore. How to…
KoalaJ
  • 145
  • 2
  • 11
3
votes
1 answer

NLP : Get 5 best candidates from QuestionAnsweringPipeline

I am working on a French Question-Answering model using huggingface transformers library. I'm using a pre-trained CamemBERT model which is very similar to RoBERTa but is adapted to french. Currently, i am able to get the best answer candidate for a…
Benno Uths
  • 33
  • 3
3
votes
1 answer

Tensorflow - Keras disconnected graph

Tensorflow Version: 2.x Python: 3.7.4 Disconnected graph: I am trying to replicate the below model architecture, but right part seems to be disconnected when I tried to plot the model in Keras. I already passed the hidden matrices HQ(For question)…
Raghu
  • 407
  • 5
  • 12
3
votes
4 answers

Chatbot that will answer from the given Information/Documents

I want to make a chatbot that will answer the questions based on the given document. E.g, if I have hundreds of documents and I want to get some information from it but don't know which information is on which line of the page so I have to spend…
Haseeb Ali
  • 65
  • 1
  • 6
3
votes
1 answer

TFRecords for embedded text data

For a project at Uni, I'm working on the implementation of a Question Answering (bAbI dataset Task 5 at the moment, see https://research.fb.com/downloads/babi/) system with Neural Nets in TensorFlow, and I want to use TFRecords for my Input…
SimonAda
  • 167
  • 1
  • 9
3
votes
4 answers

Building a closed domain QA system using LSTM

My objective is to build a closed domain question answering system from a set of documents containing knowledge about the domain. I have gone through a bunch of research papers which implement such a system using Recurrent Neural Networks (mostly,…
Samyak Jain
  • 300
  • 1
  • 9
3
votes
1 answer

How to use QA Service of IBM watson with REST API

I have just started to learn IBM Watson services. I need to use Question and answer API of bluemix in java using REST API. But I couldn't find any service like Question and answer. Please can anybody tell me is the name is changed or where can I…
ImGenie
  • 323
  • 1
  • 15
2
votes
1 answer

how to make privateGPT retrieving info only from local documents?

I'm using privateGPT with the default GPT4All model (ggml-gpt4all-j-v1.3-groovy.bin) but also with the latest Falcon version. My problem is that I was expecting to get information only from the local documents and not from what the model "knows"…
TheOldMan
  • 61
  • 8
2
votes
1 answer

Identify and correct mistakes in Q&A datasets for natural language processing (NLP)

How do you identify and correct mistakes in Q&A datasets that contain errors, such as incorrect answers or missing information, and ensure the accuracy of the dataset? Let's say I got thousands of questions+answers that are formed like the Stanford…
Nick Larsen
  • 21
  • 1
2
votes
1 answer

Fine-tune T5 pre-trained model on a specific domain for question answering

I need to build a question-answering system on a specific domain of Finance, I have documents data containing all the information about the field, Can I fine-tune T5 pre-trained model (large) unsupervised training on the documents so it can answer…
zakaria hamdane
  • 39
  • 5
2
votes
1 answer

How to specify a column for Prediction in Haystack?

I am using an OpenSearchDocumentStore to store my data an feed it to my Haystack pipeline, the data includes uuids and other information, that are not relevant for the prediction but need to stack in the DocumentStore (I was told). Now I wonder if…
Brian Hode
  • 75
  • 1
  • 5
2
votes
1 answer

How do get a 2D sprite to face the camera in a 3D unity game?

I've been trying to get it to work but most of the codes are either outdated or doesn't work can anyone help i need a code for unity 2021 ? I tried finding some codes but they are pretty old like from 2016
deezlikestocode
  • 23
  • 1
  • 4
1
2
3
…
16 17