Questions tagged [llama-index]

112 questions
1
vote
0 answers

ModuleNotFoundError: No module named 'llama_index.langchain_helpers.chatgpt'

I'd like to use ChatGPTLLMPredictor from llama_index.langchain_helpers.chatgpt, but I got an error below on M1 Macbook Air. ModuleNotFoundError: No module named 'llama_index.langchain_helpers.chatgpt' My code looks like this and line 3 is the…
Taishi Kato
  • 370
  • 1
  • 3
  • 11
1
vote
0 answers

Unable to use Llama Index with AWS Lambda

I am using Llama Index to create a custom bot using AWS Lambda, but when I try to create its layer and upload it to the AWS layer, I am getting "package not found" errors for different libraries. I tried to delete some packages from the Llama Index…
1
vote
1 answer

Why does LLM(LLaMA) loss drop staircase-like over epochs?

I'm training a LLM(LLaMA-6B) and have noticed that its loss seems to drop in a stair-like fashion over the epochs. Specifically, I'll see little loss change for one epoch, and then suddenly the loss will drop quite a bit after a new epoch. I'm…
1
vote
1 answer

Google Colaboratory - Llama Index : Address already in use when trying to load Google Doc

I'm trying to connect google collab using llama-index & openai library and google doc. Following exactly the same example from the doc: https://llamahub.ai/l/google_docs . The code I'm running, after installing libraries. from llama_index import…
0
votes
0 answers

import SimpleDirectoryReader from llama-index

I have a conda virtual python 3.10.12 environment named LLM. I've created it on my ubuntu 18.04 LTS server. I've pip installed llama-index 0.6.9 into the virtual environment because llama-index wasn't available through conda. when I try to import…
user3476463
  • 3,967
  • 22
  • 57
  • 117
0
votes
0 answers

How to add fulltext search to llamaindex

I am making chatbot that is capable of discussing movies with langchain and llamaindex. I am following this guide. I wish llamaindex performs not only search with vector knn, but also adds some results based on direct keyword hits. Is there a way to…
Nick Zorander
  • 131
  • 12
0
votes
0 answers

How to add source doc title to each chunk of document in llamaindex

If I understand correctly how llamaindex works, it splits each long document to several smaller chunks, and then passes them as context part in LLM prompt. I am following this guide I am trying to create chatbot that is capable of discussing movies,…
Nick Zorander
  • 131
  • 12
0
votes
1 answer

llama-index: How to Extract `context_str` Used in LlamaIndex for a Given Response?

I'm working with LlamaIndex, and I need to extract the context_str that was used in a query before it was sent to the LLM (Language Model). Here's the relevant code: index = VectorStoreIndex.from_documents( documents,…
0
votes
1 answer

Differences between Langchain & LlamaIndex

I'm currently working on developing a chatbot powered by a Large Language Model (LLM), and I want it to provide responses based on my own documents. I understand that using a fine-tuned model on my documents might not yield direct responses, so I'm…
0
votes
0 answers

how to read nested mongoDB atrributes in llama-index

am trying to access and read document from mongoDB, query_dict = { "details.description": {"$exists": True} } field_names = ["details.description"] reader = SimpleMongoReader(connection_string, 27017) documents = reader.load_data( …
Exorcismus
  • 2,243
  • 1
  • 35
  • 68
0
votes
1 answer

creating index from text corpus with llama-index encountering issue import Chatcompletion from openai

I have the python code below. I'm using llama_index to create an index from a text corpus. I'm then submitting a query to the index to get a response. I'm getting the error below that it cannot import Chatcompletion from openai. It looks like…
user3476463
  • 3,967
  • 22
  • 57
  • 117
0
votes
0 answers

How to query by different user's document from Pinecone

I plan to build a AI faq base on their website, pinecone.init(api_key = PINECONE_API_KEY, environment = PINECONE_ENV) index_name = "project-name" if index_name not in pinecone.list_indexes(): …
Ilake Chang
  • 1,542
  • 1
  • 14
  • 19
0
votes
1 answer

ERROR: The prompt size exceeds the context window size and cannot be processed

I have been trying to create a document QA chatbot using GPT4ALL as the llm and hugging face's instructor-large model for embedding, I was able to create the index, but getting the following as a response, it's not really a error which I'm getting…
0
votes
1 answer

I don't understand how the prompts work in llama_index

I have been trying to query a pdf file in my local directory using LLM, I have downloaded the LLM model I'm using in my local system (GPT4All-13B-snoozy.ggmlv3.q4_0.bin) and trying to use langchain and hugging face's instructor-large model for…
0
votes
1 answer

langchain emedding with huggingface can't pass the access token

I am creating an index of documents with llama_index and langchain. For the embedding I want to use https://huggingface.co/bert-base-multilingual-cased. I had no problem creating the embedding using the following code: from…