LangChain: Chunking issue with text_splitter.split_documents & RecursiveCharacterTextSplitter(chunk_size=1000, chunk_overlap=0)

Asked Apr 26 '23 at 10:43

Active Apr 26 '23 at 10:43

Viewed 4,648 times

I have a set of text files where each file where the file sizes vary from 1K to 2.5k. Is this possible?

text_splitter = RecursiveCharacterTextSplitter(chunk_size=2500, chunk_overlap=0) texts = text_splitter.split_documents(data)

asked Apr 26 '23 at 10:43

Rdhill

1

Found my issue. Closed Did not read the documentation properly – Rdhill Apr 26 '23 at 15:29
1

how did you fix it? – Rodrigo Rubio May 21 '23 at 07:27
Sorry for the late response. I changed the chunk size. – Rdhill Jun 17 '23 at 03:42

0 Answers0