Questions tagged [dataimporthandler]

The DataImportHandler is a Solr contrib that provides a configuration driven way to import data into Solr, supporting both full and incremental (delta) import.

The DataImportHandler is a specific Solr request handler that provides a configuration driven way to import this data into Solr in both "full builds" and using incremental delta imports.

402 questions
26
votes
11 answers

Solr DataImportHandler not found

I am using Solr 3.3.0 with Tomcat 6.0.26. I was able to successfully install Solr and i was even able to access its web interface using http:/localhost:8084/solr/admin. Now i want to use its dataimporthandler to index data from my database.I have…
Prim
  • 1,312
  • 5
  • 25
  • 51
16
votes
2 answers

Solr DIH -- How to handle deleted documents?

I'm playing around with a Solr-powered search for my webapp, and I figured it'd be best to use the DataImportHandler to handle syncing with the app via the database. I like the elegance of just checking the last_updated_date field. Good stuff. …
Brandon Yarbrough
  • 37,021
  • 23
  • 116
  • 145
15
votes
5 answers

SOLR - Best approach to import 20 million documents from csv file

My current task on hand is to figure out the best approach to load millions of documents in solr. The data file is an export from DB in csv format. Currently, I am thinking about splitting the file into smaller files and having a script while post…
Bobby ...
  • 151
  • 1
  • 1
  • 4
14
votes
2 answers

org.apache.solr.common.SolrException: TransactionLog doesn't know how to serialize class org.bson.types.ObjectId; try implementing ObjectResolver?

When performing a data import from mongodb, Solr throws the following error: org.apache.solr.common.SolrException: TransactionLog doesn't know how to serialize class org.bson.types.ObjectId; try implementing ObjectResolver? at…
XieWilliam
  • 167
  • 1
  • 14
12
votes
4 answers

org.apache.solr.common.SolrException: Error loading class 'org.apache.solr.handler.dataimport.DataImportHandler

I am new for solr. I have installed apache tomcat 7.0 on my server and I have solr 3.6.1 on server. I have solr-home folder set by network guys on my D:\ drive. The folders in that are: bin,etc,logs,multicore,webapps. In the multicore folder there…
user1909813
  • 123
  • 1
  • 1
  • 6
11
votes
2 answers

What SQL datatype should be used to populate a Solr location (spatial) field when using a DataImportHandler?

I have a Solr schema which contains a location field (using the default solr.LatLonType ): And I am trying to populate it using a DataImportHandler. Currently I SELECT the value…
STW
  • 44,917
  • 17
  • 105
  • 161
11
votes
6 answers

SOLR dataimport 404 Error

I m facing Problem with Dataimport in Solr. if i call this Link http://localhost:8983/solr/dataimport?command=full-import&clean=false showing Error HTTP ERROR 404 Problem accessing /solr/dataimport. Reason: NOT_FOUND I have follow Same as per Solr…
Ashutosh
  • 201
  • 4
  • 16
11
votes
6 answers

Solr 4.1 DataImportHandler ClassNotFoundException

I have been trying to setup Data Import Handler (Solr 4.1) following this tutorial and tried solutions suggested in previous posts such as Configure DIH in multicore solr and added the dataimport jar to the classpath but the error still persists.…
krishnang
  • 698
  • 1
  • 7
  • 21
9
votes
2 answers

Solr safe dataimport and core swap on high-traffic website

Hello fellow technicians, Let's assume we have a (PHP) website with millions of visitors a month and we running a SolR index on the website with 4 million documents hosted. Solr is running on 4 separate servers where one server is the master and…
9
votes
1 answer

Importing ObjectID as string

I am trying to upgrade a Solr 6.2.1 single node instance to a SolrCloud setup using the Solr version 6.6. The issue I am facing is that while performing data import from mongodb using the solr-mongo-importer-1.1.0.jar and…
Rajesh
  • 15,724
  • 7
  • 46
  • 95
9
votes
3 answers

Steps to connect MongoDB and Solr using DataImportHandler

I am new to SOLR and MONGODB. I am trying to index data from mongodb into SOLR using DataImportHandler but I could not find the exact steps that I need to follow. Could you please help me in getting the exact steps to index MongoDB into Solr using…
chetna agarwal
  • 131
  • 1
  • 2
  • 5
8
votes
4 answers

how to index data in solr from database automatically

I have MySql database for my application. i implemented solr search and used dataimporthandler(DIH)to index data from database into solr. my question is: is there any way that if database gets updated then my solr indexes automatically gets update…
Romi
  • 4,833
  • 28
  • 81
  • 113
8
votes
2 answers
7
votes
1 answer

Using properties from solrcore.properties in data-config.xml (Solr 4.2.1)

We are trying to upgrade from Solr 3.6.2 to Solr 4.2.1 and are having problems with using properties in solrcore.properties in data-config.xml. With Solr 3.6.2, we were able to directly use properties in solrcore.properties inside data-config.xml…
arun
  • 10,685
  • 6
  • 59
  • 81
7
votes
4 answers

How can I do indexing .html files in SOLR

The files I want to do indexing is stored on the server(I don't need to crawl). /path/to/files/ the sample HTML file is
1
2 3
26 27