Questions tagged [elasticsearch-jdbc-river]

The Java Database Connection (JDBC) river allows to fetch data from JDBC sources for indexing into Elasticsearch.

It is implemented as an Elasticsearch plugin.

The relational data is internally transformed into structured JSON objects for the schema-less indexing model in Elasticsearch.

Creating a JDBC river is easy. Install the plugin. Download a JDBC driver jar from your vendor's site (here MySQL) and put the jar into the folder of the plugin $ES_HOME/plugins/river-jdbc. Then issue this simple command:

curl -XPUT 'localhost:9200/_river/my_jdbc_river/_meta' -d '{
    "type" : "jdbc",
    "jdbc" : {
        "url" : "jdbc:mysql://localhost:3306/test",
        "user" : "",
        "password" : "",
        "sql" : "select * from orders",
        "index" : "my_jdbc_index",
        "type" : "my_jdbc_type"
    }
}'

Reference :-

Elasticsearch Jdbc River Quick Start

Elasticsearch JBDC River Parameters

124 questions
3
votes
1 answer

Parent Child Document Mapping in ElasticSearch via AWS SQS Plugin

Does the AWS SQS River Plugin for elasticsearch support the _parent field during indexing? If so, how? The documentation is not clear and I've tried both of the following: { "_id": "123", "_parent":"parent_id" "_index": "es_index_name", "_type":…
3
votes
1 answer

ElasticSearch multimatch query cross_fields type

I am trying to use elasticsearch (version 1.0) multimatch query with type set to cross_fields like in the manual on elasticsearch page here: the query looks like this (and it's exactly like on elasticsearch page): { "multi_match" : { "query":…
preboha
  • 33
  • 4
3
votes
1 answer

Elasticsearch indexed database table column structure

I have a question regarding the setup of my elasticsearch database index... I have created a table which I have rivered to index in elasticsearch. The table is built from a script that queries multiple tables to denormalize data making it easier to…
Jay Rizzi
  • 4,196
  • 5
  • 42
  • 71
3
votes
2 answers

ElasticSearch river JDBC MySQL not deleting records

I'm using the JDBC plugin for ElasticSearch to update my MySQL database. It picks up new and changed records, but does not delete records that have been removed from MySQL. They remain in the index. This is the code I use to create the river: curl…
Stephen O'Flynn
  • 2,309
  • 23
  • 34
3
votes
1 answer

JDBC, Elasticsearch and Postgresql Json data type

Postgresql : 9.3.2 Elasticsearch : 0.90 jprante/elasticsearch-river-jdbc : 2.2.2 postgresql JDBC : 9.3-1100 JDBC 41 I'm trying to get a postgresql Json data type column into elasticsearch, using the elasticsearch river. Here the created…
2
votes
0 answers

Elasticsearch - indexing SQL Server table - what is available today?

This question was probably asked multiple times but I still can't find definite answer. I have a table in a SQL Server database. Data inserted into the table constantly. Nothing gets deleted or updated. Each row has unique id and date column. I want…
Igor K.
  • 915
  • 2
  • 12
  • 22
2
votes
0 answers

Elasticsearch integration with mysql and php

I need to integrate Elasticsearch to my website. I have installed elasticsearch in localhost XAMPP server. I am checking the static datas using http://localhost:9200. My data's are in mysql db. So i have installed river-jdbc in…
2
votes
1 answer

Elastic Search JDBC River Plugin SQL Server Integrated Security

So I've been working on implementing elastic search using the JDBC River plugin to get data from our SQL Server DB into elastic search. I've got it working fine using the SQL Server credentials, but trying to use integrated security doesn't work. It…
2
votes
2 answers

Elasticsearch database sync

I'm using jdbc river to sync Elasticsearch and database.The known problem is that rows deleted from database remain in ES, jdbc river plugin doesn't solve that. Author of jdbc river suggested the way of solving the problem: A good method would be…
2
votes
0 answers

Issue to configure river-jdbc oracle

I'm trying to use the elasticsearch river-jdbc plugin with an oracle database. When creating the river i got a exception : [2014-12-10 11:42:44,795][WARN ][river ] [Agent Axis] failed to create river…
2
votes
1 answer

Elasticsearch Date Histogram Aggregation over a Nested Array

Following are a couple of sample documents in my elasticsearch index: { message: "M1", date: "date object", comments: [ { "msg" :"good" date:"date_obj1" }, { "msg" :"bad" date:"date_obj2" }, { "msg"…
2
votes
2 answers

Automatically syncing ElasticSearch with SQL

I've ran this query and it worked well. curl -XPUT 'localhost:9200/_river/my_jdbc_river/_meta' -d '{ "type" : "jdbc", "jdbc" : { "url" : "jdbc:mysql://localhost:3306/test", "user" : "myaccount", "password" :…
user962206
  • 15,637
  • 61
  • 177
  • 270
2
votes
0 answers

elasticsearch jdbc river does not index all the documents

I am using the elasticsearch jdbc river plugin, and I have a simple SQL table with 11 million rows. But when I use it to index the table, it stops somewhere at 2 million rows. On checking the elasticsearch log file, I did not find any errors. Does…
dickyj
  • 1,830
  • 1
  • 24
  • 41
2
votes
1 answer

Jdbc river stops on MapperParsingException

I am using Elastic search version 1.2.0, Jdbc river version 1.2.0.1. Following is my Jdbc river command. curl -XPUT 'localhost:9200/_river/tbl_messages/_meta' -d '{ "type" : "jdbc", "jdbc" : { "strategy" : "simple", "url" :…
Sridhar
  • 11,466
  • 5
  • 39
  • 43
2
votes
1 answer

ElasticSearch - creating JDBC river

I working on a PHP project, Using MYSQL for storing data. I want to use ElasticSearch search engine for searching I installed the ES on my Mac OS. I know after that I should create JDBC river but I don't know how. Any body can help me? thanks.
1
2
3
8 9