Questions tagged [logstash-jdbc]
187 questions
1
vote
0 answers
How to connect presto using logstash to fetch data from Cassandra DB
I am trying to connect presto using logstash to pull data from Cassandra DB. I am looking for presto-cassandra connectivity using logstash.
I tried few jdbc drivers but it could not create the connectivity.
Could you please let us know if connection…
Sapna Basantani
- 41
- 2
1
vote
1 answer
IllegalAccessError when using logstash jcdc output
I have a simple logstash configuration:
input {
jdbc {
jdbc_driver_library => "..\sqljdbc_6.0\enu\jre8\sqljdbc42.jar"
jdbc_connection_string => "jdbc:sqlserver:/server:1433;databaseName=DBNAME;integratedSecurity=true;"
…
tomsky
- 535
- 4
- 11
- 28
1
vote
2 answers
Logstash - Got error as An unknown error occurred sending a bulk request to Elasticsearch
I am trying to move SQL Server table record to elasticsearch via logstash. Its basically a synchronization. But I am getting an error from LogStash as unknown error. I have provided my configuration file as well as Error log.
Configuration:
input…
Ganesh Ram Ravi
- 169
- 1
- 10
1
vote
1 answer
Connecting Logstash to SQL Server
When I start Logstash with my config file, the following error appears. I've added multiple classpaths to the current jdbc jar. Had the driver class been renamed or something? Thanks
[2018-09-11T11:44:57,241][ERROR][logstash.pipeline ] A…
RMass
- 177
- 1
- 2
- 14
1
vote
1 answer
logstash: Import comma separated string from MySQL into elastic search as an array
I'm trying to insert a comma separated string (GROUP_CONCAT) into elasticsearch as an array datatype. As input I use JDBC and the output of the SQL query is…
Panagiotis Simakis
- 1,245
- 1
- 18
- 45
1
vote
1 answer
Jdbc_streaming filter plugin performance
Recently I have used Jdbc_streaming filter plugin of logstash, it is very helpful plugin which allows me to connect with my database on the fly and perform checks against my events.
But are there any drawbacks or pitfall of using this filter.
I mean…
Shivkumar Mallesappa
- 2,875
- 7
- 41
- 68
1
vote
1 answer
Logstash if type condition not working
In my Logstash I have one pipeline that runs 2 SQL queries to download data. Below conf file for the pipeline:
input {
jdbc {
jdbc_driver_library => "/opt/logstash/lib/ojdbc8.jar"
jdbc_driver_class =>…
Michael Dz
- 3,655
- 8
- 40
- 74
1
vote
1 answer
No handler found for uri [/news] and method [POST]
I have just started with elastic search 5.5.2. I am using logstash-jdbc-input plugin to push data from mysql database to elastic search. Here is logstash configuration that I am using
input {
jdbc {
jdbc_connection_string =>…
Sunil Garg
- 14,608
- 25
- 132
- 189
1
vote
0 answers
Configure Logstash to create an Elasticsearch document with nested arrays
I'm indexing my PostgreSQL data for Elasticsearch using the Logstash JDBC Input Plugin. I have two tables called REQUEST and ASSIGNMENT listed below.
How can I use Logstash to index the two tables into one Elasticsearch document of type REQUEST…
EricPSU
- 163
- 1
- 7
1
vote
1 answer
logstash with jdbc gets PsychParser error
Background environment:
logstash using the microsoft jdbc driver to connect to sql server with integrated security.
When the jruby gets to PsychParser.java in 'parse' method, it throws an error:
) 'reader'…
BezBran
- 161
- 1
- 8
1
vote
0 answers
Logstash - Only import new or updated rows using JDBC
Right now I've got Logstash importing a miniature version of my MSSQL database, using the JDBC plugin. I've got each JDBC input scheduled to run every minute to update Elasticsearch. To update, I'm currently just re-importing every single table and…
reno
- 48
- 8
1
vote
2 answers
Logstash jdbc plugin: how use a date filter for a column?
In my MS SQL table, i have a column with date stored as string on format "dd-mm-yyyy 00:00:00.000"
for example : 1999-10-06 00:00:00.000 or 2000-04-27 00:00:00.000
During my import, i want to convert this column's values into date type.
I saw a…
user6558241
1
vote
2 answers
Import data from Teradata using logstash jdbc plugin
Could some body please tell me how to use log stash JDBC plugin for Teradata?
The problem with Teradata is it requires two java_driver_files (tdgssconfig.jar and terajdbc4.jar) to be listed. How to specify two files terajdbc4.jar and…
Raja
- 11
- 1
1
vote
1 answer
Connect to multiple databases dynamically using Logstash JDBC Input plugin
I am using Logstash JDBC input plugin to read data from database and index it into Elastic Search.
I have separate database for each customer and I want to connect to them one by one dynamically to fetch data?
Is there any provision or parameter…
ni3ns
- 39
- 7
1
vote
1 answer
Logstash jdbc left outer join as subdocuments
I'm using the Logstash jdbc plugin to get MySQL data into ElasticSearch. Due to a left outer join I end up with multiple 'child rows' for a single 'parent row'. Say 1 user has 1 or more documents. I tried to group_concat the text of the documents…
JointEffort
- 583
- 7
- 21