Stack Overflow
Stack Overflow

Questions tagged [logstash-jdbc]

187 questions
0
votes
1 answer

Logstash not able to retrieve key stored in logstash-keystore

I am trying to pass a null value to keystore. Logstash is not working and I am getting an error. Same configuration is working if it is not stored in a keystore and hard coded "". Error : "Unable to configure plugins: Error while trying to retrieve…
user2831322
  • 11
  • 4
0
votes
0 answers

how to create nested object from select columns in logstash

I am doing a select * from xxx to a database, I would need to know how to take two or three fields from that select (field1, field2, field3) and create an array with these values. Any suggestion on how to do it? input { jdbc { …
Max
  • 538
  • 1
  • 6
  • 16
0
votes
1 answer

Removing Json object name using Logtash

I'm trying to parse the following json using logstash { "payload":…
Khatere Tajfar
  • 40
  • 6
0
votes
0 answers

Configure logstash input from DB values

as I am new to the ELK technology i need some help on this. I've a requirement in which i need to get log location(More than 1 for sure)s from a DB table and pass those values in logstash input to view the data in kibana. Can you please share some…
Ryan
  • 1
  • 1
0
votes
2 answers

Logstash Sql_Last_value date format seems to irrelevant

Hi All i am using logstash to index document from MSSQL server to elasticsearch i using below config to for doing incremental indexing for that i am using using column called modified_date but having problem with dateformat. below is my…
Mohan vel
  • 505
  • 9
  • 29
0
votes
2 answers

Nested document to elasticsearch using logstash

Hi All i am trying to index the documents from MSSQL server to elasticsearch using logstash. I wanted my documents to ingest as nested documents but i am getting aggregate exception error Here i place all my code Create table department( ID Int…
Mohan vel
  • 505
  • 9
  • 29
0
votes
2 answers

sql_last_value resets whenever logstash restarts

Whenever I logstash restarts it start fetching database records from scratch, here is my .conf file which I am executing input { jdbc { # Postgres jdbc connection string to our database, mydb jdbc_connection_string =>…
Muhammad
  • 921
  • 2
  • 11
  • 29
0
votes
1 answer

Need clarification on sql_last_value used in Logstash configuration

Hi All i am using below code for indexing data from MSSql server to elasticsearch but i am not clear about this sql_last_value. input { jdbc { jdbc_driver_library => "" jdbc_driver_class =>…
Mohan vel
  • 505
  • 9
  • 29
0
votes
1 answer

sql_last_value in logstash is always 351

I was working on inserting indexes to elasticsearch using logstash. My conf looks like this: input { jdbc { jdbc_connection_string => "jdbc:mysql://localhost:3306/sample" jdbc_user => "root" jdbc_password => "" …
Satnam112
  • 242
  • 1
  • 10
0
votes
1 answer

Deploy Logstash in production environment

Hi all i have created a logstash config file scheduled every 5 minutes which transport data from MSSql sever to Elasticsearch and i run my logstash application using the windows powershell with the following command .\logstash-7.2.0\bin\logstash -f…
Mohan vel
  • 505
  • 9
  • 29
0
votes
3 answers

Incremental indexing using Logstash from SQL Server to Elasticsearch

Hi All I'am getting below error while running my logstash to index record from SQLserver database to elasticsearch Java Version : 13 Logstash : 7.2.0 Elastic search : 7.2.0 JDBC Driver : mssql-jdbc-7.4.1.jre12-shaded MyConfig file input { jdbc…
Mohan vel
  • 505
  • 9
  • 29
0
votes
0 answers

When using logstash to import data from mysql to elasticsearch usig JDBC not all records are imported?

I am using MySQL Cluster which is running on NDB engine. I am trying to import data from a view. This is the defination of view- CREATE ALGORITHM = UNDEFINED DEFINER = `s2ic`@`%` SQL SECURITY DEFINER VIEW `s2ic`.`courses_view` AS …
Aman Prakash
  • 340
  • 4
  • 15
0
votes
1 answer

Export Data from Postgres To ElasticSearch Using Logstash Gives LoadError: no such file to load -- pg

I am trying to export data from Postgres To ElasticSearch Using Logstash. Here is my conf file, which is at path "/etc/logstash/conf.d" input { jdbc { jdbc_connection_string => "postgresql://localhost:5432/panzura" jdbc_user =>…
Deepak Pandey
  • 1,322
  • 12
  • 21
0
votes
1 answer

Why is logstash throwing error of daylight saving time gap with SQL Server data

We are using LogStash version 7.3.2 to fetch SQL Server data. And it is working fine but sometimes it is throwing below exception: Exception when executing JDBC query {:exception=># transition (daylight savings time 'gap'): 1942-09-01T00:00:00.000…
Raj
  • 429
  • 2
  • 6
  • 26
0
votes
1 answer

Logstash exception while fetching incremental data from SQL Server

I am using LogStash 7.3.2 to fetch incremental data from SQL Server using this query: select * from mytable where lastupdatetimestamp > :sql_last_value I also have specified last_run_metadata_path in logstash config file. It works fine but…
Raj
  • 429
  • 2
  • 6
  • 26
1 2 3
…
12 13