Stack Overflow
Stack Overflow

Questions tagged [logstash-jdbc]

187 questions
0
votes
1 answer

Nested json objects in logstash aggregate filter plugin

I'm using logstash aggregate filter plugin to insert data to ES. I want to create a json like "Countries" : { "Asia" : { "name" : "Srilanka" }, "Africa" : { "name" : "Kenya" } } when…
Anuradha Abeysuriya
  • 19
  • 7
0
votes
0 answers

Logstash Not Recognizing The Lat/Lon fileds in Json Format

I have fields like A_Latitude, A_Longitude, B_Latitude and B_Longitude. I would like to make use of this data and create Maps in Kibana. The problem is data is getting into elasticsearch, but the gejson columns created in Logstash filter not gettin…
Ramya T
  • 53
  • 1
  • 6
0
votes
1 answer

ELK data ingestion: elasticsearch treat text as boolean even though mapping says type is 'text'

I'm using ELK 7.4.1 with docker from here, and I need to ingest data from MySQL database. One of the tables has this 'status' field defined as varchar(128). I used logstash jdbc plugin for this purpose, but when I started the docker image I saw a…
devvjj
  • 33
  • 3
0
votes
1 answer

Where is logstash classpath in windows?

I've spent hours with google trying to select data from a table of my postgres and insert it to elasticsearch (ES) by logstash in windows. Logstash didn't see driver class where I tried to determine jar by jdbc_driver_library option
Nesquik27
  • 234
  • 1
  • 7
  • 18
0
votes
0 answers

MSSQL JDBC Driver library path is not recognized when using ~/ when running Logstash manually

Currently trying to populate the employee index with the below settings: CONF input { jdbc { jdbc_driver_library => "~/sqljdbc_6.2/enu/mssql-jdbc-6.2.1.jre8.jar" jdbc_driver_class => "com.microsoft.sqlserver.jdbc.SQLServerDriver" …
lionheart
  • 423
  • 2
  • 4
  • 17
0
votes
1 answer

LOGSTASH - Issue with JDBC input connected to HSQL DB database when selecting ARRAY columns

I'm having troubles to successfully import HSQL DB database content using Logstash's JDBC input plugin. The problem occurs when I try to fetch a column that is of type ARRAY. Please note that if I try to fetch non-array columns, it works just…
LudoZik
  • 917
  • 1
  • 8
  • 20
0
votes
1 answer

ElasticSearch 7 not taking _id from JDBC on Logstash

I am trying to update ElasticSearch indexes with the data stored into a SQL DataBase in way that every row added into the DB are added automatically into ElasticSearch. I tried to set the Primary Key of the DB as the _id field of ElasticSearch in…
Samu
  • 1
  • 1
0
votes
0 answers

jdbc driver class not loaded when connecting to SAP HANA DB

I have below logstash.conf which connects to SAP HANA DB input { jdbc{ jdbc_connection_string => "jdbc:sap://:" jdbc_driver_library => "/app/tomcat/jdbc_lib/ngdbc-2.4.61.jar" jdbc_driver_class =>…
peace
  • 299
  • 2
  • 16
0
votes
2 answers

how to connect elasticsearch with postgres using logstash?

I have trouble in transferring data from postgres to elastic using logstash. I get error "block in converge_state". The error generated is : Failed to execute action {:action=>LogStash::PipelineAction::Create/pipeline_id:main,…
Karan Gupta
  • 529
  • 2
  • 7
  • 21
0
votes
2 answers

Identifying when logstash jdbc SQL statement has completed execution

I've set up a logstash pipeline watching a directory for logstash.confs with a jdbc input and elasticsearch output. I enabled .logstash_jdbc_test_last_run, which logs the time when query is executed: --- 2019-08-23 15:26:42.847349000 Z When running…
Dan Stark
  • 808
  • 1
  • 9
  • 23
0
votes
1 answer

Logstash support for Crate DB

I'm trying to import data from Crate DB(https://crate.io) to logstash using logstash jdbc input plugin. But I'm getting this error. "LoadError: no such file to load -- sequel/adapters/crate" I've included crate DB driver in configuration with…
Mathivanan
  • 371
  • 2
  • 16
0
votes
0 answers

Problem with PostgreSQL json object (PGobject) to logstash - type cast problem

I am trying to index data from a PostgreSQL database to elastic search using logstash. I have a column in the database which is of type JSON. When I run logstash, I get an error called "Missing Converter handling". I do understand that is…
Swaroop
  • 109
  • 3
  • 9
0
votes
1 answer

Stored Query from Database as JDBC input to Logstash

I have table eg QueryConfigTable that holds a query in one column eg ,select * from customertable .I want the query in the column to be hold query to be executed as input to JDBC in logstash I its taking the column query as value and storing in…
David
  • 17
  • 3
0
votes
1 answer

index not creating while using multiple JDBC Inputs in Linux environment

hi while trying to create index using logstash with multiple JDBC inputs ,unable to create Index in linux environment ..but it works on Windows . Index created on windows system ....but on Cento-os index is creating as follows %{type} input…
David
  • 17
  • 3
0
votes
1 answer

logstash with huge mysql result set

I'm working on replication data from MySQL to elasticsearch so I'm using logstash to do replication but the problem is that in mysql there is a product table that has many relations and select query contain 46 left outer join so result returned is…
Mohammad Amjad
  • 61
  • 6
1 2 3
…
12 13