Stack Overflow
Stack Overflow

Questions tagged [elk]

Questions about the ELK stack, which gives you the ability to aggregate logs from all your systems and applications, analyze these logs and create visualization.

ELK is a stack of the three open source projects - , and

The ELK stack gives you the ability to aggregate logs from all your systems and applications, analyze these logs and create visualization.

Useful links:

1095 questions
3
votes
0 answers

Logstash - filter based on a dedicated time field for the last 30 days

I have an application that receives logs remotely from IoT devices. Those logs have timestamps from when they really happened - I process and log these logs and therefore have a specific time field original-log-time in my JSON logs. So every one of…
peach
  • 657
  • 5
  • 26
3
votes
1 answer

Processing multiple logs from the same machine using ELK

I have a single host containing multiple log files. 2 such log files are csab and oneapplogs. The corrseponding Groks are opeapplog : match => {"message" =>…
Tony Stark
  • 511
  • 2
  • 15
3
votes
0 answers

Using the CBOR format instead of JSON in elasticsearch ingest plugin

In the documentation of Ingest Attachment Processor Plugin in Elasticsearch, it is mentioned, "If you do not want to incur the overhead of converting back and forth between base64, you can use the CBOR format instead of JSON and specify the field as…
Ankit Jain
  • 41
  • 1
3
votes
1 answer

kibana opendistro can't connect to ElasticSearch open distro container on Docker

I am trying to run Kibana opendistro in Elasticsearch opendistro through a docker-compose in a virtual machine in AZURE when i run the docker-compose i can access kibana on browser with : http://myipadress:5601/app/kibana but i can't for…
Moro007
  • 75
  • 2
  • 9
3
votes
1 answer

Best logging plugin of Kong API gateway to utilise existing ELK stack log

Can anyone help me to choose one Kong API Gateway logging plugin from all available options like Tcp Log, Udp Log, Http Log, File Log, Syslog, Statsd, Loggly, etc which can utilize the existing ELK stack log?
DevSay
  • 886
  • 1
  • 14
  • 32
3
votes
4 answers

Kibana Server Not Ready

I configured Elastic search, Kibana and log stash cluster. Elastic search is working fine, but Kibana is displaying an error stating Kibana Server Not Ready. Logs shows > x .kibana_task_manager_1."} Jan 13 12:50:05 kibana-csi kibana[28007]:…
Bubashan_kushan
  • 384
  • 8
  • 24
3
votes
1 answer

kibana dashboard limit user access? without xpack

I'm using ELK stack 7.4 OSS (open source) version.I have already created a dashboard and i want to give 'read only permission' to dashboard to user. But the xpack role creation wasn't working with OSS(Open source) version. Is there and alternative…
rehan
  • 469
  • 1
  • 7
  • 17
3
votes
2 answers

Logstash Scheduling first run

I have a logstash pipeline running every 5 minutes with below jdbc input config, issue is upon starting the pipeline first time, it also waits for 5 minutes and then start scheduling. Is there any way to specify that we query/statement is executed…
Kamboh
  • 155
  • 1
  • 12
3
votes
0 answers

Vega: Use filter as input and dynamically change data URL

I am trying to create a Vega visualisation using an external URL and I want to construct the URL dynamically using some filters as input to the visualisation. My current Vega code is this: { "$schema":…
Aryak Sengupta
  • 1,727
  • 2
  • 18
  • 23
3
votes
0 answers

Paging problems in Elasticsearch SQL API

My existing system has some search SQL procedures that returns the data based on some filters. Now, to improve searches we have decided to use Elasticsearch for all our searches. We are in phase of making a prototype for now. Below is what i have…
Ajay kumar
  • 53
  • 6
3
votes
1 answer

Using grok to extract android log data

I'm a new user in ELK and logstash, and I'm trying to extract the following log with grok but without success. This is my log: 08-14 10:22:50.863 1419 1419 D GpsNetInitiatedHandler: location enabled :false and I wish to extract this like…
Alisa Faingold
  • 31
  • 3
3
votes
1 answer

Exceeding maximum length of field in elasticsearch - error in kibana

Discover: The length of [message] field of [-CSnZmwB_xkQcDCOrP1V] doc of [prod_logs] index has exceeded [1000000] - maximum allowed to be analyzed for highlighting. This maximum can be set by changing the [index.highlight.max_analyzed_offset] index…
UMA MAHESWAR
  • 167
  • 3
  • 16
3
votes
0 answers

Receiving the sent data from Laravel to Logstash in Kibana

I am using Laravel to send my logs to Logstash and I want to show them in Kibana. Here is what I did: In logging.php: 'logstash' => [ 'driver' => 'custom', 'via' => \App\LogstashLogger::class, 'host' =>…
Farshad
  • 1,830
  • 6
  • 38
  • 70
3
votes
0 answers

While searching a string I cannot retrieve strings which consist of a symbol(.,& ) between characters

I am using elastic search 7.3, My data consists of strings like: K&S K.S. K S KS KS. when I search for K S I don't get any result for K&S. I have tried normalizer for this problem but still not getting relevant results. this is the index…
Chetan Pandey
  • 105
  • 6
3
votes
0 answers

elasticsearch.exceptions.RequestError: RequestError(400, 'too_long_frame_exception', 'An HTTP line is larger than 4096 bytes.')

I'm working on client server so I can't edit the elasticsearch.yml file. I used ignore=400 parameter.Help me for the solution of the this error elasticsearch.exceptions.RequestError: RequestError(400, 'too_long_frame_exception', 'An HTTP line is…
Gnturu Padmavathi
  • 29
  • 7
1 2
3
…
72 73