0

How much data Kibana or ELK can handle? I have CSV file which has infinite data nd its growing day by day. I want to load it in Kibana for visualization. Can someone tell me how much data ELK can handle?

Dead Programmer
  • 123
  • 1
  • 5
  • 14
  • This depends entirely on your elasticsearch cluster configuration. Usually the constraining resource is memory. ES scales very well. You could check out the [sizing docs](https://www.elastic.co/blog/found-sizing-elasticsearch) or [this blog post about a petabyte-scale ES cluster](https://grey-boundary.io/field-notes-elasticsearch-at-petabyte-scale-on-aws/). – dshockley Aug 26 '17 at 07:15

1 Answers1

0

Kibana is quite good in working with large datasets, so the limiting factor in your case is elasticsearch. As long as you can scale your elasticsearch cluster, you can store quite a large amount of data on it, but please remember that you need an infinitely large cluster to store "infinite" amount of data. That could be quite costly :)

whites11
  • 12,008
  • 3
  • 36
  • 53