Questions tagged [druid]

Druid is a column-oriented open-source distributed data store written in Java.

According to the Apache Druid website:

Apache Druid is a real-time analytics database designed for fast slice-and-dice analytics ("OLAP" queries) on large data sets. Most often, Druid powers use cases where real-time ingestion, fast query performance, and high uptime are important.

Druid is commonly used as the database backend for GUIs of analytical applications, or for highly-concurrent APIs that need fast aggregations. Druid works best with event-oriented data.

597 questions
5
votes
1 answer

Druid: how to cache all historical node data in memory

I have about 10GB of data stored on a historical node. However the memory consumption for that node is about 2GB. When I launch a select query, results are returned the first time in more than 30 secondes. Next, they are in second (because of…
DrWho3
  • 53
  • 3
5
votes
4 answers

Query druid from java application

I'm new to druid. I want to query a remote druid cluster from my java application. I read in the druid-user google group that we can use io.druid.client.DirectDruidClient . Can someone please help me or point out a resource with an example for the…
Priyanka
  • 261
  • 1
  • 3
  • 10
5
votes
0 answers

storm integration with druid class com.fasterxml.jackson.module.scala.ser.ScalaIteratorSerializer overrides final method withResolved error

I am new to both storm and druid. From the last few days, i am stuck on this issue. I am sending data from Kafka to storm and then to the druid. * I think druidbeambolt is receiving the data but unable to convert to it JSON before transferring to…
gashu
  • 863
  • 2
  • 10
  • 21
4
votes
3 answers

Druid setup ERROR: service serving this console is not responding

I am trying to setup druid in cluster mode. The setup is completer and there is no error in the server logs. Even the druid console is launching successfully, but getting below error: "It appears that the service serving this console is not…
graceful
  • 126
  • 7
4
votes
1 answer

How to do pagination in Druid SQL

My question is actually a two-part question: How to do pagination on select queries with Druid SQL. I know that pagination is supported in Druid native query, but I'd like to use SQL if possible How to do pagination for aggregation queries(group…
Artem Vovsia
  • 1,520
  • 9
  • 15
4
votes
3 answers

druid kafka indexing service setup

I followed the docs and edited: druid-0.9.2/conf/druid/_common/common.runtime.properties and added: "druid-kafka-indexing-service" to the druid.extensions.loadList and restarted all druid services: middlemanager, overlord, coordinator, broker,…
KillerSnail
  • 3,321
  • 11
  • 46
  • 64
4
votes
1 answer

Druid for non time-series data

For cases where the data get sent to Druid immediately as its generated, all is fine and dandy (as in IoT). Love it. But now I have different situation, stemming from late data-entry. The end-user can go offline (losing internet connection), and the…
Cokorda Raka
  • 4,375
  • 6
  • 36
  • 54
4
votes
1 answer

Hadoop and Druid incompatibility issue with Jackson library

I am running druid 0.9.0 on an Azure Cluster with HDP insight 2.4.1.1-3. The hadoop client is 2.7.1. After countless attempts to solve the issue with Jackson, specifically : Error: class…
Stelios Savva
  • 812
  • 1
  • 10
  • 30
4
votes
5 answers

How to insert data into druid via tranquility

By following tutorial at http://druid.io/docs/latest/tutorials/tutorial-loading-streaming-data.html , I was able to insert data into druid via Kafka console Kafka console The spec file looks as following examples/indexing/wikipedia.spec [ { …
Cheok Yan Cheng
  • 47,586
  • 132
  • 466
  • 875
3
votes
3 answers

Can we able to do Transformation in Druid

I am having a scenario where I will be receiving data in csv files and there I need to generate some columns with the existing one. Example: Col_1 Col_2 Col_3 Col_4 abc 1 No 123 xyz 2 Yes 123 def 1 …
HEMANT PATEL
  • 77
  • 1
  • 11
3
votes
0 answers

Exploding a json array into individual druid rows using flatten spec

I have been trying to explode a json array into multiple rows in Druid using flatten spec. Is it possible to get the below json array into druid using flatten spec or any other method ? [{"name":"test","age":21},{"name":"test2","age":22}] In Druid…
Shane
  • 588
  • 6
  • 20
3
votes
1 answer

How to transform date string in Druid

I am adding a Druid ingestion spec and one my fields called maturityDate is a string in the format "dd/MM/yyyy". Sample data: 5/01/2023 I am using Druid UI console and in the Transform phase, adding the following…
saurabh.in
  • 389
  • 3
  • 13
3
votes
0 answers

Extension [/opt/apache-druid-0.20.1/dist/druid/extensions/druid-orc-extensions] specified in "druid.extensions.loadList" didn't exist?

I am trying to deploy apache/druid:0.20.1 in Kube. I am getting error: Extension [/opt/apache-druid-0.20.1/dist/druid/extensions/druid-orc-extensions] specified in "druid.extensions.loadList" didn't exist!? I…
Ankit
  • 131
  • 1
  • 8
3
votes
1 answer

How access Druid Console

I'm testing Apache Druid. I installed it in a single machine. I followed Druid tutorial: https://druid.apache.org/docs/latest/tutorials/index.html The machine that I'm using is a virtual machine in an internal cloud access of the company. When I…
Isabelle
  • 151
  • 2
  • 9
3
votes
0 answers

In Apache Druid, Is it possible to get the value a previous row?

In Apache Druid, when writing a query, is it possible to get the value a previous row? For e.g., in MySQL I can do that by setting a variable value. I want todo this to find the difference between the previous end time and the current start time of…
Naveen J P
  • 31
  • 2
1
2
3
39 40