Questions tagged [apache-calcite]

Apache Calcite is a data management framework. Not to be confused with Apache (HTTP Server).

Apache Calcite is a data management framework. It has an implementation of relational algebra, an extensible cost-based optimizer, and an optional SQL parser and JDBC driver.

Calcite is used by Apache Hive and Apache Drill as their query optimizers, and you can use it as a framework to build your own data engine.

Calcite was previously known as Optiq.

255 questions
1
vote
1 answer

Is it possible to configure Apache Calcite identifiers to be case insensitive?

The Calcite SQL language reference (https://calcite.apache.org/docs/reference.html) says the following: In Calcite, matching identifiers to the name of the referenced object is case-sensitive. But remember that unquoted identifiers are implicitly…
tuzhucheng
  • 158
  • 3
  • 9
1
vote
0 answers

missing Schema.contentsHaveChangedSince in v1.18

According the document "JSON/YAML models", "However, it also leads to the problem of cache staleness. A particular schema implementation can override the Schema.contentsHaveChangedSince method to tell Calcite when it should consider its cache to be…
minfeng xu
  • 21
  • 3
1
vote
0 answers

Apache Calcite query json nested data

I'm done to read simple data in json format from kafka by using calcite sql. There is a special requirement that there is nested data like bellow {"DATA":{"SPEED":80},"USER_ID":100200,"USER_NAME":"user1"} And I want DATA.SPEED no just DATA as my…
Gavin Gu
  • 61
  • 6
1
vote
1 answer

How can I create an External Catalog Table in Apache Flink

I tried to create and ExternalCatalog to use in Apache Flink Table. I created and added to the Flink table environment (here the official documentation). For some reason, the only external table present in the 'catalog', it is not found during the…
1
vote
1 answer

Avatica Calcite JDBC Driver issue

I am getting the below error while trying to getConnection through Java Web App. Any one faced this issue ? com.fasterxml.jackson.databind.JsonMappingException: Class org.apache.calcite.avatica.remote.Service$ResultSetResponse not subtype of…
vdata2025
  • 11
  • 2
1
vote
1 answer

Apache Arrow adapter Integration with Apache Calcite

Is there any option readily available to integrate apache arrow and apache calcite? I observed that CSV, JSON has this integration feature. but Apache Arrow doesn't have this. we have to write all these classes like calcite-arrow-sample since its…
Ram Ghadiyaram
  • 28,239
  • 13
  • 95
  • 121
1
vote
1 answer

calcite select count(intCol) from table when row type is _MAP (elasticsearch example)

I'm new to Calcite. The functionality it provides look fabulous! While doing a research, I'm trying to figure out how to do some basic SQL queries with example ElasticSearch adapter. In the AbstractElasticsearchTable.getRowType, it maps rows to a…
1
vote
1 answer

How to take advantage of calcite-server

Our project relies on calcite-core, but we also need to use DDL statements. The server module (calcite-server) adds DDL support to Calcite. How can we take advantage of calcite-server to support our demands? calcite's documentations have mentioned…
W.H.Tang
  • 11
  • 1
1
vote
1 answer

How do I get an output schema for an Apache Beam SQL query?

I've been playing with the Beam SQL DSL and I'm unable to use the output from a query without providing a coder that's aware of the output schema manually. Can I infer the output schema rather than hardcoding it? Neither the walkthrough or the…
brabster
  • 42,504
  • 27
  • 146
  • 186
1
vote
0 answers

using Calcite's ReflectiveSchema from scala

I'm experimenting with calcite from scala, and trying to pass a simple scala class for creating a schema at runtime (using ReflectiveSchema), I'm having some headache. For example, re-implementing the FoodMart JDBC Example (which works well in…
Alfredo Serafini
  • 195
  • 3
  • 13
1
vote
2 answers

in calcite how to modify the generated SQLNode with another sqlNode?

If I have a SqlNode node parsed from the sql select id, age from student where id > 5 , and I also have another SqlNode subNode parsed from another subcondition id < 20 Then, how to merge this two so that I can get a SqlNode have the same result…
1
vote
0 answers

Creating DDL Statements from Calcite Schemas

I have created a bunch of Calcite Schemas and tables. I was wondering how do I convert them to SQL DDL statements.
AKG
  • 598
  • 6
  • 18
1
vote
0 answers

Relbuider on Calcite Tables

We have built our own way configuration scheme for specifying interaction on data. We plan to use calcite to convert the specification into Relation Algebra and then create SQL Queries (for now) to be executed in Hive. The specification we use looks…
AKG
  • 598
  • 6
  • 18
1
vote
1 answer

beamsql with dynamic query

We have an Apache Beam pipeline and need to run multiple BeamSql queries. The queries are not known at the pipeline construction time, but will be known when the pipeline is running. The queries will be updated periodically. Is this possible with…
1
vote
1 answer

Will calcite take statistics from data directly?

Can I give my entire dataset to calcite, so that it will take statistics from data itself? If so, how can I import my dataset into calcite?
Anbu
  • 23
  • 4