Stack Overflow
Stack Overflow

Questions tagged [flink-table-api]

Apache Flink is an open source platform for scalable batch and stream data processing. Flink supports batch and streaming analytics, in one system. Analytical programs can be written in concise and elegant APIs in Java and Scala. Apache Flink features Table API (and SQL API) as unified APIs for stream and batch processing.

81 questions
0
votes
1 answer

Flink: Temporal Join not emitting data

I'm trying to implement a event-time temporal join but I don't see any data being emitted from the join. I don't see any runtime exceptions either. Flink Version: 1.13 Kafka topics have only 1 partition for now Here's how I set it up: I have an…
taricjain
  • 1
  • 1
0
votes
1 answer

How to set not null column via Schema.Builder in Flink?

When I was create table via Table API, my code looks like this: Schema.Builder schemaBuilder = Schema.newBuilder(); schemaBuilder.column("id", DataTypes.BIGINT()) .column("value", DataTypes.STRING()) .primaryKey("id"); then I get an…
Haw Ke
  • 3
  • 2
0
votes
1 answer

Flink TableEnvironment.create throws NoSuchMethodError

I am testing flink hive connector, following the instruction here https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/connectors/table/hive/overview/. The final code is as follows. I tried to run it in Intellij IDE. Unfortunately, it…
gao xiahong
  • 3
  • 1
0
votes
1 answer

what state/s does flink create when using the tableApi to join multiple tables?

I have multiple streams that I want to join (A to B, B to C , C to D...) to create one Z when using the table api and joining 3 tables select * from A inner join B on a.pk_id = b.fk_id inner join C on b.pk_id = c.fk_id what is/are the underlying…
urield
  • 3
  • 2
0
votes
1 answer

Headers with Flink Table Api Kafka Sink

How does one send kafka headers with the table api in Flink? I used the sql syntax to create a sink but not sure how to include custom headers.
Houston
  • 426
  • 4
  • 17
0
votes
1 answer

Read a csv file in Flink 1.15 using Table API

I'm doing a simple tutorial with flink + java using Table API. What I want to do is really simple - I want to read a csv file from a local filesystem, using a schema and print it out. The way I'm doing this is this(the code below is compiled from…
drsealks
  • 2,282
  • 1
  • 17
  • 34
0
votes
1 answer

Flink table left outer join showing an error

I am doing a left outer join on two tables in flink, and the code is given below, showing an exception, inner join with the same two tables worked fine and was able to convert to Datastream Table table =…
Sangeeth
  • 1
  • 1
0
votes
1 answer

java return data type of flink table api aggregation function

I am using flink table api to compute avg and stddevPop for some fields as the following: Table windowedTable = inputTable .window(Tumble.over(lit(5).seconds()).on($("ts")).as("w")) .groupBy($("w"), $("src_ip")) …
Charles Ju
  • 1,095
  • 1
  • 9
  • 28
0
votes
0 answers

Integrate flink environment with hive

Hi I am trying to integrate my flink environment with hive. I am using flink 1.15.1 and hive 1.1 I read in the flink doc here that I need to add to the /lib directory the flink-sql-connector-hive-1.2.2 so I added that on the flink official docker…
Programmer666
  • 33
  • 4
0
votes
1 answer

Flink table api filesystem connector is not available

I'm trying to write to my local filesystem with flink table api (1.15.1 version). I'm using TableDescriptor.forConnector('filesystem') but I get the exception: Could not find any factory for identifier 'filesystem' that implements…
JoeHills
  • 43
  • 4
0
votes
1 answer

Apache Flink Table API Insert statement

I have a Flink application that processes data from 2 streams. I am using a Table API where i want to consume data from one stream1 and query another stream2 and get the record with the latest timestamp - I have this now - def…
Dan
  • 79
  • 10
0
votes
1 answer

Flink Table API streaming S3 sink throws SerializedThrowable exception

I am trying to write a simple table API S3 streaming sink (csv format) using flink 1.15.1 and I am facing the following exception, Caused by: org.apache.flink.util.SerializedThrowable: S3RecoverableFsDataOutputStream cannot sync state to S3. Use…
Jaya Ananthram
  • 3,433
  • 1
  • 22
  • 37
0
votes
1 answer

Duplicate messages in Flink kafka sink from Source kafka CDC using table connectors

I'm trying to use Apache Flink 1.15.1 to read messages from two kafka topic, transform them and finally send them to another kafka topic. Added some savepoints to save the state of the application in case of cancellation and restating. The problem…
user3332207
  • 1
  • 1
0
votes
1 answer

flink table API not processing records

I read json data from Kafka and tried to process the data with flink table API. StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment(); StreamTableEnvironment tEnv =…
Charles Ju
  • 1,095
  • 1
  • 9
  • 28
0
votes
0 answers

org.apache.flink.table.api.TableException: Failed to execute sql

I have a problem running a flink job in mini kube that use table connectors to read messages from kafka and then tries to write back to kafka (am just trying to learn table api so not doing any analytics) but getting error…
user3332207
  • 1
  • 1
1 2 3
4
5 6