Stack Overflow
Stack Overflow

Questions tagged [apache-bahir]

Apache Bahir provides extensions to multiple distributed analytic platforms, extending their reach with a diversity of streaming connectors and SQL data sources.

What is Apache Bahir

Apache Bahir provides extensions to multiple distributed analytic platforms, extending their reach with a diversity of streaming connectors and SQL data sources.

Currently, Bahir provides extensions for Apache Spark and Apache Flink.

Apache Spark extensions

  • Spark data source for Apache CounchDB/Cloudant
  • Spark Structured Streaming data source for Akka
  • Spark Structured Streaming data source for MQTT
  • Spark DStream connector for Apache CounchDB/Cloudant
  • Spark DStream connector for Akka
  • Spark DStream connector for Google Cloud Pub/Sub
  • Spark DStream connector for MQTT
  • Spark DStream connector for Twitter
  • Spark DStream connector for ZeroMQ

Apache Flink extensions

  • Flink streaming connector for ActiveMQ
  • Flink streaming connector for Flume
  • Flink streaming connector for Redis
  • Flink streaming connector for Akka
  • Flink streaming connector for Netty

The Apache Bahir community welcomes the proposal of new extensions.

Contact the Bahir community

For Bahir updates and news, subscribe to our development mailing list. Check out All Mailing Lists.

22 questions
0
votes
2 answers

Can not Create a MQTT stream with Username and Password

I want to create a MQTT stream which uses username and password for subscription. I am using apache-bahir for creating mqtt stream. When I used MQTTUtils.createStream() method, It only accepts ssc,brokerurl,topic, and StorageLevel as parameters.…
Ashok v
  • 77
  • 1
  • 8
0
votes
1 answer

MQTTUtils.createPairedStream() is not a member of org.apache.bahir

When I started spark-shell by the following command bin/spark-shell --packages org.apache.bahir:spark-streaming-mqtt_2.11:2.3.0 --repositories http://central.maven.org/maven2/org/apache/bahir/spark-streaming-mqtt_2.11/2.3.0/ Two errors were…
Ashok v
  • 77
  • 1
  • 8
0
votes
1 answer

Flink job with AMQSource doesn't generate output

I used Apache Bahir's AMQSource connector that listens to ActiveMQ, but when I run the Flink job to consume the data from ActiveMQ no output is generated. For example, the connector is listening to ActiveMQ which contains 4 messages, but when I run…
Miki
  • 1
0
votes
1 answer

Apache Spark 2.3.1 - twitter is not a member of package org.apache.spark.streaming

First of all I have been looking around for this problem a while now, and I can see there exist other solutions regarding this, however nothing for the Apache Spark version 2.3.1. To be short, I am trying to create an application that uses bahir to…
Thelin90
  • 37
  • 2
  • 11
0
votes
2 answers

Schema lost with ApacheBahir Stuctured Streaming connector on ApacheSpark streaming

I'm trying to hook-up an ApacheSpark Structured Stream to a MQTT topic (IBM Watson IoT Platform on IBM Bluemix in this case). I'm creating the structured stream as follows: val df = spark.readStream …
Romeo Kienzler
  • 3,373
  • 3
  • 36
  • 58
0
votes
1 answer

Schema issue with ApacheBahir Stuctured Streaming connector on ApacheSpark streaming

I'm trying to hook-up an Apache Spark Structured Stream to a MQTT topic (IBM Watson IoT Platform on IBM Bluemix in this case). I'm creating the structured stream as follows: val df = spark.readStream …
Romeo Kienzler
  • 3,373
  • 3
  • 36
  • 58
-3
votes
1 answer

How to use createpairedStream in MQTTUtils?

I can not use the MQTTUtils.createPairedStream() in Scala? How to specify list of topics as parameters? I tried all the ways like dictionary, list,tuples, but it did not worked. And then i tried in python, at that time it shows an error like…
Ashok v
  • 77
  • 1
  • 8
1
2