Questions tagged [message-hub]

Based on Apache Kafka, IBM® Message Hub for Bluemix™ is a scalable, distributed, high throughput message bus to unite your on-premise and off-premise cloud technologies.

Based on Apache Kafka, IBM® Message Hub for Bluemix™ is a scalable, distributed, high throughput message bus to unite your on-premise and off-premise cloud technologies. You can wire microservices together by using open protocols, and you can connect stream data to analytics to realize powerful insights. Check the documentation for more information

97 questions
3
votes
1 answer

Why kafka-python fails to connect to Bluemix message hub service?

I'm trying to connect to a Bluemix Message Hub instance on http://bluemix.net. This simple script #!/usr/bin/env python from kafka import KafkaProducer from kafka.errors import KafkaError kafka_brokers_sasl = [ …
3
votes
1 answer

Increase Log size and retention period of Message Hub (Apache Kafka) on IBM Public Bluemix

Is there a way to increase log size of Message Hub (Apache Kafka) from 1 GB (retention.bytes) to 50 GB and log retention from 24 hours on Public Bluemix?
Farhans72
  • 41
  • 1
3
votes
1 answer

Why can't I programmatically add and delete topics using the Kafka Administration REST API for Bluemix's Message Hub?

I'm calling the IBM Bluemix Administration API for Message Hub (aka Kafka), as described here. Calling the endpoint https://kafka-admin-prod02.messagehub.services.eu-gb.bluemix.net:443/topics (using an appropriate X-Auth-Token value corresponding to…
Andrew Ferrier
  • 16,664
  • 13
  • 47
  • 76
3
votes
1 answer

Client ID authentication no longer works with Kafka API

Using the Message Hub Kafka interface, I've found that my Bluemix app that was using client.id authentication is getting connections refused by the Kafka brokers. How do I fix this?
Oliver Deakin
  • 209
  • 1
  • 8
3
votes
3 answers

Timeout connecting to message-hub on Bluemix

I'm trying to connect to a Message Hub Service. I can connect if I use the REST API but when I try to connect from my Java program there's always a timeout I'm using the next configuration: Properties producerProps = new…
Ruben J Garcia
  • 344
  • 4
  • 13
2
votes
2 answers

MirrorMaker Kafka 0.9 connection to Kafka Brokers 0.10 (IBM Message Hub)

I am trying to connect my MirroMaker Kafka 0.9 to the Kafka Brokers 0.10 (IBM Message Hub) without success. The links I have followed are the followings, but they are mostly for Kafka clients…
Edoardo Basili
  • 109
  • 1
  • 9
2
votes
1 answer

Retrieve messages from a topic on a message hub

I am trying to get messages from a topic on a message hub on bluemix using Confluent Kafka Python. My code is found below, but something is not working. The topic and the message hub is up and running, so there is probably something with the…
jawwe
  • 638
  • 1
  • 5
  • 13
2
votes
3 answers

Kafka java.io.EOFException - NetworkReceive.readFromReadableChannel

I'm trying to connect to IBM Message Hub from Apache Spark 2.2.1 Structured Streaming. The connection code is quite basic: import org.apache.spark.sql.functions._ import org.apache.spark.sql.SparkSession val spark =…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
2
votes
1 answer

IBM Message Hub - after hours of working fine it fails with SASL Handshake not supported by broker (required by mechanism PLAIN)

The following application is a simple consumer which prints all messages to the console. #!/usr/bin/env python import confluent_kafka consumer = confluent_kafka.Consumer({ 'bootstrap.servers': …
Christian Will
  • 1,529
  • 3
  • 17
  • 25
2
votes
1 answer

Why am I getting the Kafka Error Failed to initialize SASL authentication: SASL handshake failed when using Node.js client for Message Hub service ?

I am getting the ERROR Failed to initialize SASL authentication: SASL handshake failed (start (-4)): SASL(-4): no mechanism available: No worthy mechs found when trying to use the Message Hub Bluemix service with node-rdkafka Why would this be…
ValerieLampkin
  • 2,620
  • 13
  • 27
2
votes
1 answer

How to purge a Message Hub topic?

Frequently when developing with MessageHub, I find that I want to purge my development data from a topic. How can I purge a MessageHub topic? This question is similar to Purge Kafka Queue but differs because that question is directed at apache kafka…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
2
votes
2 answers

Bluemix API to retrieve the service credentials

In a previous question, I can get the apiKey for interacting with the MessageHub management api. I'm not binding to this service to a Bluemix application, so I don't have access to the VCAP_SERVICES environment variable in my application. I would…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
2
votes
1 answer

MessageHub - Data Encryption at rest

we need to understand if Bluemix MessageHub supports data encryption at rest. If it does not offer direct support for data encryption at rest, are there any best practices to implement this from a consumer or producer?
D Roy
  • 59
  • 1
2
votes
1 answer

IBM Bluemix Message Hub Producer Message Format

The "Getting started with Message Hub (BETA)" page on bluemix.net indicates that for a Java producer "...the message must be in the following form: [{ "value" : string }, ...] ". I cannot find any reference in the Kafka documentation to this format,…
Gary Gershon
  • 83
  • 1
  • 8
2
votes
2 answers

Partitions on Message-Hub Service from Bluemix

I know there isn't this feature yet but, Will it be provided in the future?
Ruben J Garcia
  • 344
  • 4
  • 13