Questions tagged [azure-eventhub]

Microsoft Azure EventHubs is a highly-scalable high-throughput low-latency durable event ingestion system in Azure cloud. EventHubs serves as an event buffer for applications to process events with variable load profiles. Microsoft Azure Event Hubs is comparable to Apache Kafka or AWS Kinesis. This is a fully-managed service-offering built & run by the teams at Microsoft.

Microsoft Azure EventHubs is a highly scalable high throughput low latency durable event ingestion system in Azure cloud. EventHubs serves as an event buffer for applications to process events with variable load profiles.

Stream millions of events per second into multiple applications

Event Hubs is a highly scalable publish-subscribe ingestor that can intake millions of events per second so that you can process and analyze the massive amounts of data produced by your connected devices and applications. Once collected into Event Hubs you can transform and store data using any real-time analytics provider or with batching/storage adapters.

Enable applications to process events with variable load profiles

Today’s connected world is defined by big data. Big data originates from many sources such as connected cars and thermostats that produce telemetry data every few minutes, application performance counters that generate events every second or mobile apps that capture telemetry for every user’s individual action. In this connected world, you need a managed ingestor service capable of elastic scale in order to accommodate variable load profiles as well as the spikes caused by intermittent connectivity.

Connect millions of devices across platforms

The rapid proliferation of connected devices raises challenges due to the variety of platforms and protocols involved. Connecting these disparate data sources while handling the scale of the aggregate stream is a significant challenge. Event Hubs provide easy provisioning of capacity to ingest events from millions of devices while preserving event order on a per device basis. Support for AMQP and HTTP allow many platforms to work with Event Hubs. Native client libraries also exist for popular platforms.

1941 questions
5
votes
3 answers

Multiple Azure EventHub trigger to single function in Azure Function app

I want to do the same functionality (with few changes based on message data) from two different eventhubs. Is it possible to attach two consumer group to a single function. It did not work even though I add it to function.json.
Kannaiyan
  • 12,554
  • 3
  • 44
  • 83
5
votes
3 answers

Pushing events greater then 256KB to Azure EventHub

I am using Azure Event Hub. I am planning to send events and use SendBatchAsync. I see that Event Hub has a limit of 256KB (whether sending individually or in Batch) So, if my data is > 256KB, what is the best practice to handle this? Should we…
khar
  • 201
  • 4
  • 12
5
votes
1 answer

Azure Event Hub multiple recipients

I have a server which will need to send messages to several clients to let the clients know that something needs to be done. I am trying to achieve this by using Azure Event Hub. I use the following code to send the message: await…
Jron
  • 51
  • 1
  • 3
5
votes
1 answer

Can webhooks be delivered straight to Azure Event Hubs?

I've read a lot of documentation on Azure about working with Shared Access Signatures, and I don't believe it's possible to have webhooks delivered straight to Evenhtubs. I believe an intermediate service like a an Azure Function or Logic App…
solvingJ
  • 1,321
  • 1
  • 19
  • 30
5
votes
1 answer

About Microsoft.ServiceBus.Messaging.LeaseLostException

I got an exception of Microsoft.ServiceBus.Messaging.LeaseLostException, in my EventHub processor. what does this exception mean? What is the possible root cause of this exception? Following are stack track: at…
Youxu
  • 1,050
  • 1
  • 9
  • 34
5
votes
1 answer

Event Hub metrics shows lots of "Other Errors", how to get details?

So I have created an Event Hub using the new portal. When I visit the Event Hub blade and browse to the Metrics blade in the Monitoring section I get this chart: I wonder where I can find more info about these errors. Does anybody know?
Peter Bons
  • 26,826
  • 4
  • 50
  • 74
5
votes
3 answers

Offset in Azure EventHubTrigger Function App

Expectation: Using a function app with EventHubTrigger-CSharp template runs when a new event is comming in. Implementation: Using the very basic example from…
5
votes
4 answers

Azure IoT Hub AMQP Communication Multiplexing

In some of the Microsoft documentation for working with Azure IoT hubs, it mentions that it is possible to multiplex the communication of multiple devices under a single TLS connection (using the AMQP protocol) for scenarios where multiple simple…
Nathan G
  • 987
  • 1
  • 7
  • 12
5
votes
2 answers

How to pass a dependency to a class that implements IEventProcessor(Event Hub)

I have the following problem. we use Event Hub . In the following class, we Inherit from IEventProcessor and as you can see we use Service Locator . We can't get it to work with constructor/property injection. It seems that Castle Windsor can't…
Veronica_Zotali
  • 253
  • 1
  • 3
  • 13
4
votes
1 answer

The specified name is not available Azure EventHub namespace

I have tried to deploy an ARM template with new EventHub Namespace. But it is failing with the BadRequest error, The specified name isn't available.. But the name has not used previously in anything under that resource group. When I tried to create…
Avilon
  • 121
  • 10
4
votes
1 answer

TypeError: Object of type StructField is not JSON serializable

I am trying to consume a json data stream from an Azure Event Hub to be further processed for analysis via PySpark on Databricks. I am having trouble attempting to extract the json data into data frames in a notebook. I can successfully connect to…
4
votes
1 answer

Rust: Receive AMQP messages from Azure Event Hub

I would like to consume an Event hub with Rust. I've found a some promising crates, but nothing quite satisfactory: Azure SDK for Rust - uses HTTPS, not AMQP Dove - unusable with event hubs for missing TLS support ntex-amqp - zero docs, broken…
Robert Cutajar
  • 3,181
  • 1
  • 30
  • 42
4
votes
3 answers

Azure Function EventHubTrigger how to read EventHubName and Connection string from Azure App Configuration?

I am trying to read the eventhubname and connection string from Azure App Configuration, NOT function app settings, but I cannot get this to work, if I real from the function app itself it works fine but I need to read from App Configuration…
Matt Douhan
  • 2,053
  • 1
  • 21
  • 40
4
votes
0 answers

Increase Throughput of Debezium Kafka Connector

I have started to use Debezium recently to deal with capture changes data in realtime and sink to the target database. Instead of Kafka, I use Azure Event Hub with Kafka Connect to connect SQL Server and use confluent JDBC to sink changed data to…
4
votes
1 answer

Azure function shows 0 executions on azure portal

I am an azure novice. My setup is as follows. I've got an IoT Hub, An Event Hub, an Azure function. The idea is to send messages to the IoT hub, route them to the Event Hub based on a certain message type, handle these events with the use of the…