Questions tagged [azure-eventhub]

Microsoft Azure EventHubs is a highly-scalable high-throughput low-latency durable event ingestion system in Azure cloud. EventHubs serves as an event buffer for applications to process events with variable load profiles. Microsoft Azure Event Hubs is comparable to Apache Kafka or AWS Kinesis. This is a fully-managed service-offering built & run by the teams at Microsoft.

Microsoft Azure EventHubs is a highly scalable high throughput low latency durable event ingestion system in Azure cloud. EventHubs serves as an event buffer for applications to process events with variable load profiles.

Stream millions of events per second into multiple applications

Event Hubs is a highly scalable publish-subscribe ingestor that can intake millions of events per second so that you can process and analyze the massive amounts of data produced by your connected devices and applications. Once collected into Event Hubs you can transform and store data using any real-time analytics provider or with batching/storage adapters.

Enable applications to process events with variable load profiles

Today’s connected world is defined by big data. Big data originates from many sources such as connected cars and thermostats that produce telemetry data every few minutes, application performance counters that generate events every second or mobile apps that capture telemetry for every user’s individual action. In this connected world, you need a managed ingestor service capable of elastic scale in order to accommodate variable load profiles as well as the spikes caused by intermittent connectivity.

Connect millions of devices across platforms

The rapid proliferation of connected devices raises challenges due to the variety of platforms and protocols involved. Connecting these disparate data sources while handling the scale of the aggregate stream is a significant challenge. Event Hubs provide easy provisioning of capacity to ingest events from millions of devices while preserving event order on a per device basis. Support for AMQP and HTTP allow many platforms to work with Event Hubs. Native client libraries also exist for popular platforms.

1941 questions
3
votes
0 answers

Event Hub Connection Pooling

I have an azure function that is receiving some payloads from a service, doing some basic operations on it and then forwarding it to an event hub. The solution works fine, but there are spikes in latency occurring quite often(every 10 minutes or…
3
votes
3 answers

Subscribe to Azure IoT Hub Device Events

I want to read the "Microsoft.Devices.DeviceConnected" events (https://learn.microsoft.com/en-us/azure/iot-hub/iot-hub-event-grid#event-types) from Azure IoT Hub. The only examples I found deals with Azure Event Grid but I'd rather like to use the…
binaryguy
  • 1,167
  • 3
  • 12
  • 29
3
votes
1 answer

Is it possible to receive events from Azure Event Hubs using REST API?

Is it possible to receive events from Azure Event Hubs using REST API? I have found only send event API in the Azure documentation. How to GET events?
Michael Chudinov
  • 2,620
  • 28
  • 43
3
votes
1 answer

Eventhub Trigger Setup Local Dev for VSCode

I've been banging my banging my head on this one all day but just can't get my local VSCode dev environment to handle EventHub triggering with the Python worker. Microsoft.Azure.WebJobs.Host: Error indexing method 'Functions.myfunctionname'.…
3
votes
1 answer

Azue Function V2 - Event hub trigger not respecting host configuration maxBatchSize

I have a function with a event hub trigger. That function is v2. That functions has event hub trigger. Host.json is the following { "version": "2.0", "extensions": { "eventHub": { "maxBatchSize": 1024, "prefetchCount": 1024, …
FEST
  • 813
  • 2
  • 14
  • 37
3
votes
1 answer

How to debug EventHubTrigger locally?

I'm trying to debug an Azure Function locally. It's an EventHubTrigger. The problem is that I need to debug the code locally because I still don't have the "real" settings. My code currently looks like this: public static class Notificator { …
SuperJMN
  • 13,110
  • 16
  • 86
  • 185
3
votes
1 answer

Tradeoffs involved in count of partitions of event hub with azure functions

I realize this may be a duplicate of Why not always configure for max number of event hub partitions?. However, the product has evolved and the defaults have changed, and the original issues may no longer be a factor. Consider the scenario where…
Ouananiche
  • 579
  • 5
  • 12
3
votes
1 answer

EventHub Register Processor inside Azure WebJob not working

I'm trying to take the load off my main server. For that I created a micro service to handle my printing task that was consuming a lot and was trying to integrate both by using Azure Event Hubs. The problem is, I can't seem to get the webjob to…
eestein
  • 4,914
  • 8
  • 54
  • 93
3
votes
1 answer

Event Hub Pointer w/ Azure Functions

I have asked this q on the microsoft docs, was then asked instead to post on msdn social forums, who then said i should post here... So, consider that i have an EventHub, & something happens / errors during working with that message, does the…
m1nkeh
  • 1,337
  • 23
  • 45
3
votes
2 answers

Azure Event Hubs for Kafka with 2 consumers from the same group rebalance infinitely

I use Azure Event Hubs for Kafka and Spring Kafka 1.3.5 (for compatibility reasons) on consumer site. Here is my config for that: @EnableKafka @Configuration class EventHubsKafkaConfig(@Value("\${eventhubs.broker}") val eventHubsBroker: String, …
Roman T
  • 1,400
  • 5
  • 18
  • 31
3
votes
1 answer

Event Grid "Microsoft.EventHub.CaptureFileCreated" event not published to Azure Function subscription

I am trying to develop an Azure Function to act upon a blob created by the Capture feature of an Event Hub. However, whereas capture blobs are correctly stored on the container, it seems that no Microsoft.EventHub.CaptureFileCreated event is…
3
votes
1 answer

Azure Functions - synchronization of trigger functions is not working

In this issue: Azure Functions - Event Hub not triggering Functions I described a problem with syncing event hub triggers and I managed to find a solution by simply invoking 'syncfunctiontriggers' action with Azure CLI: az resource invoke-action…
tommy vercetti
  • 307
  • 5
  • 16
3
votes
1 answer

How to process eventhub stream with pyspark and custom python function

My current setup is: Spark 2.3.0 with pyspark 2.2.1 streaming service using Azure IOTHub/EventHub some custom python functions based on pandas, matplotlib, etc I'm using…
3
votes
1 answer

RabbitMQ to Azure Event Hub: AMQP 0.9.1 compatibility with AMQP 1.0

I have a component that currently integrated with RabbitMQ. I would like to swap out RabbitMQ for Azure Event Hub as we are now in the cloud. Is AMQP 0.9.1 compatible with AMQP 1.0? Will the swap work seamlessly?
3
votes
2 answers

Azure Event Hub partition numbering & Sending to specific partition

I have a quick question about sending messages to a partition in an event hub in Azure. If you have 32 partitions in an event hub what is the numbering? Is it 0 to 31 or 1 to 32? I'm assuming 0 to 31 but I wanted to…
mike w
  • 101
  • 1
  • 10