Questions tagged [azure-eventhub]

Microsoft Azure EventHubs is a highly-scalable high-throughput low-latency durable event ingestion system in Azure cloud. EventHubs serves as an event buffer for applications to process events with variable load profiles. Microsoft Azure Event Hubs is comparable to Apache Kafka or AWS Kinesis. This is a fully-managed service-offering built & run by the teams at Microsoft.

Microsoft Azure EventHubs is a highly scalable high throughput low latency durable event ingestion system in Azure cloud. EventHubs serves as an event buffer for applications to process events with variable load profiles.

Stream millions of events per second into multiple applications

Event Hubs is a highly scalable publish-subscribe ingestor that can intake millions of events per second so that you can process and analyze the massive amounts of data produced by your connected devices and applications. Once collected into Event Hubs you can transform and store data using any real-time analytics provider or with batching/storage adapters.

Enable applications to process events with variable load profiles

Today’s connected world is defined by big data. Big data originates from many sources such as connected cars and thermostats that produce telemetry data every few minutes, application performance counters that generate events every second or mobile apps that capture telemetry for every user’s individual action. In this connected world, you need a managed ingestor service capable of elastic scale in order to accommodate variable load profiles as well as the spikes caused by intermittent connectivity.

Connect millions of devices across platforms

The rapid proliferation of connected devices raises challenges due to the variety of platforms and protocols involved. Connecting these disparate data sources while handling the scale of the aggregate stream is a significant challenge. Event Hubs provide easy provisioning of capacity to ingest events from millions of devices while preserving event order on a per device basis. Support for AMQP and HTTP allow many platforms to work with Event Hubs. Native client libraries also exist for popular platforms.

1941 questions
4
votes
1 answer

Failure while sending batch events to azure eventhub

I'm trying to send a batched events using Microsoft.Azure.EventHubs call "SendAsync(IEnumerable)". Is this a transactional operation i.e. is there possiblity of partial success/failure? Is there any official documentation confirming that there will…
4
votes
1 answer

Client vs Publisher in Azure Event Hubs

Azure Event Hubs' documentation mentions such terms as client and publisher. For example, here The Event Hubs security model is based on a combination of Shared Access Signature (SAS) tokens and event publishers. An event publisher defines a…
Ingweland
  • 1,073
  • 1
  • 13
  • 25
4
votes
1 answer

Connect to Azure IoT/Event hub from browser side

Is there any javascript sdk or library available to connect to Azure IoT or Event hub from Browser side? I would like to avoid the latency involved in the redirection of the messages from Web application to browser in connecting to the Event hub…
KDR
  • 478
  • 6
  • 19
4
votes
1 answer

On listening from Azure Event Hub I am getting error

On listening from Azure Event Hub I am getting error The supplied offset XXXXX is invalid. The last offset in the system is XXXXX Error on Partition 1: The AMQP Object session is aborted. Error on Partition 0: The supplied offset is invalid.
4
votes
3 answers

How to use listkeys function in an ARM Template with Event Hub

I have an event hub that looks like this: I have successfully done it for service bus, but only for the high level RootManageSharedAccessKey. However with Event Hub I want the primary connection string for the SendOnly shared access policy. I…
4
votes
1 answer

Azure - Logging Request Details to EventHub from API Management

The basic example provided by Microsoft when I add the Log to EventHub action to my Incoming processing is useful but I want to be able to log the Request Content and Content Length. Currently I cannot find any documentation or definitions of the…
Mr_road
  • 554
  • 6
  • 25
4
votes
2 answers

Azure Functions Event Hub trigger bindings

Just have a couple of questions regarding the usage of Azure Functions with an EventHub in an IoT scenario. EventHub has partitions. Typically messages from a specific device go to the same partition. How are the instances of an Azure Function…
Helikaon
  • 1,490
  • 13
  • 30
4
votes
2 answers

Can I set EventData.PartitionKey while sending to EventHubs using a PartitionSender?

I currently have an EventHub instance set up in Azure. It has 5 partitions. What I want to know if if the PartitionKey always has to be a number between 0 and n-1 with n being the number of partitions. I have the following code: private static…
David Pilkington
  • 13,528
  • 3
  • 41
  • 73
4
votes
1 answer

HTTP POST between Postman and EventHub

Can someone help me. I want to send data from Postman (Chrome APP) to my EventHub via HTTP POST. I was successful a while ago but have lost the documentation. I have the following credentials: EventHub URL in the form…
Joe
  • 123
  • 2
  • 3
  • 10
4
votes
2 answers

How to use client-side event batching functionality while Sending to Microsoft Azure EventHubs

I'm dealing with a high throughput application of EventHub. According to the documentation, in order to achieve very high throughput from a single sender, then client-side batching is required (without exceeding the 256 KB limit per event). Best…
Attila Cseh
  • 235
  • 2
  • 13
4
votes
5 answers

Connect Azure Event Hubs with Data Lake Store

What is the best way to send data from Event Hubs to Data Lake Store?
irriss
  • 742
  • 2
  • 11
  • 22
4
votes
2 answers

Stable Node JS AMQP 1.0 Client (Event Hub)

I'm looking for a stable AMQP 1.0 client for NodeJS so that I can consume events from Azure Event Hubs. I have tried using https://github.com/noodlefrenzy/node-amqp10, but it chokes sporadically on certain payloads with messages like malformed…
Ian Walker-Sperber
  • 3,661
  • 2
  • 14
  • 18
4
votes
1 answer

Relationship between Azure EventHub and ConsumerGroups

Please just help me clarify this. When processing events from an Azure Event Hub, and creating a EventProcessorHost using a ConsumerGroupName X. If I do this on multiple processes (not threads), and I create multiple EventProcessorHost all with…
Daniel van Heerden
  • 836
  • 1
  • 7
  • 25
4
votes
2 answers

Does Azure Event Hub guarantees at least once delivery?

I'm building an azure web application, I'd like to send the activity logs to Azure Event Hub. What happen if the connection between the application host and the event hub is lost? Does the Event Hub client implement some kind of local queue?
user1075679
  • 287
  • 1
  • 2
  • 13
4
votes
2 answers

How to get Azure EventHub data using node js

I am a beginner in Microsoft event hub. I am successfully sending data to eventHub using node js(refrence). How to receive and display the data from event hub? Any idea?
Abdul Manaf
  • 4,933
  • 8
  • 51
  • 95