Questions tagged [azure-eventhub]

Microsoft Azure EventHubs is a highly-scalable high-throughput low-latency durable event ingestion system in Azure cloud. EventHubs serves as an event buffer for applications to process events with variable load profiles. Microsoft Azure Event Hubs is comparable to Apache Kafka or AWS Kinesis. This is a fully-managed service-offering built & run by the teams at Microsoft.

Microsoft Azure EventHubs is a highly scalable high throughput low latency durable event ingestion system in Azure cloud. EventHubs serves as an event buffer for applications to process events with variable load profiles.

Stream millions of events per second into multiple applications

Event Hubs is a highly scalable publish-subscribe ingestor that can intake millions of events per second so that you can process and analyze the massive amounts of data produced by your connected devices and applications. Once collected into Event Hubs you can transform and store data using any real-time analytics provider or with batching/storage adapters.

Enable applications to process events with variable load profiles

Today’s connected world is defined by big data. Big data originates from many sources such as connected cars and thermostats that produce telemetry data every few minutes, application performance counters that generate events every second or mobile apps that capture telemetry for every user’s individual action. In this connected world, you need a managed ingestor service capable of elastic scale in order to accommodate variable load profiles as well as the spikes caused by intermittent connectivity.

Connect millions of devices across platforms

The rapid proliferation of connected devices raises challenges due to the variety of platforms and protocols involved. Connecting these disparate data sources while handling the scale of the aggregate stream is a significant challenge. Event Hubs provide easy provisioning of capacity to ingest events from millions of devices while preserving event order on a per device basis. Support for AMQP and HTTP allow many platforms to work with Event Hubs. Native client libraries also exist for popular platforms.

1941 questions
0
votes
1 answer

Kafka send to azure event hub

I've set up a kafka in my machine and I'm trying to set up Mirror Maker to consume from a local topic and mirror it to an azure event hub, but so far i've been unable to do it and I get the following error: ERROR Error when sending message to topic…
FEST
  • 813
  • 2
  • 14
  • 37
0
votes
1 answer

Azure event hub: outgoing messages count is higher than incoming messages

Can someone please help me understand this? Why do I see the outgoing messages count is higher than incoming messages count in azure event hub.? Any help would be highly appreciated. Thanks.
user12852650
0
votes
1 answer

Is it possible to Stream from Kafka Cluster and send to Azure event Hub

We have a usecase where we need to consume the data from one of the Kafka Cluster on some Topic like 'daily-data' and we need to filter them and send it to a Azure Event Hub topic say 'our-daily-data'. By Default, kafka streams doesn't support…
satya
  • 109
  • 2
  • 14
0
votes
2 answers

Sending message to Azure Event Hub with nodemcu

I am trying to send messages to Azure Event Hub by using nodemcu (ESP8266). I am using REST API of the Azure Event Hub. I followed this instructions however I didn't worked for me. Currently, I am taking this response: 401 SubCode=40103: Invalid…
0
votes
3 answers

Receive and Delete messages from Event Hub

I know that the messages in an event hub expires after a certain period of time depending on how we configure it but is there any way we can delete the events received in an event hub through code or through configuration in the Azure portal as soon…
The Inquisitive Coder
  • 1,085
  • 3
  • 20
  • 43
0
votes
4 answers

Getting deviceId from Azure IotHub / EventHub

I am trying to read device Id from Event Hub (on the back of IoTHub) but my syntax in JS seems wrong. module.exports = function (context, IoTHubMessages) { context.log(`JavaScript eventhub trigger function called for message array:…
Mark
  • 1
  • 2
0
votes
2 answers

The type or namespace EventProcessorClient could not be found

I am starting off with Event Hubs with .Net Core and am facing a very peculiar issue when trying to write the same code as in the official MS documentation(https://learn.microsoft.com/en-us/azure/event-hubs/get-started-dotnet-standard-send-v2). The…
The Inquisitive Coder
  • 1,085
  • 3
  • 20
  • 43
0
votes
1 answer

How to install Diagnostic Extension on an multiple Azure IaaS VMs automatically once the VMs are provisioned and running

My customer needs to send Windows Event Log Diagnostic Data and perfmon logs to Azure Event Hub from Azure Diagnostic Data as only Azure Diagnostic Extension can send data to Event Hubs . I saw that there is a Policy that one can create in Azure…
Pallab
  • 1,915
  • 2
  • 19
  • 46
0
votes
1 answer

Is there a way to restrict the no of partitions initialize per consumer in Event hubs

I have a C# Windows Service which is installed in 3 different servers. All these 3 services are registering to the same event hub which has 8 partitions. In a way these 3 servers are my consumers. Once I start the windows service, multiple…
CrazyCoder
  • 2,194
  • 10
  • 44
  • 91
0
votes
1 answer

Synchronous message using list of threads in C#

I would like to send a list of messages to event hub in set number of threads i.e. 4 threads. I want the message to be send synchronously. The problem is that when I try to print out the payload some reason it does not print out the thread name,…
Ali
  • 33
  • 1
  • 9
0
votes
1 answer

How to disable other partitions to stop receiving messages when one partition is active in Azure event hubs

I have an application which is installed in 3 different servers.This application subscribes to a single Event hub. This event hub has 8 partitions. So when I start my application in all the 3 machines, all partitions are initialized randomly on all…
CrazyCoder
  • 2,194
  • 10
  • 44
  • 91
0
votes
1 answer

Difference between azure evenhub plugin and Filebeat azure module

I am trying to deploy elkstack on azure with eventhub in between for resiliency. To ship data from Eventhub to Logstash, I found 2 options azure evenhub plugin and azure module in filebeat. Not sure which one should I use and in which scenario. Also…
Swapan Sur
  • 71
  • 4
  • 13
0
votes
3 answers

In new version azure eventhub, how to close consumer_client after timeout

I am receiving data through azure eventhub and trying to close if I am receiving no more data for like 10 or 15 seconds. I tried to implement arguments auth_timeout and idel_timeout in _consumer_client, but neither worked. I am also referring to…
Brian Lee
  • 173
  • 3
  • 14
0
votes
1 answer

stream AAD sign-in logs to Eventhub and then reads log data from an event hub and forwards it to a specific endpoint exposed by Splunk

I have a requirement where we need to stream AAD sign-in logs to Eventhub and then reads log data from an event hub and forwards it to a specific endpoint exposed by Splunk. I believe below are the Azure components that are involved AAD Event…
user12852650
0
votes
0 answers

Synchronously call ProcessEventsAsync to receive messages in C#

I have Windows Service written in C#, which is subscribing to Event hubs and listening to them for any messages. The code I have followed is as follows: public class SimpleEventProcessor : IEventProcessor { public Task…
CrazyCoder
  • 2,194
  • 10
  • 44
  • 91