Questions tagged [eventhub]

17 questions
0
votes
1 answer

How to replay the messages in azure eventhub

I have a azure eventhub and has multiple consumers for the eventhub. Checkpoint are available for these consumers. I would like to replay the messages for a specific consumer. How can I achieve this? and if it is by changing the sequence…
Madhu
  • 415
  • 1
  • 4
  • 15
0
votes
0 answers

Eventhub consumer skips messages

We're using a python event hub consumer client that reads from a topic containing 32 partitions. We've enabled checkpointing as per the documentation (that seems to work). Events get consumed via a singular client. The velocity of these small json…
Havnar
  • 2,558
  • 7
  • 33
  • 62
0
votes
1 answer

Want to use Faust with Event Hub kafka

We are migrating from kafka to eventhub and as eventhub itself uses kafka in background, we are trying to use our existing code using python "faust" with some connection changes to connect to eventhub, but it is somehow not working.(we don't want to…
0
votes
0 answers

How to validate each and every message on azure event hub for data reconciliation

I have a requirement where i have an azure function which emit event hub message for change in Cosmos DB trigger. So thousand of document can be modified in Azure cosmos DB which in turn will generate that many event hub messages. Is there a way to…
0
votes
1 answer

Azure Event Hub: How can I see what the Event Hub does?

I have inherited an Azure Event Hub as a ressource for management and usage. Unfortunately there is no documentation. I can only see a Event Hub Namespace Ressource and there is one Event Hub Entity, which is active. If I click on it, there is only…
AzUser1
  • 183
  • 1
  • 14
0
votes
1 answer

Receiving data using Kafa with an Azure Event Hub Connection String

Im new using these resources so please correct me if there is sth wrong or not possible. I have an event hub connection string and a namespace. Unfortunately I don't have access to the event hub itself. As far as I understand the event hub is…
0
votes
1 answer

Console Program stops after CreateBatchAsync for Event Hub

I'm trying to send events to an Azure Event hub by using the C# script from a Microsoft example. However after the line ...CreateBatchAsync the program stops and never gets to the next line. What is going wrong? this is the code from…
Ellen
  • 1
  • 3
0
votes
3 answers

Create an azure timer function to fetch events from Event Hubs for every 2 mins

Currently, I have a EventHub trigger function that triggers for every event and now my requirement has changed as I need to monitor 2 mins data that we receive and remove any noise from the data. So, Can we create timer function and receive batch…
sreddy
  • 15
  • 7
0
votes
0 answers

Got Future attached to a different loop when using eventhub aio in Fastapi python

I am using python 3.9, azure-eventhub 5.10.1, azure-eventhub-checkpointstoreblob-aio, and I have following code that throws the exception regularly (we also have lots of successful case that sends the message with no error), but also got the runtime…
0
votes
1 answer

How do i send data to specific partition (let's say partition 0) in event hub

i have created 2 partitions in event hub following the same code to send data to event hub https://github.com/Azure/azure-sdk-for-python/blob/main/sdk/eventhub/azure-eventhub/README.md#publish-events-to-an-event-hub below code i tried i was able to…
0
votes
0 answers

how to get the files from eventhub and load into azure data lake directly?

im getting files from eventhub , im continuosuly streaming data through pyspark code using below code: events = ( spark .readStream .format("eventhubs") .options(**ehConf) .load() .withColumn("body",…
karthik
  • 69
  • 5
0
votes
1 answer

Ingesting json message into even hub by using python

I am trying to ingest the json message into AZURE Event Hub My problem is size of json message since Event hub has a limit of 1MB I have one big json message which consists of multiple json message DATA = [{"Id": "393092", "UID": "7f0034ee", "date":…
Yoonsik
  • 1
  • 1
0
votes
2 answers

EventHub data bursty with long pauses

I'm seeing multi-second pauses in the event stream, even reading from the retention pool. Here's the main nugget of EH setup: BlobContainerClient storageClient = new BlobContainerClient(blobcon, BLOB_NAME); RTMTest.eventProcessor = new…
Dennis Cronin
  • 73
  • 1
  • 7
0
votes
0 answers

OutOfMemory using Azure eventhub messaging APIs

We are running a java application in Azure Kubernetes and using eventhub messaging libraries and checkpointing for consuming data from azure eventhub. Application reads data from eventhub and has some processing logic(including processing blob data)…
MKM
  • 1
  • 2
0
votes
0 answers

Health Check Endpoint

I need to create an azure function (HTTP Trigger) to perform healthcheck. It should return status code 200 if everything is ok and 500 if a problem occurred. [FunctionName("Name")] public static async Task Run( …
tulipe
  • 676
  • 2
  • 8
  • 22
1
2