A system is to be designed where a number of sensors will transmit data to event hub. Each sensor will transmit number of data(max 15-20 (around 5 KB)) each second.
One use case is that all of these raw data has to be transmitted to cosmosDB with…
Say you have events telling you when given doors in a building are opened and closed and how long each door is allowed to remained opened before an alarm is triggered.
Something like: (might need a timestamp too on events...)
{ "id": 1,…
I am sending compressed Gzip stream to IoT hub and forwarding it to Azure stream analytics as input. I have configured ASA input endpoint with compression type Gzip and serialization type JSON, but it fails with error Invalid compression and…
I am working on anomaly detection using Azure Stream Analytics. I want to detect anomalies in request payloads passed to a Rest Api.
Azure Stream Analytics provides a built in function AnomalyDetection_SpikeAndDip, for detecting anomalies in the…
I have a large soap xml file with at least 10000+ transactions, that is stored in an azure blob.
I am reading the xml content from azure and have to send individual transaction to the server for processing.
How can I manage the records that are read…
I am facing some delay in event processing through stream analytics. I am working on an IoT Project and gateway is sending messages to IoTHub. Since we are dealing with different type of messages, through event hub end point we are routing the…
I need to Store data into Aure Data lake Store using Azure Stream Analytics and IoT Hub. I configured my input and my output in Azure stream Analytics, and wrote my query:
SELECT * INTO [output-ADLS] FROM [inputForIotHub]
It works fine and get my…
Is there a way to detect data quality issues from the streaming inputs (eventhub) (JSON) in Azure stream analytics?
Scenarios:
1) Bad messages: Blank records, NULLS/Spaces in key columns
2) values above expected Range, incorrect data type etc.
3)…
I have a scenario where event hub gets data in every 10 seconds, which pass to the stream analytics and then which is passed to the Azure SQL Server. The technical team raised the concerns that Azure SQL is unable to handler so much of data, if data…
I am working in streaming of data by using Azure Stream analytics job which will use T SQL Query. I Have the following Requirement:
I can do it by using case and sum statements, but I have lot of countries and issues (L3), so is there any pivot…
I need to send data from two devices to my Azure IOT hub.
Both of the devices transmit data with different JSON format. The common column between them is TimeStamp.
Now i need to consume and combine these two inputs and output my data into Power…
I am working with azure stream analytics query language and i have some problems with data preparation.this is my current output
but i want to combine data with same time
for example in first line
{"46027020",…
I found some tutorials that show a Simple "Device Monitoring" solution using IoTHub -> StreamAnalytics -> PowerBI here and here.
Tried setting up the System as said just use a different Accounts for Azure (private MSDN account) and PowerBI (Work…
I am having the same issues with powerBI ,seems the automatic refresh its failing ,i currently have to click refresh to see new data coming in ,i have configure the the tumblingwindow part e.g tumblingwindow(second,3),done the live to dashboard are…
I would like to know what is meant by an event in azure event hub.
I thought it's like getting some content(string) from source and process it by other services is one event.
if so, what is maximum content(string) I can send at one event