Questions tagged [stream-analytics]

87 questions
1
vote
2 answers

Filter out duplicates in Stream Analytics

I am receiving data from some sensors trough a few different bridges. The data i receive contains a lot of duplicates. With the same serialNo, values, (almost) same datetime etc, but from different bridges. The data don't include some kind of unique…
1
vote
1 answer

Azure Stream Analytics How to handle more than 5 query?

I have created one ASA job and also created one input(eventhub) and 6 output(2 cosmos and 4 service bus queue) and Queries are like below. SA allows to write more than 5 query but giving error in activity logs.Because of which I am getting…
1
vote
2 answers

Terraform - Select GZIP compression option on an Azure Stream Analytics Input (Event Hub)

I need to set the Gzip compression option onto my EventHub input in a Stream Analytics job to get it to process. The documentation doesn't have "Compression" options available in the SA job Event Hub Input specification.…
1
vote
2 answers

Remove Duplicates from EventHub in Azure Stream Analytics

I have created an Azure stream Analytics Job which will get input data from EventHub and write to cosmosDB and Blob. I could see sometimes the data from eventHub is duplicating and as a result duplicate data will be written to cosmosDB and Blob…
Antony
  • 970
  • 3
  • 20
  • 46
1
vote
1 answer

Azure Analytics UDF

I would like to know if it is possible to have an user defined .js, to decode Base64 from my Json String in Stream Analytics. And how free am I to use any js function or is there a preset number of functions which can be used. I tried using atob(),…
1
vote
1 answer

Default field value if a condition satisfies in Azure Stream Analytics SAQL

I have a requirement to set value of one field as per value of another field available in the document. Below is the SAQL which I tried for obtaining the requirement. WITH INPUT01 AS ( SELECT input.id AS ID, ROUND(input.sig,5) AS…
Antony
  • 970
  • 3
  • 20
  • 46
1
vote
1 answer

Cant figure whichwindow to use in Azure Stream Analytics

I have created a stream analytic's job in Azure and i want to display the results in Power BI. The job is pretty simple since all i want to do is display every 1 sec the number of events which occured in the last 10 minutes. However, when the last…
1
vote
1 answer

Stream analytics - Pocessing JSON with no array name

I would like to convert this array to rows using a stream analytics query containing the CROSS APPLY GetArrayElements() but this function requires an array name. Obviously there is no name. Any suggestions? Example of JSON to parse : { "Alert1":…
1
vote
1 answer

Stream Analytics not processing instantly, constant 5 second watermark

We are trying to process event driven icons on a dashboard (on/off/active) with IoT hub, stream analytics, and table storage. I cannot get the actual process to work under 6 seconds. Watermark for stream analytics is a constant 5 seconds. The…
1
vote
1 answer

Azure Stream Analytics Query - get last request for all device

I have IoT Hub, it collects messages from many devices. Data from IoT Hub are sent to stream analytics, and now I would like to stream analytics, display a list of all devices along with the last request. That is, a table in which there are eg 10…
PawelC
  • 1,128
  • 3
  • 21
  • 47
1
vote
2 answers

How to read a large JSON file as input for Azure Stream Analytics

I am providing a JSON file of 5 MB size as input for Azure Stream Analytics and i am getting the below error. "selected file 'filename' must be between 1 and 2097152 bytes" Number of streaming units selected is 3. How to make Stream Analytics to…
Antony
  • 970
  • 3
  • 20
  • 46
1
vote
1 answer

ffprobe Fastest way to read video packets

I've been using ffprobe to read packets from video streams for analysis. However it's painfully slow. A 30min 720p video takes roughly 8min to read. I'm using the following command at the moment: ffprobe.exe -i video.mp4 -show_entries…
secondplace
  • 518
  • 3
  • 8
  • 20
1
vote
1 answer

Nested condition for Azure Stream analytics

I have 2 questions: Does azure Stream analytics support nested conditions using the CASE statement ? I see there are 2 formats of CASE expression mentioned here- https://learn.microsoft.com/en-us/stream-analytics-query/case-azure-stream-analytics .…
Rima
  • 545
  • 6
  • 12
1
vote
1 answer

Cast String to date time in Stream analytics Query

We are sending datetime as string in the format 2018-03-20 10:50:037.996, and we have written Steam analytics query as below. SELECT powerscout.Device_Id AS PowerScout, powerscout.[kW System], CAST(powerscout.[TimeStamp] AS datetime) AS…
1
vote
1 answer

azure stream analytics group multiple inputs to one output

i am working with azure stream analytics and want to group multiple inputs with same time to only one output. current output how can i modify my code that it prints for example in first…