Questions tagged [stream-analytics]
87 questions
1
vote
1 answer
Stream Analytics GetArrayElements as String
I have a Stream analytics job that gets the data from an external source (I do not have a say on how the data is being formatted). I am trying to import the data into my data lake, storing as a JSON. This works fine, but I also want to get the…
PaulFrancis
- 5,748
- 1
- 19
- 36
1
vote
1 answer
Specify timezone in Stream Analytics blob output?
When creating a Stream Job which outputs to Blob Storage, one has to specify a "Path Pattern", such as:
telemetry/{date}/{time}
This appears to be in UTC, and even when specifying just a {date}, the timezone is relevant.
What time is it using for…
JohnKoz
- 908
- 11
- 21
1
vote
1 answer
Syntax issue in Stream Analytics Query running in Azure: Invalid column name: 'payload'
I am having a syntax issue with my stream analytics query. Following is my Stream Analytics query, where i am trying to get following fields from the events:
Vehicle Id
Diff of previous and current fuel level (for each
vehicle),
Diff of current…
Reddy
- 1,620
- 6
- 26
- 33
0
votes
0 answers
How to make Azure stream analytics write output every fix interval of 15 minutes
I have a Azure Stream analytics job.
I want to make my job write output to my database(ADLS Gen2) every 15 minutes.
Any suggestions on this
I tried to check tumbling window but i guess it is for counting of events in a fix time.
GURMEET SINGH
- 11
- 1
0
votes
1 answer
calculate cummulative sum in azure stream analytics
Is it possible to calculate the cummulative sum over groups in azure stream analytics?
This is the input:
TMS product amount
2023-06-01 10:00:00 P1 10
2023-06-01 10:00:20 P2 …
josh66
- 1
0
votes
1 answer
Calculate volume weighted average price of trades based on the last traded 500 units of volume in azure stream analytics
I have streaming data coming from eventhub as follows:
product price quantity
1 55 100
2 44 200
2 43 200
1 60 300
2 55 100
2 44 50
2 47 100
1 44 …
josh66
- 1
0
votes
0 answers
Azure Stream analytics - Handle Same second records
I have a lot of telemetry data being sent by various sensors and it often happens that multiple parameters for a single device is changed within the same second (with millisecond differences). I want a method to merge these records for the same…
0
votes
1 answer
Get the period of events that are received within x time from each other
Given the following input:
[
{ "DeviceId" : "AA" : "Date": "2022-04-25 00:00:00", "Event" : 1}
{ "DeviceId" : "AA" : "Date": "2022-04-25 00:01:00", "Event" : 1}
{ "DeviceId" : "AA" : "Date": "2022-04-25 00:05:00", "Event" : 1}
{…
Faas
- 417
- 1
- 4
- 14
0
votes
1 answer
How to use configuration data in Azure Stream Analytics Job?
I have a Stream Analytics job streaming data from an EventHub. The job makes use of multiple Javascript functions to perform some calculations. I would like to pass in some configuration (preferrably JSON from Blob Storage) to those functions. Is…
Ezombort
- 1,892
- 3
- 16
- 20
0
votes
1 answer
Maximum Event Hub receivers exceeded. Only 5 receivers per partition are allowed
I have a Azure Stream Analytics job that receives some raw events, transforms them and then writes them to some different outputs. I get the following error:
Maximum Event Hub receivers exceeded. Only 5 receivers per partition are allowed.
Please…
Leon Cullens
- 12,276
- 10
- 51
- 85
0
votes
1 answer
Container Field under Storage Account Settings is not displayed
While creating a stream analytics job for IoT Edge, one needs to associate the job with a container in a storage account. In storage account settings under configure section of Stream Analytics Job - Container Field is not being displayed when "Add…
shravan_s46
- 1
- 1
0
votes
1 answer
How to prevent doubling values on Stream analytics due to blob input
We see an issue that on stream analytics when using a blob reference input. Upon restarting the stream, it prints double values for things joined to it. I assume this is an issue with having more than 1 blob active during the time it restarts.…
sandrews
- 1
- 2
0
votes
1 answer
Azure stream analytics with custom windows
I know stream analytics has several window funcitons. In my case I need to aggregate messages over a time window where a new window should start every time a field (or a combination of fields) change.
To make this concrete: suppose I have the…
Jan Bols
- 457
- 4
- 11
0
votes
1 answer
IoT Hub / Stream Analytics - SQL - Convert incoming timestamp to Date Time
I have a timestamp coming in as milliseconds after 01/01/1970 ([timestamp] below is the column name for the data), and need to add an additional column that uses SQL to take these milliseconds and convert it to a date/time format.
I have…
user14750197
- 3
- 1
0
votes
1 answer
Azure Stream Analytics: How can I update Query at runtime and Programmatically?
Every time I have to update the query of the Stream-Analytics service, I have to first stop it, update the query, and then start it back again. And all of this is done manually from the Azure portal.
This was the initial phase when I was exploring…
Manu Rastogi
- 188
- 1
- 7