Related to Microsoft Azure Cloud Analytics system
Find more information about Azure Stream Analytics:
Questions tagged [azure-stream-analytics]
919 questions
3
votes
1 answer
Azure Event Hub to Stream Analytics with Partitions
Azure documentation states that:
Partitions are a data organization mechanism and are more related to the degree of downstream parallelism required in consuming applications than to Event Hubs throughput.
Assuming that the only consumer of the…
Paul Mooney
- 1,576
- 12
- 28
3
votes
1 answer
Latest value in PowerBi from ASA
Is it possible to show the latest value that has arrived in PowerBi from Stream Analytics?
In the card diagram type for example I imagine having a filter value for a measurementtime field selecting latest value or something?
Gökhan Kurt
- 531
- 5
- 13
3
votes
1 answer
Basic query with TIMESTAMP by not producing output
I have a very basic setup, in which I never get any output if I use the TIMESTAMP BY statement.
I have a stream analytics job which is reading from Event Hub and writing to the table storage.
The query is the following:
SELECT
*
INTO
…
dennis
- 562
- 6
- 21
2
votes
1 answer
Use Azure Stream Analytics Managed Identity to access SQL DB using terraform
There is an option to create Managed Identity from terraform for Stream analytics job (azurerm_stream_analytics_job, using identity block).
And it is possible to use Managed Identity to connect to databases (as explained here)
But I could not find…
JoeBloggs
- 89
- 7
2
votes
1 answer
Aggregate over batches of records
I would like to aggregate stream analytics records in batches of n records each with the following conditions:
each record can only be in a single batch.
each batch contains at most n records.
when the nth record of a batch arrives (or a timeout…
Max Tet
- 735
- 1
- 8
- 16
2
votes
1 answer
azure-streamanalytics-cicd failing when "SqlReferenceProperties" has "User" field populated
Trying to set up CI/CD pipeline for Azure Stream analytics following the doc and VS code with SA extension installed with one "Data Stream" input and one "Reference data" input (SQL database).
azure-streamanalytics-cicd build -project…
Alex Sysoiev
- 108
- 8
2
votes
1 answer
Unable to open or query .parquet files due to corrupted column
I am sending JSON telemetry data from Azure Stream Analytics to Azure Data Lake Gen2 serialized as .parquet files. From the data lake I've then created a view in my Azure Synapse Serverless SQL pool that I can connect to and query data for…
Josh L
- 1,412
- 2
- 18
- 40
2
votes
2 answers
Grafana as Azure Stream Analytics output
I am pushing events to my Event hub, then this data is being analyzed in Azure Stream Analytics. I'd like to visualize output from stream analytics in Grafana.
What is the easiest approach to achieve this?
deha
- 805
- 8
- 29
2
votes
1 answer
How to detect if no data ingested in any IoTHub Device using Stream analytics?
Basically I have multiple devices in IoTHub with 30 partition. Now, I want to detect if there is no data being ingested to any devices after 10 mins using Stream Analytics. Once detected, I want to select what device is it and send that information…
jtabuloc
- 2,479
- 2
- 17
- 33
2
votes
1 answer
ARM template for deploying and disabling Azure Stream Analytics Service
Is there a way we can deploy the stream analytics jobs in disabled mode through ARM template?
Jim
- 355
- 7
- 20
2
votes
2 answers
Azure Stream Analytics Reference Input Join
0
I am trying to use following query to join stream input (deviceinput) and reference input (refinputpdjson):
Following are my Inputs for Stream Analytics Job:
Input 1: Stream Input from IoT Hub
Input 2: Reference Data from Azure Blob Storage
SELECT…
Kamlesh Khollam
- 111
- 2
- 15
2
votes
1 answer
Azure Stream Analytics with two event hub inputs joins
I have two Event hub inputs (Event-A & Event-B) to azure stream analytics.
Input Event-A: Primary (whenever I am getting event from 'event-A' then I have to do joins with data from 'event-B' for last 20 minutes duration)
Input Event-B: Secondary…
user1531248
- 521
- 1
- 5
- 17
2
votes
1 answer
Hopping Window in Azure Stream Analytics
I try to get my head around the hopping window in azure stream analytics.
I'll get the following data from an Azure Event Hub:
[
{
"Id": "1",
"SensorData": [
{
"Timestamp": 1603112431,
"Type": "LineCrossing",
…
Link
- 1,307
- 1
- 11
- 23
2
votes
1 answer
What do the Azure Stream Analytics blob output schemaHashcode, Guid, and Number variables refer to?
In the Blob Output Configuration documentation for Azure Stream Analytics under "Path pattern" it is stated:
File naming uses the following convention:
{Path Prefix Pattern}/schemaHashcode_Guid_Number.extension
Example output…
Creyke
- 1,887
- 2
- 12
- 16
2
votes
1 answer
Call Azure Stream Analytics UDF with multi-dimensional array of last 5 records, grouped by record
I am trying to call an AzureML UDF from Stream Analytics query and that UDF expects an array of 5 rows and 2 columns. The input data is streamed from an IoT hub and we have two fields in the incoming messages: temperature & humidity.
This would be…
Sam Vanhoutte
- 3,247
- 27
- 48