U-SQL is a query language designed for Azure Data Lake. It provides a way to mingle SQL keywords with syntactic C# expressions, so that within a single script, a programmer can schematize the data from an unstructured source, use SQL to aggregate the data into the desired form, and then write the output to a file or table.
Questions tagged [u-sql]
771 questions
0
votes
1 answer
Create USQL Assembly from DLL in Azure Blob Storage
I'm trying to create a Data Lake Analytics database assembly from a DLL located in Azure Blob Storage.
According to the USQL language reference guide this is possible, although doesn't give any examples as to what needs to go into the FROM…
Paul Andrew
- 3,233
- 2
- 17
- 37
0
votes
2 answers
U-SQL Intellisense from Alias
If I use an Alias in U-SQL the intellisense doesn't prompt me for anything. For example,
@query =
SELECT PropertyOne,
PropertyTwo
FROM @some_table;
@intellisense_test =
SELECT PropertyOne
FROM @query;
In this case the…
Ben Kotvis
- 1
- 2
0
votes
2 answers
U-SQL script unable to compile after SDK update
My Data Lake Analytics (U-SQL) scripts stopped compiling after updating the Azure SDK and the Data Lake Tools for Visual Studio (2.2.2).
The Microsoft examples still compile successfully, so there must be something wrong with my project?
Error…
coalmee
- 1,334
- 2
- 16
- 27
0
votes
0 answers
U-sql error json
I'm trying to extract data from the Data Lake store, which are saved in the json. When I try to submit script I get the error:
Vertex failure triggered quick job abort. Vertex failed:
SV1_Extract[0] with error: Vertex user code error.
I will add…
Kamil
- 5
- 2
0
votes
2 answers
Removing null columns with U-SQL
I have many files that I'm attempting to join together. I happen to know that many of the columns in each of these files contain nothing but null values and I can do without having them in there. How can I write a U-SQL statement to extract the data…
Whit Waldo
- 4,806
- 4
- 48
- 70
0
votes
1 answer
Display JSON array elements as one line in U-SQL
How do I display each JSON array element as a comma separated element in one line, rather than one element per line, in U-SQL?
For example, the JSON file is:
{
"A": {
"A1": "1",
"A2": 0
},
"B": {
"B1": "1",
…
Alvin Chin
- 51
- 3
0
votes
2 answers
Reading in json file with encrypted content with U-SQL
I'm using this assembly as a json extractor and its all working fine. The json file that is my input is just plain json now. What i'm trying to do is read in a file with encrypted content.
So in the extractor I want to use my C# method that…
Luuk Gortzak
- 145
- 1
- 1
- 8
0
votes
0 answers
Azure Automation Error: Object reference not set to an instance of an object
I am trying to submit a U-SQL job using Azure Automation on a schedule. However, when I use the Submit-AzureRmDataLakeAnalyticsJob command, I get the following error:
Submit-AzureRmDataLakeAnalyticsJob : Object reference not set to an instance of an…
Pfav
- 23
- 4
0
votes
1 answer
Can't submit Data Analytics job in PowerShell Portal
Why can't I run the Submit-AzureRmDataLakeAnalyticsJob cmdlet in a PowerShell runbook via the Aure web portal? I get the following error message:
Submit-AzureRmDataLakeAnalyticsJob : The term 'Submit-AzureRmDataLakeAnalyticsJob' is not recognized…
AyeMarciMar
- 11
- 5
0
votes
2 answers
Managing U-SQL scripts in multiple files and run it as a single job
We wrote a big U-SQL script that consists of several units of code dependent on each other. It could run as a single U-SQL job. BTW, we are running this job as Azure Data Factory activity.
We want to divide this script into multiple U-SQL scripts…
Jamil
- 858
- 11
- 26
0
votes
2 answers
System Error Running U-SQL Script Locally
When I attempt to run a U-SQL script locally, I get the following error :
Start : 7/1/2016 12:53:49 PM
Initialize : 7/1/2016 12:53:49 PM
GraphParse : 7/1/2016 12:53:49 PM
Run : 7/1/2016 12:53:49 PM
Start 'Root' : 7/1/2016 12:53:50 PM
End…
Pfav
- 23
- 4
0
votes
1 answer
I can SELECT from parameterized TVF in U-SQL but cannot CROSS APPLY
I can select from a parameterized Table Value Function in U-SQL, but I can't seem to use it in a CROSS APPLY. See @query1 where I can do a basic select from my TVF. See @query3 for my workaround using SQL.MAP. See @query2 which doesn't work and is…
Jason
- 562
- 2
- 5
- 13
0
votes
1 answer
Inserting data to U-SQL tables is taking too long?
Inserting data to U-SQL table is taking too much time. We are using partitioned tables to recalculate previously processed data. Insertion for the first time took almost 10-12 minutes on three tables with 11, 5 and 1 partitions and parallelism was…
Ahsan Abbas
- 155
- 7
0
votes
1 answer
Header row not appearing at the top of CSV while using Outputters
In u-sql query dumping data from one csv file to another through Outputterss.Csv() function but header row with column names is appearing at the end of file instead of top.Please find my code below.Thanks for the help.
@telDataResult=
SELECT…
user3714403
- 101
- 12
0
votes
1 answer
Need to fetch n percentage of rows in u-sql query
Need help in writing u-sql query to fetch me top n percentage of rows.I have one dataset from which need to take total count of rows and take top 3% rows from dataset based on col1. Code which I have written is :
@count = SELECT…
user3714403
- 101
- 12