U-SQL is a query language designed for Azure Data Lake. It provides a way to mingle SQL keywords with syntactic C# expressions, so that within a single script, a programmer can schematize the data from an unstructured source, use SQL to aggregate the data into the desired form, and then write the output to a file or table.
Questions tagged [u-sql]
771 questions
0
votes
1 answer
Passing properties to U-SQL activity through Azure Data Factory Pipeline through parameters?
I want to pass the slice start/end time properties of a pipeline to a U-SQL activity through the "parameters" property of the activity/pipeline.
The purpose is to generate dynamic file names based on the date the slice starts and orchestrate the…
Tayyab Anwar
- 319
- 1
- 10
0
votes
1 answer
Does data lake analytics has a support to create relational databases
It seems data lake analytics has a support to create databases but can we create relational databases too?
Ahsan Abbas
- 155
- 7
0
votes
2 answers
How to force file processing on one node without splitting?
Is it possible to force file processing on one node without splitting? I tried to use AtomicFileProcessing set on true, but it doesn't work.
mieszko91
- 43
- 1
- 9
0
votes
1 answer
XML Outputter adds extra non ascii character
I am using following XML outputter for writing xml files on basis of CSV data.
public override void Output(IRow input, IUnstructuredWriter output)
{
IColumn badColumn = input.Schema.FirstOrDefault(col => col.Type != typeof(string));
…
Muhammad Umar Farooq
- 521
- 9
- 23
0
votes
3 answers
Custom parallel extractor - U-SQL
I try create a custom parallel extractor, but i have no idea how do it correctly. I have a big files (more than 250 MB), where data for each row are stored in 4 lines. One file row store data for one column. Is this possible to create working…
mieszko91
- 43
- 1
- 9
0
votes
1 answer
ADLA/U-SQL Error: Vertex user code error
I just have a simple U-SQL that extracts a csv using Extractors.Csv(encoding:Encoding.[Unicode]); and outputs into a lake store table. The file size is small around 600MB and is unicode type. The number of rows is 700K+
These are the…
0
votes
1 answer
U-SQL Error Extracting from BCP CSV File
I have data that I extracted from SQL Server using BCP the file is ASCII CSV.
Dates in the 2016-03-03T23:00:00 format.
When running the extract I get
Additional information:…
Marcus.Kellermann
- 45
- 5
0
votes
1 answer
U-SQL: Schematized input files
How can I use schematized input files in an U-SQL script? That is, how can I use multiple files as input to an EXTRACT clause?
According to…
Frank im Wald
- 896
- 1
- 11
- 28
0
votes
1 answer
Can we process multiple rows using U-SQL User defined operators?
I was trying to develop U-SQL User defined operators using this link. It looks like we can read one row, process it and write it as a single row using UDO.
In my scenario I have to read multiple consecutive rows and write multiple consecutive rows…
Jamil
- 858
- 11
- 26
0
votes
2 answers
Writing SQL to U-SQL Query
Can anybody please guide me in writing this below SQL in U-SQL language used in Azure Data Lake
select tt.userId, count(tt.userId) from (SELECT userId,count(userId) as cou
FROM [dbo].[users]
where createdTime> DATEADD(wk,-1,GETDATE())
group…
Midhun Murali
- 2,089
- 6
- 28
- 49
0
votes
1 answer
Moving Data to Different Output folders based on column value
Now we have the Data in Azure Data Lake Store and now are processing the data present there with Azure Data Analytic Job with U-SQL. Now we have a requirement where we need to push data into different output folders based on the column value…
Midhun Murali
- 2,089
- 6
- 28
- 49
-1
votes
2 answers
ANTLR4 - Parse subset of a language (e.g. just query statements)
I'm trying to figure out how I can best parse just a subset of a given language with ANTLR. For example, say I'm looking to parse U-SQL. Really, I'm only interested in parsing certain parts of the language, such as query statements. I couldn't be…
kylemart
- 1,156
- 1
- 13
- 25
-1
votes
1 answer
special characters removal from text file using U-SQL
Can you please help me to remove the Special Character(”) from a text file using U-SQL.
@testResult =
SELECT Card_no,
Regex.Replace(Card_no, "s+|\\'|\\”", "9999") AS var4
FROM @testData;
getting the syntax error.
Thanks
-1
votes
1 answer
how to combine different schemas
I'm using a custom OUTPUTTER to generate XML from my "flat data" like so:
SELECT *..
OUTPUT @all_data
TO "/patient/{ID}.tsv"
USING new Microsoft.Analytics.Samples.Formats.Xml.XmlOutputter("Patient");
Which generates individual files that look like…
Alex Gordon
- 57,446
- 287
- 670
- 1,062
-1
votes
1 answer
Translate T-SQL Json query to USQL
Hi I am trying to translate this logic from T-sql json query to usql. But i am not able to achieve the same results. Any help will be appreciated.
select N'{
"rowid": "1",
"freeresponses": {
"fr1": "1.1",
"fr2": "1.1",
"fr3": "1.3",
…
Anbarasan Dhanushkodi
- 113
- 1
- 8