U-SQL is a query language designed for Azure Data Lake. It provides a way to mingle SQL keywords with syntactic C# expressions, so that within a single script, a programmer can schematize the data from an unstructured source, use SQL to aggregate the data into the desired form, and then write the output to a file or table.
Questions tagged [u-sql]
771 questions
-1
votes
1 answer
Joins in USQL scripts
Can we use "Between" condition in usql scripts when joining multiple tables. Below is the code snippet :
SELECT sf.ScoringFeedCode AS ScoringFeedCode,
mc.CalendarCode AS CycleCode,
mc.CalendarGUID AS CycleCalendarGUID,
…
-1
votes
3 answers
Remove double quotes from Data
I am getting data in csv file with double quotes around string columns but while reading csv file using U-sql i am getting errors because of double quotes in data as well.
I am thinking of replacing double quotes which is in data at first step then…
Raj
- 462
- 3
- 15
-1
votes
1 answer
Dynamically generate Extract scripts from metadata in USQL
I have a requirement to read metadata information that comes in json format and dynamically generate extract statements to further transform data for that table.
I have currently loaded metadata information in Azure SQL DB. So, I would need to read…
SDR
- 361
- 1
- 4
- 20
-1
votes
1 answer
USQL logging, debugging and troubleshooting
Is there any way to log and debug issues in an USQL Script?
Here I am not talking about the UDO.
In more detail I am extracting data from multiple data lake files and don't know which one file failed. I am wondering if there is a way to log from the…
Vanamali
- 47
- 5
-1
votes
1 answer
How to handle U-SQL error if the Table does not exist
How to handle U-SQL error (E_CSC_USER_DDLENTITYOFNEITHERTYPEEXISTS) if the table not exists.
How to use IF object_id('table1') Is not null in U-SQL?
T-SQL example:
if object_id('table1') Is not null
Select empName, empStoreNum, empSales, 'East' As…
starh
- 1
- 1
-1
votes
1 answer
Read Meta Data of files inside Azure Data Lake Store
Need to READ META DATA of files stored in Azure Data Lake Store.
File may be of format JPEG, EXCEL or TIFF
Please advise, really looking for suggestions. I am using Microsoft Azure Data Lake Store and using USQL.
Sgupta
- 23
- 4
-1
votes
1 answer
Azure u-sql Deployment issue using vsts
I'm building CI/CD for ADLA - USQL and having azure powershell scripts for deploying this release using VSTS and facing this below error while deployment -
The user is not authorised to perform this operation on storage.
I assume since I'm…
Arunachalam
- 47
- 7
-1
votes
1 answer
The target “Build” does not exist in the project working with Continuous integration with MSbuild for U-SQL
I am working with continous integration with vsts using MSBuild for U-SQL reffering the link : https://blogs.msdn.microsoft.com/azuredatalake/2017/10/24/continuous-integration-made-easy-with-msbuild-support-for-u-sql-preview/
But i am facing below…
Arun S
- 3
- 3
-1
votes
3 answers
Regular expression match U-SQL
I need a help in writing in U-SQL to output records to two different files based on a regular expression output.
Let me explain my scenario in detail.
Let us assume my input file has two columns, "Name" and person identification number ("PIN"):
Name…
Sreejith
- 19
- 3
-1
votes
1 answer
Delta Processing (Parallel execution issue)
Scenario:
We have "employees_final" ADLA catalog/table.
Users from various locations would be loading employees data into "employees_final" ADLA catalog/table "in parallel" through ADF invoking U-SQL.
When users are loading the data, it goes to…
Sha
- 31
- 4
-1
votes
1 answer
Azure Data lake packages
We have tried creation of packages in Azure data lake but we aren't able to declare the table valued function & Procedures ,Views in Azure data lake package.
If you can provide the code it will be very useful to us.
Adi
- 232
- 1
- 9
-1
votes
2 answers
Need localhost SQL Server Database information
Need localhost SQL Server Database information
piyush jain
- 113
- 8
-1
votes
1 answer
Handling Cosmos view in USQL
I was just exploring the USQL and thought one scenario where in I need reuse the existing Cosmos (scope) view in my USQL.
First thing , is it possible to consume the Scope view in USQL?
If its possible then how we can do that?
Thanks.
Abhi
- 341
- 1
- 6
- 23
-1
votes
1 answer
Remove invalid characters from value of json while creating JObject in USQL
In USQL I am reading csv file. It is telemetry data, so csv file may have any bad data. I am reading that csv file and creating JObject in USQL. I want to replace invalid characters from all values of json objects, so that my script will not fail…
Mahesh Dounde
- 91
- 12
-2
votes
1 answer
Query JSON nested objects using U-SQL
I am trying to get Country and Category from below.
I am able to get country but not Category.
Example input:
[{
"context": {
"location": {
"clientip": "0.0.0.0",
"continent": "Asia",
"country":…
Vatan Soni
- 540
- 2
- 11
- 23