Stack Overflow
Stack Overflow

Questions tagged [u-sql]

U-SQL is a query language designed for Azure Data Lake. It provides a way to mingle SQL keywords with syntactic C# expressions, so that within a single script, a programmer can schematize the data from an unstructured source, use SQL to aggregate the data into the desired form, and then write the output to a file or table.

771 questions
0
votes
1 answer

Azure Data Lake Analytics and querying data from linked data source (blob)

I would like to access/read/store file from linked (external) blob storage account - not from primary data lake store account. I added a new Data Source (external blob) in Azure Portal. How can I specify that I need to read from external blob? I…
peterko
  • 503
  • 1
  • 6
  • 18
0
votes
1 answer

Is there any way to pass a U-SQL script a parameter from a C# program?

I'm using U-SQL with a table in Azure Data Lake Analytics. Is there any way to pass a list of partition keys generated in a C# program to the U-SQL script then have the script return all the elements in those partitions?
Justin Borromeo
  • 1,201
  • 3
  • 13
  • 26
0
votes
1 answer

ALTER TABLE REBUILD doesn't work in U-SQL

I'm trying to rebuild an U-SQL table with the expression: ALTER TABLE dbo.Content REBUILD; It doesn't work and returns the error: Scripts must contain at least one data write operation or one DDL operation. At least one data write or one DDL…
Valeri Ilyin
  • 49
  • 7
0
votes
1 answer

How to suppress returning a row in U-SQL IReducer

On a condition I want to suppress returning a row in code behind for U-SQL REDUCE, I am not able to figure out the return statement for that. To return a row as given in the documentation examples I used yield return…
Nasir
  • 167
  • 6
0
votes
1 answer

Run U-SQL Script from C# code with Azure Data Factory

I am trying to Run an U-SQL script on Azure by C# code. Everything is created on azure (ADF, linkedservices, pipelines, data sets) after code gets executed but U-SQl script is not executed by ADF. I think there is an issue with startTime and end…
Kishan Gupta
  • 586
  • 1
  • 5
  • 18
0
votes
1 answer

Can U-SQL EXTRACT Column Definition be specified as Table Type

I have defined a Table Type and wanted to use that with the EXTRACT statement instead of defining the same structure again as part of the EXTRACT. It doesn't seem to work for me, and documentation doesn't indicate if this is supported. Thanks, Nasir
Nasir
  • 167
  • 6
0
votes
1 answer

Azure Data Lake Analytics IOutputter E_RUNTIME_USER_ROWTOOBIG

I'm trying to write the results of my custom IOutputter to an intermediate file on the local disk. After that I want to copy the database file (~20MB) to the adl output store. Sadly the script terminates with: An unhandled exception of type …
coalmee
  • 1,334
  • 2
  • 16
  • 27
0
votes
1 answer

Azure Data Lake External Data Source: Row size is too big

I tried reading from an external Azure Sql Db both with CREATE EXTERNAL TABLE xyz ....FROM LOCATION "dbo.xyz" and SELECT * FROM ExternalDataSource EXECUTE @"SELECT a,b,c FROM dbo.xyz WHERE DATALENGTH(a)<128000" approaches and getting a Row size too…
chi
  • 471
  • 3
  • 18
0
votes
2 answers

Extract only required files in U-SQL

Is it possible to extract files only for 3 days, without extracting all the files. DROP VIEW IF EXISTS dbo.Read; CREATE VIEW IF NOT EXISTS dbo.Read AS EXTRACT Statements FROM …
Bond
  • 101
  • 1
  • 3
  • 15
0
votes
1 answer

Skip Line By Prefix

I've been trying to use Azure Data Lake Analytics to do some analysis over a large group of IIS log files. So far I can get this to work for a single, best-case file using something like this: @results = EXTRACT s_date DateTime, …
chris.house.00
  • 3,273
  • 1
  • 27
  • 36
0
votes
1 answer

No data output when extracting part of filename in U-SQL

When I do an extract from multiple files and include part of the filename in the fields list and in the FROM clause (e.g. FROM "/input/filename-{filedate:*}.nc"), the resulting output file only contains a header row. If I remove "filedate" from the…
Magnus Johannesson
  • 432
  • 7
  • 20
0
votes
1 answer

U-SQL skipping 0 Length Files

I am trying to skip 0 length files (files that exist but are 0 bytes) on input, I suspect there is already a feature to do this and I can't find the syntax.
Carolus Holman
  • 175
  • 9
0
votes
0 answers

Imperative USQL

How do I write control code for USQL? For example, move records between rowsets depending on the result of a query, and do this iteratively? Do I need to write a C# wrapper that dynamically generates and submits USQL? For example, imagine I am…
dashnick
  • 2,020
  • 19
  • 34
0
votes
1 answer

How can I Extract a Large json Array in U-SQL and Include meta-data?

I am trying to extract a large amount of Data from a json document. There are about 1500 nodes per json document. When I attempt to load the body node I get the 128KB limit error. I have found a way to load the node but I have to go all the way down…
Carolus Holman
  • 175
  • 9
0
votes
1 answer

Use information from custom extractor in custom outputter

I have implemented a custom extractor for NetCDF files and now I'm trying to implement a custom outputter for NetCDF files. When extracting from and outputting to NetCDF files, in the outputter I need to use some of the structural information found…
Magnus Johannesson
  • 432
  • 7
  • 20
1 2 3
…
51 52