Stack Overflow
Stack Overflow

Questions tagged [derived-column]

SSIS Derived Column Transformation is one of the SQL Server Integration Services that can be added within a Data Flow Task, it is used to add a new column to the data pipeline by applying SSIS expressions. The developer can choose whether to add a new derived column or to replace an existing column.

SSIS Derived Column Transformation is one of the SQL Server Integration Services that can be added within a Data Flow Task, it is used to add a new column to the data pipeline by applying SSIS expressions. The developer can choose whether to add a new derived column or to replace an existing column.

SSIS expressions are a combination of literals, functions, operators that yields a single data value. An expression can be composed of a single value (“abc”) or a variable (@[User::Variable1]) or a function (GETDATE()), or it can be more complex and contains some conditionals (CASE statement) or some mathematical operations or some string manipulation.

References

164 questions
0
votes
1 answer

Dataflow Derived Columns to parse complex array

can some help me to get the (nth-1) element in below complex arrays in ADF dataflow through derived columns: "Ranks": { "3760901": [ 6286064, 40635, 5712864, …
Andy
  • 405
  • 1
  • 5
  • 16
0
votes
2 answers

What is wrong in this statement for SSIS derived column transformation?

I am performing some transformation to create a derived column using SSIS derived column transformation task This column "Column" to be rounded 2 decimal and put space in front. I am using this statement: RIGHT("      …
AnS
  • 1
0
votes
1 answer

Azure Data Factory - replace expression in derived column transformation using Mapping Data Flow

I am trying to use Azure Data Factory for a Derived column transformation task one of my tasks is mentioned below, DESCRIPTION_TEXT : UNILEVER GROUP ##### GBR Remove trailing country code (only when it equals to country) and ##### if they exist My…
Rajkumar G
  • 3
  • 1
0
votes
0 answers

Following Statement in SSIS derived column

Name the second derived column SalesQtr. The data for this column should be extracted from the OrderDate field using a month function. You will need to build an “IF” statement around the month function that will check and assign the quarter value.…
vivek surya
  • 1
0
votes
1 answer

change the length of derived column in SSIS

I want to change the derived column's length in my SSIS package from 8 to 100 How can I do that?
Ravit Shagan Damti
  • 1
  • 1
0
votes
1 answer

Subtraction of dates with hours and minutes (result in float)

I would like some help with an SSIS problem. I have two columns, one with a date of when demand was open and another when the demand was responded to. My date comes in this way: DT_ANSWERED_DATE DT_CREATED_DATE 2021-02-04…
Roberta_Gomes
  • 1
  • 2
0
votes
0 answers

SSIS column skew-SSIS is concatenated to next column value to the current column when it finds the text deliminator in the column value itself

I have a ssis package which gets data from sql and dumps to CSV file. There are half a million of rows and almost 100 columns and when i dump the data to Flat file destination, some of the column values gets concatenated to the next column value as…
TheSacredKiller
  • 121
  • 3
  • 8
0
votes
0 answers

Spark SQL: Create constant value based on column in other table

I have two tables: (1) Line | ID | Client | | --- | ------ | | 0001| 0001 | | 0001| 0002 | | 0001| 0003 | Line holds all available clients for a specific ID (there can be more IDs) and is the base table. Shipping is a derived field…
rutgerv
  • 43
  • 10
0
votes
0 answers

SSIS Derived column throw's error for Decimal(17,2) datatype

Using ODBC Source to read data from Hadoop and insert them in OLE DB destination. Performing conversion operations on various columns using derived column on various column. I have Column "POPrice" in destination with datatype Decimal(17,2) and in…
user6787720
  • 33
  • 5
0
votes
2 answers

Adding a derived conditional column using dplyr

The initial dataset I am working with is a list of tarnatula prices overtime from two shops, one based in Canada and the other in Poland. In order to make a fair comparison between the two shops, I want to convert the Polish Zloty to USD, depending…
Bex Middleton
  • 17
  • 1
  • 7
0
votes
1 answer

How can we have column in oracle whose data is dependent on other column from other table and should honour all the updates on dependent table

Let's say I have two tables table A and table B and they have one to many relation. Table A col1 | Col2 Table B Col1 | Col3 Now I want to have a Col4 in Table A such that if any row of Col3 is true for a given Col1 value, then i want Col4 in Table…
Narahari
  • 21
  • 4
0
votes
1 answer

Combine the varying number of rows to one row in Data Factory in Azure

I am so new in Azure Data Factory, and I have a problem solving this problem. I wanted to combine varying number of rows in to one row base on the substring of the first column , I know that I can use collect() but the problem is I don't have a key…
Patty.G
  • 11
  • 4
0
votes
1 answer

Getting Data Lake Metadata in Azure Data Factory's Data Flow

I want to add the timestamp of copying parquet files to my dataframe in data flow as a derived column. In source module I can filter parquet files by last modified which makes me think that it should be possible to access files' metadata including…
ARCrow
  • 1,360
  • 1
  • 10
  • 26
0
votes
2 answers

calculate a derived column in sql

I have a following query which produces table below:- select * from temp_3 bucket values OTIF+2 319 OTIF 24987 null 1347 OTIF+>2 515 OTIF+1 552 Now I need the values to be in percentage of the total sum of…
noob_python
  • 25
  • 1
  • 7
0
votes
1 answer

Dynamic column masking in Azure with derived column

I am building a data flow within azure data factory and I would like to apply some GDPR masking rules within the flow. What I would like to do is the following: In the Derived Column (or other component) I would like to match my input columns with a…
mattssok
  • 1
  • 1
1 2 3
…
10 11