Questions tagged [dataflowtask]

113 questions
1
vote
2 answers

Skip a Data Flow Component on Error

I want to skip a component of my data flow task, when this component throws a specific error. To be precise, I read data from different source files/connections in my dataflow and process them. The problem is that I can't be sure if all source…
Zahtu
  • 93
  • 4
1
vote
2 answers

Import XML with multiple Tables to SQL Server

I got XML with multiple tables to import to SQL Server to do this, I follow this steps: Add data flow task to control flow tab. On data flow tab (when double clicked the data flow task): Add XML source, configure the XML location and XSD…
Villapando Cedric
  • 289
  • 1
  • 4
  • 14
1
vote
0 answers

SSIS Package Hangs when trying to insert million of rows from a OLE DB Source

i have a package with a data flow task that has an OLE DB source and OLE DB Destination. In the OLE DB Source I have a SQL Command with Two Consequent Inserts of a Target table with help of Two Joins from a Table from different Database and other…
1
vote
1 answer

SSIS Data Flow performance slow vs select into

so I have a script: select * into my_archive_05302013 from archive_A where my_Date = '05/18/2013' and: insert into archive_B (ID,my_date,field_n ) select ID, my_Date,field_n from my_archive_05302013 where the n in field_n is about 100 or so. so…
user2129585
  • 259
  • 1
  • 4
  • 14
1
vote
2 answers

Export null values to Flat file Source

I have a package which will export data from a table into flat file destination. In another server the exported text file will import into a table. What actually my problem is , the package should export and import NULL as NULL and empty string as…
Maximus
  • 792
  • 9
  • 19
1
vote
2 answers

How do I get the name of the Data Flow Task component that triggered the OnTaskFailed Event?

I have a project to implement custom logging in our SSIS packages. I have a Data Flow task that moves data from several tables in one database to the corresponding tables in another database. If the move of Table A from database A to database B…
nleidwinger18
  • 169
  • 1
  • 2
  • 12
1
vote
1 answer

SSIS DataFlowTask using Record Sets instead of Records

I am using SSIS 2012 with a data flow task having a data source and an Ole DB Sql Task. The data source is creating a set of Id's { 1,2,3, etc } with the Ole DB Sql Task deleting a record in another database-table. What I am seeing in the Sql…
Marc Allen
  • 11
  • 1
1
vote
2 answers

SSIS 2005 - Have UPDATE *and* SELECT in OLE DB Source in Data Flow

This might be a dumb question, but I have a data flow task, OLE DB Source and Flat File Destination. In my OLE DB Source I'd like to have an UPDATE statement, and then a SELECT. When I do that, I don't seem to get any rows written to my Flat…
J Brun
  • 1,246
  • 1
  • 12
  • 18
0
votes
1 answer

Using an SSIS variable in a DataFlow task

I have and SQL Execute task that gets me a list of years and save them into a an object variable, let's say "Years". Then I have a ForEach Loop Counter that recieves thah variable, and inside that Counter I have a DataFlow task, what I want to do is…
user1112251
  • 119
  • 1
  • 4
  • 13
0
votes
1 answer

SSIS Data Flow Task indicates it wrote x rows, and reported no errors, but none of the rows appear in destination

This package had worked in the past but, for whatever reason, hasn't been working as intended recently. The package has a script task that sets a file path variable to the file path for the most recent csv file in a folder and then uses this file…
user3799279
  • 143
  • 1
  • 11
0
votes
1 answer

How to get 1st date of previous year in Azure Data Flow and how to use nested IF in data flow

I am working on Azure Data Flow and my requirement is to compare two date columns in derived column stage with an expressional and populate 0 or 1 based on that into another column. Conditions are: If (DateColumn1 >= 1st Jan of the previous year)…
Nezko1
  • 15
  • 4
0
votes
1 answer

Azure data factory - Data flow External call - specify response body schema

I .. simply do not understand what I should do with this. I have a REST call that gets the list of Projects. I set up that as a source to the data flow - having a Rest Linked service feed the data. The JSON from the REST call is list of Projects…
Dmitriy Ryabin
  • 363
  • 3
  • 16
0
votes
1 answer

ADF data flow etl schema mapping issue

I'm working with data flows in data factory to create a dynamic data flow which has parameterized source/sink/surrogate key names to reuse across many files and accomplishes the following tasks: Join source parquet to existing delta destination to…
Brian
  • 117
  • 1
  • 1
  • 6
0
votes
0 answers

How to implement conditional branching inside Data Flow Task of SSIS package?

In package i have one Data Flow task which execute an SQL query and return some columns. I want to check value of one of the Source column, whether it is 1 or 0. If the column value is 1, then insert the record in table Source_Error_tbl (redirect…
Tris
  • 7
  • 3
0
votes
2 answers

What is wrong in this statement for SSIS derived column transformation?

I am performing some transformation to create a derived column using SSIS derived column transformation task This column "Column" to be rounded 2 decimal and put space in front. I am using this statement: RIGHT("      …
AnS
  • 1