Questions tagged [dataflowtask]
113 questions
1
vote
0 answers
How can I find all Sources and Destinations used in a SSIS package excluding disabled Data Flow Tasks
I have this requirement at work, I need to list all the sources and destinations used in multiple SSIS packages for Inventory purposes. The packages are old and they have a lot of Data Flow Tasks that are disabled plus they are complex.
The sources…
Nate
- 11
- 2
1
vote
0 answers
Getting Azure dataflow Log Filepath in ADF
I would like to get the Log file path of data flow activities which are generated by ADF. Does anyone know how to get that log file path location. I need to trace and maintain those log files.
Sree
- 33
- 1
- 7
1
vote
1 answer
How to use "Where" condition in Mongodb to bigquery dataflow template?
I have written python code for mongodb to bigquery data pipeline using apache beam (Dataflow Runner).
Mongodb has simple mysql like table with 2 columns (id and name) and No complex structure.My code is as below.
…
Joseph D
- 189
- 1
- 12
1
vote
1 answer
Why does the SSIS package fail when deployed to Integration Services Catalogs but runs fine on Visual studio?
I have a very simple SSIS package that takes data form an Excel sheet and dumps into a table. No Data conversion, a straight import. The package runs perfectly on Visual Studio but when deployed, I get the errors you see in the attached picture.
I…
Susie Dent
- 73
- 2
- 6
1
vote
2 answers
Is it possible to send mail from data flow pane in SSIS
In SSIS can we Send email using Data Flow Output Column.
And If Condition is Met I want to Send Email.
I want to is it possible?
If it is possible then how can we do that?
If anyone know please let me know..
Thanks in advance!
pinky adhikari
- 75
- 7
1
vote
2 answers
Extract and load data from multiple sources SSIS
I am planning to create a data warehouse and load data using SSIS from oracle to SQL Server. The latency time for the DWH is 5 minutes.
I need to run a package every 5 minutes for update_date_time on the source is between the last update and current…
Doodle
- 481
- 2
- 7
- 20
1
vote
1 answer
What is the simplest way to put Data Flow Task's name into Variable is SSIS ?
i have a package in SSIS where i try to put data flow task's into a variable, once the data flow tasks fails.
What is the best way to do that ?
Please share screen shots if you can,
thanks in advance,
erezlale
- 625
- 2
- 6
- 17
1
vote
1 answer
SSIS Flat File Source Not Splitting Column by Comma
I have a flat file connector in SSIS but for some reason it is not splitting the commas into columns. I have the column delimiter set to comma and you can see in "Column 0" there is commas "," however it just doesn't want to split them. Has anyone…
user2407147
- 1,508
- 2
- 22
- 40
1
vote
2 answers
SSIS Conditional Column Similar to Power Query
im a little new to SSIS coming from using Power Query in Excel a lot. Is it possible to create a conditional column in SSIS, similar to how you can in Power Query.
For example in Power Query you can create a conditional column to say IF column…
user2407147
- 1,508
- 2
- 22
- 40
1
vote
1 answer
How to programmatically set the AutoAdjustBufferSize property for a DataFlow?
How to programmatically set the AutoAdjustBufferSize property for a DataFlow? I.e.
MainPipe mp = ((TaskHost)p.Executables.Add("DTS.Pipeline")).InnerObject as MainPipe;
mp.AutoAdjustBufferSize = true;
Greg Spillman
- 13
- 2
1
vote
1 answer
Apache Beam Combine grouped values
I'm trying to find a way to re-order my Kafka messages and send ordered messages to a new topic using Apache Beam in conjunction with Google DataFlow.
I have Kafka publisher that sends String messages of the following…
MeetJoeBlack
- 2,804
- 9
- 40
- 66
1
vote
1 answer
SSIS PAckage ForEach Loop continue
I have a ssis package which exports data from excel files and dump it into a SQL Table. For processing files, I am using a foreach loop and a dataflow opens an excel source and dumps data into ole db destination. If any file is not containing the…
Mehwish
- 11
- 1
- 5
1
vote
0 answers
Select Query Failing in Execute Sql Task but not in DFT
I have a select query in Execute SQL TASK(EST) like
select * from table
The result set is "Full Result" and assigned to an object variable. When I execute the task, it fails and throws error saying
"SSIS debug host has stopped working"
The same…
Manoj Soundararajan
- 21
- 1
1
vote
1 answer
Send Row from one DataFlow Task to Another
In response to my deleted post
I am suspecting (I could be wrong) a way to transfer limited number of rows from 1 Dataflow Task to another is by using DataReader in the
first one and ScriptTask as Source in the second one.
I need to know how to…
N_E
- 743
- 10
- 16
1
vote
1 answer
Copying multiple tables using SSIS Package
I am trying to design an SSIS package which copy about 50+ tables from an ODBC DataSource (QuickBooks DB) to an SQL DB.
Should I create 50 Data Flow Task to do this ?
What is the best way to do this ?
Putting DFT inside a Loop, and reading the…
Yesudass Moses
- 23
- 1
- 6