Questions tagged [dataflowtask]
113 questions
0
votes
0 answers
I have an SSIS package with a SQL Task and a Data Flow Task and both are throwing connection errors
I have a SSIS package that I am running in VS2015 for testing. I connect to 3 different databases on 2 different SQL instances (default and a named instance). Running SQL2019 Standard. Any connection to the default instance run just fine. Any…
mikegrove
- 1
- 1
0
votes
2 answers
SSIS Ado.NET Source With Expression Fails Validation
I have a weird problem where I have a control flow like so:
And at the end a data flow like so:
I am trying to read data from a QuickBooks Desktop file but to make sure I don't unnecessarily run the Data Flow task, I first compare the modified…
Coda759
- 107
- 14
0
votes
1 answer
Why is STR Available Inconsistently?
When I create a OLE DB source, I can use the following expression:
STR(1234.545, 8, 2)
But when I use a Derived-Column flow task, that expression is illegal. The design-time error states:
The function "SET" was not recognized. Either the…
Brent Arias
- 29,277
- 40
- 133
- 234
0
votes
1 answer
SSIS - SQL Results with Individual Columns and Convert to JSON column to save in Destination table that has single JSON column
I am currently working on a SSIS package that gets results from two SQL tables and then performs a Merge JOIN to get a result set. This result will have around 50K rows and 10 columns. After this, I have to add a JSON column to each row because my…
Rahul
- 1
0
votes
2 answers
How to run some code at the end of pipeline
I have a requirement to update two tables at the end of the dataflow job pipeline(based on pipeline result).
I have put my logic to update to tables in finally block.
Here finally block is executing in parallel to the pipeline
Is there a way where i…
raj
- 1
- 1
0
votes
1 answer
SSIS Script Component convert Object type variable to Int Variable
I need to load data from ODBC source to OLEDB destination. The OLEDB destination table does not contain Identity column but it does have a Primary key column where the values has to be inserted similar to Identity column(increment it by 1).
I have…
Abhishek Dubey
- 1
- 1
0
votes
1 answer
SSIS Choosing Wrong Data Type
I've created a table in SQL Server 2016 with this definition:
CREATE TABLE Stage.Test (f1 DATE NULL);
INSERT INTO Stage.Test (f1) VALUES ('1/1/2000');
Notice the f1 column uses the DATE data type.
Then I created a data flow task in SQL Server Data…
user2148983
- 138
- 2
- 13
0
votes
1 answer
I want to define a variable globally but it should be initialized locally and the data should be the same for other classes
bool Globalveriable = false;
class Class1 extends StatefulWidget {
@override
_Class1State createState() => _Class1State();
}
class _Class1State extends State {
@override
Widget build(BuildContext…
Raj kumar patel
- 1
- 2
0
votes
2 answers
How can i run multiple queries in dataflow template?
I am performing Mysql to bigquery data migration using jdbc to bigquery template in dataflow.
But while performing "select * from teable1" command on mysql, i also want to insert the selected data to another table in same database for some…
Joseph N
- 540
- 8
- 28
0
votes
1 answer
Conditional Split in SSIS - SQL
I'm quite new to SQL Databases, but I'm trying to add a Conditional Split in my Data Flow between my Flat File Source and OLE DB Database to exclude records containing some special characters such as ø and ¿ and ¡ on the [title] column. Those are…
Dan Wilkin
- 23
- 1
- 4
0
votes
0 answers
Use destination flat file from one Data flow task as a source for another data flow task
How to use a text file generated as an output of one data flow as an input to another data flow task which will do the column mapping and push the records into a database table
MKJ
- 11
- 1
0
votes
0 answers
SSIS - Excel to txt file: how to obtain the same formatting as 'Results to Text' in SSMS?
I am creating a data flow with excel source and flat file destination.
When I create the flat file connection manager with the "Delimited" format I have no problems creating the txt file.
If I try instead to use the "Fixed width" (like it happens…
Pigna
- 2,792
- 5
- 29
- 51
0
votes
1 answer
service account execution batch dataflow job
I need to execute a dataflow job using a service account , I'm following a very simple and basic example wordcount offered within the same platform itself.
Which is weird is the error I'm getting:
According to this, GCP requires the service account…
Andres Urrego Angel
- 1,842
- 7
- 29
- 55
0
votes
0 answers
SSIS Rows Being Reduced From Original Amount
I can't seem to figure this out?
Out of the 28,804 rows I'm extracting from SQL Server to Insert into Excel Data Source I'm being limited to just 10,000 and I'm not sure why. On the Data Flow Task properties I've switched AutoAdjustBufferSize to…
Shaye
- 179
- 13
0
votes
2 answers
OLE DB Source to Excel Destination - Process is Stuck
I have the following Data Flow Task setup (see image).
It takes the correct amount of rows from the OLE DB Source and passes everything through the Data Conversion item. However, the process then gets stuck on 10,104 out of the 29,379 rows at the…
Shaye
- 179
- 13