Stack Overflow
Stack Overflow

Questions tagged [dataflow]

Dataflow programming is a programming paradigm in which computations are modeled through directed graphs: nodes are instructions and data flows through the connections between them.

Dataflow programming is a programming paradigm which models programs as directed graphs and calculation proceeds in a way similar to electrical circuits. More precisely:

  • nodes are instructions that takes one or more inputs, perform calculation on them and present the result(s) as output;
  • edges connects inputs and outputs of the instructions -- this way the output of an instruction can be fed directly to the input on another node to trigger another calculation;
  • data "travels" using the directed edges and triggers the instructions as they pass through the nodes.

Often dataflow programming languages are visual, the most prominent example being LabView.

Resources

1152 questions
0
votes
2 answers

ERD diagram Confusion

I am having a massive confusion as Im trying to develop an ERD Diagram and am confused by this statement. I am trying to relate two entities. they are "order" and "products". So im confused about the cardinality of these two. will it be 1 order will…
Sanjok Gurung
  • 948
  • 4
  • 17
  • 33
0
votes
1 answer

Splitting Field Value into Two Values from Excel Source and Mapping that Field to Two Fields in SQL-Server Using Same SSIS Package

I currently have an "ExcelSource" pointing to a "Derived Column" pointing to an "OLE DB Command". All my variables are mapped to the columns in my ExcelSource. My problem is in my DataFlow process. The column Im splitting up needs to be mapped to 2…
J.S. Orris
  • 4,653
  • 12
  • 49
  • 89
0
votes
2 answers

Spitting Value From One Field Into Two Values to be Used in Two Different Fields in SQL Server Using SSIS Package

I have fields in a column with values like the following: ABCDEFG:1234 I have a SSIS package that needs to split this value into two values like the following: ABCDEFG 1234 The ABCDEFG will be imported into Field1 and 1234 into Field2 I have the…
J.S. Orris
  • 4,653
  • 12
  • 49
  • 89
0
votes
1 answer

OLE DB to get BlobColumn Data in SSIS Dataflow

When I use ADO.net source in DataFlow to read Blob Column and pass it to Script Component to do further validations - need script compoment to do further validations on each column to generate master / child error records master (for each row) and…
Sreedhar
  • 29,307
  • 34
  • 118
  • 188
0
votes
1 answer

What does it mean when an object has multiple inputs?

I am a beginner at SSIS, and I am documenting and analyzing a control and data flow for a project. I am currently stumped by this part: In which order are these flows fired off? Does it occur exactly as shown? For example when the process on the…
Alex Gordon
  • 57,446
  • 287
  • 670
  • 1,062
0
votes
0 answers

Data shows in BIDS preview but won't load when running

Fairly new to SSIS and having a problem with one table on my raw and history loads. Loading from an interbase table to a SQL server 2008 R2 via SSIS. In BIDS I can preview the table and it shows data, but when I run the data flow task nothing loads…
bvankampen
  • 315
  • 1
  • 3
  • 6
0
votes
2 answers

SSIS:Which logging mechanism is better SQl server or Text File

SSIS has different logging mechanism. I am bit confused which logging mechanism should be used. Should I use SSIS log provider for text file or should I use SSIS log provider for SQL server. Which would give better performance? Or is there any…
Sachin
  • 57
  • 1
  • 1
  • 11
0
votes
2 answers

Need help for SSIS

We have one SQL Server job for transferring data from one sql server to other sql server m/c.Both m/c are situated at different location.Currently we using Linked server but it's performance is very slow. Hence we thought of transferring data using…
Sachin
  • 57
  • 1
  • 1
  • 11
0
votes
1 answer

Pentaho Kettle for Flow-Based Programming

Is Pentaho Data Integration aka Kettle suitable for Flow-Based Programming FBP? Kettle is an ETL(Extraction, Transformation and Loading) Tool and is based on FBP concepts There is User Defined Java Class step and has a SDK so you can extend Kettle…
Juan Rojas
  • 8,711
  • 1
  • 22
  • 30
0
votes
2 answers

c# Dataflow or Tasks, consuming messages to process in parallel

If I want to take messages from an external queue, say in Redis or similar. Is it it better to have one thread constantly checking the queue and sending messages to the relevant BroadcastBlock for processing (e.g.) if (message.type == "person") …
user2788307
  • 9
  • 1
0
votes
1 answer

VHDL code in NCLaunch giving errors not given in Xilinx

I am trying to make a dataflow design for a comparator in VHDL. It compiles and simulates fine in Xilinx, but I have to use Cadence/NCLaunch. When I copied the same code to gedit and ran it, it gives an error about a semicolon. my code is : library…
DDauS
  • 105
  • 1
  • 2
  • 11
0
votes
1 answer

SSIS - How do I join two sources on a complex expression?

I have one data source which has a column Part_Number. My second data source has Product_Family_ID, Product_ID and Part_Mask. Mask is a pattern string used in a like expression where part_number like mask. For instance 'NXA%' or…
The Evil Greebo
  • 7,013
  • 3
  • 28
  • 55
0
votes
2 answers

SSIS - write flat file header containing rowcount of the data file

I am creating an SSIS package that will write in the header of a text file STARTDATE|ENDDATE|ROWCOUNT followed by the results of a stored procedure. ROWCOUNT is the number of rows in the data set from the stored procedure. The data set is written…
unholymackerel
  • 89
  • 16
0
votes
1 answer

Master-detail migrate in SSIS 2008

I have two MSSQL 2008 databases dbA and dbB, dbA contains master-detail tables pair: AMaster, ADetail. Corresponding it dbB also contains BMaster and BDetail. The only one difference betwee A and B is type of primary key. In source database (dbA) it…
Dewfy
  • 23,277
  • 13
  • 73
  • 121
0
votes
1 answer

Building a data flow with SSIS

It has been a few months for me working with SSIS, I'm trying to implement a data flow to replace a sequence of SQL Tasks used to do some data transformation. Data flow description : Source : Each row gives information…
Yacine
  • 1
1 2 3
…
76 77