Questions tagged [procfwk]

ProcFwk is short for 'processing framework', although a generic concept this tag specifically relates to the open-source code project started by @mrpaulandrew. It offers a metadata driven approach to the orchestration of integration pipelines within the Microsoft cloud platform, using either Azure Data Factory or Azure Synapse Analytics control flow components. See procfwk.com for more details.

3 questions
1
vote
1 answer

Azure Data Factory Pipeline Orchestration Framework

I got around 9 source system (on premises / cloud based). Every source system has to end up in Raw zone of Data Lake for both Initial and Incremental Load. But few will go through standardisation zone and then to Staging (SQL Tables) which will be…
Sreedhar
  • 29,307
  • 34
  • 118
  • 188
0
votes
1 answer

InvalidPipelineNameError - Worker pipeline [Intentional Error] is not valid in target Orchestrator [MyOrchestrator]

I'm having trouble troubleshooting this issue I'm running into when trying to run the sample packages for the framework. For each infant package I get the following error: Operation on target Throw Exception - Invalid Infant failed: Operation on…
feemurk
  • 87
  • 3
  • 11
0
votes
1 answer

Grant the framework orchestrator access to itself for the 'Pipeline Already Running' utility

How do I grant the framework orchestrator access to itself allowing the 'Pipeline Already Running' to occur? In the documentation found here: https://mrpaulandrew.github.io/procfwk/pipelinealreadyrunning It states: Data Factory must explicitly be…
Paul Andrew
  • 3,233
  • 2
  • 17
  • 37