Stack Overflow
Stack Overflow

Questions tagged [marklogic-dhf]

Use for questions about the MarkLogic Data Hub Framework. More people will see your question if you also tag it with "marklogic".

The MarkLogic Data Hub Framework is a data integration framework and tool-set to quickly and efficiently integrate data from many sources into a single MarkLogic database, and expose that data.

The MarkLogic Data Hub Framework lives at https://github.com/marklogic/marklogic-data-hub

190 questions
0
votes
1 answer

Data Hub Framework and CPF

I am now studying about DHF. In my understandings, harmonization process should be done inside harmonize flow. I would like to leverage CPF for multiple binary transformation purpose, in this case what will be the best practice? The reason am asking…
user8420733
0
votes
1 answer

MarkLogic - Xpath on JSON document

MarkLogic Version: 9.0-6.2 I am trying to apply Xpath in extract-document-data (using Query Options) on a JSON document shown below. I need to filter out "Channel" property if the underneath property "OptIn" has a value of "True". { …
Bhanu
  • 427
  • 2
  • 8
0
votes
2 answers

MarkLogic - Query for multiple input values using search API

MarkLogic version 9.0-6.2 My need is to accept input (lets say PolicyId) in an array and return all the documents in the collection matching the list of PolicyIds. An element range index is created on PolicyId and I am able to do this with below…
Bhanu
  • 427
  • 2
  • 8
0
votes
1 answer

makeReferenceObject in harmonize flow - how to use the object reference?

In the DHF tutorial on harmonizing products and orders, products are included into orders by reference using SKU: https://marklogic.github.io/marklogic-data-hub/tutorial/harmonizing-order-data/ // or a reference to a…
Fan Li
  • 1,057
  • 7
  • 11
0
votes
2 answers

MarkLogic - Person name fuzzy match

We are using MarkLogic version 9.0-6.2 We have a requirement to match person names based on some fuzzy logic (For example, Mike and Michael are same). Each person has a first and last name. What is the best way to achieve this in MarkLogic. Does…
Bhanu
  • 427
  • 2
  • 8
0
votes
1 answer

Slow harmonization when using wildcard in MarkLogic

I am harmonizing documents in MarkLogic that completes within 26 mins without the snippets of wildcard code not being executed (commented out). When I execute the code below, the harmonization time is completed in a much longer time, 1 hour and 50…
Ryan
  • 175
  • 9
0
votes
1 answer

MarkLogic : DHF 4.0.0 Load Custom REST modules

We are using version 9.0.6 and DHF 4.0.0 I have a custom REST module in my data hub repository at ..\src\main\ml-modules\services\customModule.sjs When I run 'gradle mlLoadmodules' the build is successful but the module…
Bhanu
  • 427
  • 2
  • 8
0
votes
1 answer

MarkLogic deployment error '/config/query not found for write'

Version: 9.0.4 Deploying through gradle, using 'gradle mlDeploy' command. Error message com.marklogic.client.ResourceNotFoundException: Local message: /config/query not found for write. Server Message: Requ est failed. Error body not received…
Bhanu
  • 427
  • 2
  • 8
0
votes
0 answers

DHF and CPF/Alert configuration

I am using DHF and I have a usecase where I need to configure alerts for my final db. I am configuring via gradle both the cpf which is required by alerts and alerts. In my configuration, how can I tell that a given cpf is enabled only for my final…
Ravi
  • 1,179
  • 6
  • 13
0
votes
1 answer

Could MLCP Content Transformation and Triggers be used together during document ingestion?

As I understand, both the MLCP Transformation and Trigger can be used to modify ingested documents. The difference is that content transformation operates on the in-memory document object during the ingestion, whereas Trigger can be fired after a…
Fan Li
  • 1,057
  • 7
  • 11
0
votes
2 answers

Remove duplicate element parent name in MarkLogic Javascript

I am working on harmonizing data in MarkLogic using javascript. Currently, for my output, I am able to display all the child elements Activity but the problem is the parent Activities is also being displayed in duplicate. Here is the current…
Ryan
  • 175
  • 9
0
votes
1 answer

Change URI format during harmonization

I am currently working on MarkLogic using Data Hub. Is there a way you can change a document's URI during harmonization before it gets written to the Final Database? Current URI Format after Load: /Entity/123456.xml Desired URI Format after…
Ryan
  • 175
  • 9
0
votes
1 answer

How to pass data directly to final database in MarkLogic

Some of the data are just passed as is from the staging database to final database. Is there a way to load data directly into the final database? The goal is to reduce the total time processing during harmonization.
Ryan
  • 175
  • 9
0
votes
3 answers

Updating Data Hub Framework modules

MarkLogic Version : 9.0.6 After I installed version 9.0.6 on windows machine, I noticed that Data Hub Framework modules are created under C:\Program Files\MarkLogic\Modules\MarkLogic\data-hub-framework. Do these modules get imported into MarkLogic…
Bhanu
  • 427
  • 2
  • 8
0
votes
1 answer

How to execute any update statement from Collector.xqy in Data Hub Framework?

I am having a complete logic in which FIRST i need to modify or delete the document from both STAGING and FINAL Database and at last i need to insert the filtered data into my FINAL Database in DataHub Framework. I stamped my code inside…
Shalini
  • 348
  • 1
  • 12
1 2 3
…
12
13