Stack Overflow
Stack Overflow

Questions tagged [marklogic-dhf]

Use for questions about the MarkLogic Data Hub Framework. More people will see your question if you also tag it with "marklogic".

The MarkLogic Data Hub Framework is a data integration framework and tool-set to quickly and efficiently integrate data from many sources into a single MarkLogic database, and expose that data.

The MarkLogic Data Hub Framework lives at https://github.com/marklogic/marklogic-data-hub

190 questions
0
votes
1 answer

MarkLogic : Detailed logs for HTTP calls

MarkLogic version : 9.0-6.2 While calling Marklogic API (HTTP PUT) through an external tool (informatica), we are getting status code 500. To be able to debug, we are looking for logs that would show the URI along with the payload being sent through…
Bhanu
  • 427
  • 2
  • 8
0
votes
1 answer

I am trying to work with marklogic smart-mastering into my data-hub project keep getting an error

I copied the minimum-example folder content into my environment where I already installed ML9 and the DHF4. When I try to run the command to install the smart mastering I get an error - command not found. I am running on an EC2 server and issue the…
Tanya Rhodes
  • 1
  • 2
0
votes
1 answer

Set max size for MarkLogic log file(s)

We have some logfiles that will exceed the 1GB for a specific day in our development environment. Can we set a size limit, for example 250MB, so that the logfile will continue logging within a newly created log file when the size limit is reached.…
Gerben van Schoonhoven
  • 11
  • 1
0
votes
1 answer

XDMP-CONFLICTINGUPDATES error in Writer.sjs after updating to DataHub framework 4.1.0

I am using javascript for my harmonization that works fine in MarkLogic DHF 2.1.0. We recently upgraded to MarkLogic Data Hub Framework 4.1.0. The upgrade is causing problem as most of my documents are now NOT being harmonized. Harmonization runs…
Ryan
  • 175
  • 9
0
votes
1 answer

data hub hamonization schema not found

Using MarkLogic DHF, I am trying to invoke a json validation function from my harmonization flow. All works well in the rest of the flow except the validation function does not find the schema. The *-FINAL DB where the harmonized files end up has…
Paulwms
  • 95
  • 8
0
votes
0 answers

MarkLogic - Passing parameters to condition and action modules in CPF

I created a pipeline with a condition module and an action module. While coding for the condition and action modules, I need to pass some data from a different document to the condition module so that the expected condition could be evaluated to…
Bhanu
  • 427
  • 2
  • 8
0
votes
2 answers

MarkLogic CPF- condition module in pipeline

MarkLogic version : 9.0-6.2 All documents in our DB are JSONs and we use Javascript to manipulate data. I am trying to create a pipeline that identifies whenever a Phone Number in the JSON document is updated (using a condition module) and then runs…
Bhanu
  • 427
  • 2
  • 8
0
votes
1 answer

MarkLogic - Error with loading pipeline for content processing

MarkLogic version - 9.0-6.2 (on windows) I am following the guide (https://docs.marklogic.com/guide/cpf/quickStart) to perform the sample exercise provided. After installing CPF on data-hub-FINAL (with data-hub-TRIGGERS as the triggers db), I…
Bhanu
  • 427
  • 2
  • 8
0
votes
1 answer

MarkLogic - Auditing Requirements

MarkLogic version : 9.0-6.2 I apologize for the open-ended question, but looking forward to get some suggestions. We built DataHub Framework with staging and final databases. We save all the incoming changes AS-IS into staging and update the latest…
Bhanu
  • 427
  • 2
  • 8
0
votes
1 answer

MarkLogic - Deploy tasks using gradle

MarkLogic : 9.0-6.2 Data Hub Version : 2.0.6 I created a task to monitor backups and placed the file at \src\main\ml-config\tasks\taskmonitor.json I did a deploy (gradle mlDeploy), but how can I verify if the task has been created successfully? I…
Bhanu
  • 427
  • 2
  • 8
0
votes
1 answer

Marklogic URL encoding

MarkLogic version - 9.0-6.2 I have a custom REST end point that accepts phone number as a parameter. My requirement is to read this input phone number from the URL, compare with a phone number in the database and return Match/NoMatch. When I call…
Bhanu
  • 427
  • 2
  • 8
0
votes
1 answer

MarkLogic - Property Range Index on subset of documents in a database

MarkLogic version - 9.0-6.2 In our data-hub-FINAL database, every entity has a property called "TransactionRequestDtTm", which means, literally every document in the database has this property. For one specific collection, I have a requirement to…
Bhanu
  • 427
  • 2
  • 8
0
votes
1 answer

How to harmonize data inside FINAL database?

I am testing Quickstart UI to become familiar with DHF. In my understandings, default configuration have staging and final database. Input flow will place data in staging, then harmonize flow will create harmonized data inside final database. Now,…
user8420733
0
votes
1 answer

MarkLogic : Design question on Query Options Vs Transform

Our team creates a bunch of custom REST APIs (v1/resources/...) and expose them as enterprise services to other stakeholders, who do not need to know anything about MarkLogic. However, our team is responsible for creating, enhancing and maintaining…
Bhanu
  • 427
  • 2
  • 8
0
votes
1 answer

MarkLogic : Design question on search.search Vs CTS APIs

MarkLogic version 9.0-6 Our team creates a bunch of custom REST APIs (v1/resources/...) and expose them as enterprise services to other stakeholders, who do not need to know anything about MarkLogic. However, our team is responsible for creating,…
Bhanu
  • 427
  • 2
  • 8
1 2 3
…
12 13