-1

We have used below command to mount Azure Blob as folder in CentOS Linux machine

    sudo blobfuse /mnt/azureblob/ --tmp-path=/mnt/resource/blobfusetmp  
    --config-file=/home/mladmin/fuse_connection.cfg 
    -o attr_timeout=240 -o entry_timeout=240 -o nonempty #
    -o negative_timeout=120 -o allow_other

Configuration file (fuse_connection.cfg) is as follows

accountName xxx
accountKey key
containerName container

During MLCP process, we are getting kind of below error XDMP-MERGESPACE: Not merging due to disk space limitations, need=4740MB, have=2739MB

So when we looked at it, we found that issue is with temp folder disk size.

We have moved to Azure to make sure that we do not have to worry about disk size. Now -tmp-path is mandatory, so question is how we can set -tmp-path to Azure blob ?

SumanthMarigowda-MSFT
  • 1,920
  • 9
  • 14
Manish Joisar
  • 1,256
  • 3
  • 23
  • 47

1 Answers1

2

For your issue, you need to understand that what does the tmp path mean, it means when you open the files in the blob that mount on your VM, then all the files opened will store in the tmp path. So the tmp path should have enough to store the open files.

Blobfuse stores all open file contents in the temporary path. Make sure to have enough space to accommodate all open files.

So with my suggestion, if you do not know how much space to store the open files, you can make sure the tmp path as big as your blob. For example, the blob is 5gb, so the tmp path should also have 5gb.

Charles Xu
  • 29,862
  • 2
  • 22
  • 39
  • Thanks Charles for your reply. Yes, so that means mounting as a drive thru Blobfuse will not provide much help here, as during sync or rebalancing process, MarkLogic can use the same size of data, for e.g. (>200 GB) during process in temp folder. so ultimately we are not getting much benefit in this case. BTW, i understood what you mean. – Manish Joisar Apr 03 '19 at 13:30
  • Thanks Charles for quick response. OK, It was helpful, i will accept. Just last question :), you mean same problem will not be there if i use File share instead of Azure Blob ? – Manish Joisar Apr 04 '19 at 03:59
  • 1
    @ManishJoisar Yes, The File Share do not need the tmp path and just as a remote file system that you can mount. – Charles Xu Apr 04 '19 at 04:05