Search code examples
azurecentosmarklogicazure-blob-storagemlcp

MarkLogic - Forest data folder & Azure Blob

Technical Stack

  • MarkLogic 9.0
  • Cenos Linux
  • Azure Blob
  • Blobfuse

To make sure we do not have to worry about data disk size for MarkLogic Forest, we have configured Azure Blob to one of folder in Linux machine, so we do not have to worry about disk size.

There are few things i noticed

  • Need to create folder in Linux
  • Create folder and point it to above folder
  • Then configure Blobfuse else we are getting permission denied while creating forest

Use below command to give permission to all

  • chmod 777 -R

Now when we started importing using MarkLogic Content Pump (MLCP)

19/03/15 17:01:19 ERROR mapreduce.ContentWriter: SVC-FILSTAT: File status error: stat64 '/mnt/mycontainer/Forests/forest-01/000043e5': Permission denied

So if you look at below image enter image description here

1st we tried with mycontainer but as soon as we map it to Azure Blob, it does not looks green as azureblob which is. We still need to map azureblob to "azureblob" folder.

It seems i am missing something here, anything to do with Azure Blob security settings?

Solution

  • First i would like to thanks Charles for his efforts and extended help on this issue, Thanks Charls :). I am sure this will help me sometime, somewhere.

    I got link on how to setup MarkLogic on Aure

    On Page No. 27, steps to Configuring MarkLogic for Azure Blob Storage

    In summary it is

    • Create Storage account in Azure
    • Create Blob container
    • Go to MarkLogic server (http://localhost:8001)
    • Go to Security -> Credentials
    • Provide Storage account and Azure storage key
    • While creating MarkLogic Forest, mentioned container path in data directory azure://mycontainer/mydirectory/myfile

    And you are done. No Blobfuse, no drive mount, just a configuration in MarkLogic

    Awesome!!

    Its working like dream :)