Error while creating snapshot in fs in elasticsearch 7.3.2?

I am trying to create snapshot in elasticsearch i have defined the path.repo in elasticsearch.yml correctly pointing the folder elasticsearch_backup and it is having permissions

path.repo: /home/ubuntu/elasticsearch-backup

drwxr-xr-x 2 elasticsearch elasticsearch      4096 Dec 12 06:55 elasticsearch-backup/

I am using this api from kibana -

PUT /_snapshot/elasticsearch-backup
{
  "type": "fs",
  "settings": {
    "compress": true,
    "location": "/home/ubuntu/elasticsearch-backup"
  }
}

Then error which I am getting is -

{
  "error": {
    "root_cause": [
      {
        "type": "repository_verification_exception",
        "reason": "[elasticsearch-backup] [[5_cX7DhMSw2KgPrVMEm3Gg, 'RemoteTransportException[[elastic-data-node-02][MY IP.11:9300][internal:admin/repository/verify]]; nested: RepositoryVerificationException[[elasticsearch-backup] a file written by master to the store [/home/ubuntu/elasticsearch-backup] cannot be accessed on the node [{elastic-data-node-02}{5_cX7DhMSw2KgPrVMEm3Gg}{KF6p34P9TSyp81QJQ56kgQ}{MY IP.11}{MY IP.11:9300}{di}{ml.machine_memory=8339873792, xpack.installed=true, ml.max_open_jobs=20}]. This might indicate that the store [/home/ubuntu/elasticsearch-backup] is not shared between this node and the master node or that permissions on the store don't allow reading files written by the master node];'], [LhHj2udCRCWy7gt5iVQMsw, 'RemoteTransportException[[elastic-data-node-01][MY IP.10:9300][internal:admin/repository/verify]]; nested: RepositoryVerificationException[[elasticsearch-backup] a file written by master to the store [/home/ubuntu/elasticsearch-backup] cannot be accessed on the node [{elastic-data-node-01}{LhHj2udCRCWy7gt5iVQMsw}{S1TeQwE7Sjq6B__obrDEow}{MY IP.10}{MY IP.10:9300}{di}{ml.machine_memory=8339873792, xpack.installed=true, ml.max_open_jobs=20}]. This might indicate that the store [/home/ubuntu/elasticsearch-backup] is not shared between this node and the master node or that permissions on the store don't allow reading files written by the master node];']]"
      }
    ],
    "type": "repository_verification_exception",
    "reason": "[elasticsearch-backup] [[5_cX7DhMSw2KgPrVMEm3Gg, 'RemoteTransportException[[elastic-data-node-02][MY IP.11:9300][internal:admin/repository/verify]]; nested: RepositoryVerificationException[[elasticsearch-backup] a file written by master to the store [/home/ubuntu/elasticsearch-backup] cannot be accessed on the node [{elastic-data-node-02}{5_cX7DhMSw2KgPrVMEm3Gg}{KF6p34P9TSyp81QJQ56kgQ}{MY IP.11}{MY IP.11:9300}{di}{ml.machine_memory=8339873792, xpack.installed=true, ml.max_open_jobs=20}]. This might indicate that the store [/home/ubuntu/elasticsearch-backup] is not shared between this node and the master node or that permissions on the store don't allow reading files written by the master node];'], [LhHj2udCRCWy7gt5iVQMsw, 'RemoteTransportException[[elastic-data-node-01][MY IP.10:9300][internal:admin/repository/verify]]; nested: RepositoryVerificationException[[elasticsearch-backup] a file written by master to the store [/home/ubuntu/elasticsearch-backup] cannot be accessed on the node [{elastic-data-node-01}{LhHj2udCRCWy7gt5iVQMsw}{S1TeQwE7Sjq6B__obrDEow}{MY IP.10}{MY IP.10:9300}{di}{ml.machine_memory=8339873792, xpack.installed=true, ml.max_open_jobs=20}]. This might indicate that the store [/home/ubuntu/elasticsearch-backup] is not shared between this node and the master node or that permissions on the store don't allow reading files written by the master node];']]"
  },
  "status": 500
}

Solution

This might indicate that the store [/home/ubuntu/elasticsearch-backup] is not shared between this node and the master node or that permissions on the store don't allow reading files written by the master node

If you have multiple nodes and want to use the shared file system repository (fs), you need to have a... shared filesystem that all nodes have access to, otherwise this cannot work.

In order to register the shared file system repository it is necessary to mount the same shared filesystem to the same location on all master and data nodes.