Flink checkpoint on hdfs of HA namenode config

Question

The checkpoint path of flink is an hdfs absolute path like hdfs://address:port/path, but when hdfs is on HA mode, how to set the flink configuration for hdfs namenode url change?

Answer 1

Using Hadoop HA ,clusterId is recommended.After doing so,the URI looks like this hdfs://nameservice_id/path/file.Use this URI instead of 'hdfs://activeNamenodeHost/path'.Hope this helps.

How to set here : NameNode HA when using hdfs:// URI.

More details here : https://hadoop.apache.org/docs/r2.7.0/hadoop-project-dist/hadoop-hdfs/HDFSHighAvailabilityWithQJM.html