The checkpoint path of flink is an hdfs absolute path like hdfs://address:port/path
, but when hdfs is on HA mode, how to set the flink configuration for hdfs namenode url change?
Using Hadoop HA ,clusterId is recommended.After doing so,the URI looks like this hdfs://nameservice_id/path/file.Use this URI instead of 'hdfs://activeNamenodeHost/path'.Hope this helps.
How to set here : NameNode HA when using hdfs:// URI.
More details here : https://hadoop.apache.org/docs/r2.7.0/hadoop-project-dist/hadoop-hdfs/HDFSHighAvailabilityWithQJM.html