Search code examples
apache-sparkamazon-s3hdfskerberosdistcp

Client cannot authenticate via: [TOKEN, KERBEROS)

From my spark application I am trying to distcp from hdfs to s3. My app does some processing on data and writes data to hdfs and that data I am trying to push to s3 via distcp. I am facing below error. Any pointer will be helpful.

org.apache.hadoop.security.UserGroupInformation doAs - 
PriviledgedActionException as: (auth:SIMPLE) cause:org.apache.hadoop.security.
Failed on local exception: java.io.IOException: 
org.apache.hadoop.security.AccessControlException:
Client cannot authenticate via: [TOKEN, KERBEROS);
Solution

  • I was already doing knit . Doing ugi.doAs new privilege action fixed this issue