Search code examples
apache-sparkoozie

failure to login: for principal: jztwk javax.security.auth.login.LoginException: Unable to obtain password from user

I use CDH 6.3.2

I sumbit oozie job with spark,but I get a error

..................................
    at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:141)
Caused by: org.apache.hadoop.security.KerberosAuthException: failure to login: for principal: jztwk javax.security.auth.login.LoginException: Unable to obtain password from user

    at org.apache.hadoop.security.UserGroupInformation.doSubjectLogin(UserGroupInformation.java:1992)
    at org.apache.hadoop.security.UserGroupInformation.getUGIFromTicketCache(UserGroupInformation.java:649)
    ........................................

    at org.apache.oozie.action.hadoop.SparkMain.run(SparkMain.java:93)
    at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:104)
    at org.apache.oozie.action.hadoop.SparkMain.main(SparkMain.java:60)
    ... 16 more
Caused by: javax.security.auth.login.LoginException: Unable to obtain password from user

but I can run spark-submit ..........

I can run spark-shell

in oozie hive,shell work

Solution

  • this is bug in spark,you need update spark 3.0 or CDH 6.3.3