You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "Kinga Marton (Jira)" <ji...@apache.org> on 2020/02/20 11:42:00 UTC
[jira] [Commented] (OOZIE-3586) Oozie spark actions using --keytab
fail due to duplicate dist. cache
[ https://issues.apache.org/jira/browse/OOZIE-3586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040882#comment-17040882 ]
Kinga Marton commented on OOZIE-3586:
-------------------------------------
[~jmakai] thank you for reporting this.
Please attach your patch to this Jira when you have one and set the status to patch available.
Also link the review Board review to it in case of bigger changes that need RB.
> Oozie spark actions using --keytab fail due to duplicate dist. cache
> --------------------------------------------------------------------
>
> Key: OOZIE-3586
> URL: https://issues.apache.org/jira/browse/OOZIE-3586
> Project: Oozie
> Issue Type: Bug
> Reporter: Janos Makai
> Assignee: Janos Makai
> Priority: Major
>
> In CDH 6.x, on the Hadoop 3 rebase, it is now a failure if items are added multiple times to the distributed cache. In CDH5, this was a warning. This is not an issue for most uses, as adding multiple times typically is user error, but this completely breaks Spark actions with keytabs (--keytab).
> Oozie spark actions add everything in the distributed cache of the launcher job to the distributed cache of the spark job, meaning the keytab is already there, then the --keytab argument tries to add it again causing the failure [0].
> [0]
> Caused by: java.lang.IllegalArgumentException: Attempt to add (.../filename.keytab#filename.keytab) multiple times to the distributed cache.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)