[jira] [Commented] (SLIDER-742) Slider AM secure configuration

["Steve Loughran (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SLIDER-742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14487108#comment-14487108 ] 

Steve Loughran commented on SLIDER-742:
---------------------------------------

# Slider 0.70 has a no-keytab option; the application will be unable to continue after 72 hours and the  HDFS tokens expire.
# Spark streaming does not do what you think it does. If you look at SPARK-5342 they are working to address this, with the experience we have in Slider helping guide it. What they are proposing is that the AM gets a keytab, the executors in the containers ask the AM for fresh tokens before the old ones expire. This works because the processes executed in the containers are part of spark and can be set up to do this. We can't do the same for things like HBase, which expect a keytab for refreshes.



> Slider AM secure configuration
> ------------------------------
>
>                 Key: SLIDER-742
>                 URL: https://issues.apache.org/jira/browse/SLIDER-742
>             Project: Slider
>          Issue Type: Bug
>          Components: appmaster
>    Affects Versions: Slider 0.60
>         Environment: Secured Hadoop
>            Reporter: Yang Hao
>
> Running in secured Hadoop cluster, when I don't set secured-related configuration for SliderAM, an error is out:
>  "hdfs://lgtst-xiaomi/user/h_yanghao3/.slider/cluster/hbase1/keytabs': No such file or directory".
> For the token has been sent to SliderAM working dir as file container_tokens. Can we use the feature what MapReduceAM  deals with this situation, which don't need the keytab file?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)