You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by wangyum <gi...@git.apache.org> on 2018/08/15 00:51:45 UTC
[GitHub] spark issue #21734: [SPARK-24149][YARN][FOLLOW-UP] Only get the delegation t...
Github user wangyum commented on the issue:
https://github.com/apache/spark/pull/21734
Thanks @vanzin If there is a problem with a filesystem, it will take a long time to retry when get the delegation token.
The new approach is:
- Get all the delegation tokens by default.
- Only get the delegation tokens of the filesystem explicitly specified in `spark.yarn.access.hadoopFileSystems` to get better performance.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org