You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2022/09/29 12:58:00 UTC
[GitHub] [spark] attilapiros opened a new pull request, #38048: [WIP][SPARK-40612] Fixing the principal used for delegation token renewal on non-YARN resource managers
attilapiros opened a new pull request, #38048:
URL: https://github.com/apache/spark/pull/38048
### What changes were proposed in this pull request?
When the delegation token is fetched at the first time (see the `fetchDelegationTokens()` call at `HadoopFSDelegationTokenProvider#getTokenRenewalInterval()`) the principal is the current user but at the subsequent token renewals (see `obtainDelegationTokens()` where `getTokenRenewer()` is used to identify the principal) are using a Hadoop/Yarn specific principal even on resource managers different from YARN.
### Why are the changes needed?
To avoid `org.apache.hadoop.security.AccessControlException: Permission denied.` for long running applications.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Manually.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on pull request #38048: [SPARK-40612] Fixing the principal used for delegation token renewal on non-YARN resource managers
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on PR #38048:
URL: https://github.com/apache/spark/pull/38048#issuecomment-1262847129
Thank you for pinging me, @attilapiros .
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] attilapiros commented on pull request #38048: [SPARK-40612] Fixing the principal used for delegation token renewal on non-YARN resource managers
Posted by GitBox <gi...@apache.org>.
attilapiros commented on PR #38048:
URL: https://github.com/apache/spark/pull/38048#issuecomment-1262846571
cc @dongjoon-hyun @viirya
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on pull request #38048: [SPARK-40612] Fixing the principal used for delegation token renewal on non-YARN resource managers
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on PR #38048:
URL: https://github.com/apache/spark/pull/38048#issuecomment-1262847397
cc @gaborgsomogyi , too
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on pull request #38048: [SPARK-40612][CORE] Fixing the principal used for delegation token renewal on non-YARN resource managers
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on PR #38048:
URL: https://github.com/apache/spark/pull/38048#issuecomment-1264057675
Thank you, @attilapiros , @viirya , @HyukjinKwon , @weixiuli , @gaborgsomogyi ! Especially, @gaborgsomogyi !
Merged to master/3.3/3.2.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun closed pull request #38048: [SPARK-40612][CORE] Fixing the principal used for delegation token renewal on non-YARN resource managers
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun closed pull request #38048: [SPARK-40612][CORE] Fixing the principal used for delegation token renewal on non-YARN resource managers
URL: https://github.com/apache/spark/pull/38048
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org