[jira] [Commented] (HIVE-8424) Support fair scheduler user queue mapping in non-impersonation mode

["Szehon Ho (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-8424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14167346#comment-14167346 ] 

Szehon Ho commented on HIVE-8424:
---------------------------------

This looks to me, thanks for the fix.  +1 pending tests, and unless Prasad has more comments.

I had one suggestion that maybe it makes sense to do handle the case if the queues are reconfigured on Yarn side, by calling refresh before query submission itself instead of once per user session (if they are long lived), but this can be definitely done in follow-up Jira.  Feel free to file one if you agree.




> Support fair scheduler user queue mapping in non-impersonation mode
> -------------------------------------------------------------------
>
>                 Key: HIVE-8424
>                 URL: https://issues.apache.org/jira/browse/HIVE-8424
>             Project: Hive
>          Issue Type: Improvement
>          Components: Shims
>            Reporter: Mohit Sabharwal
>            Assignee: Mohit Sabharwal
>         Attachments: HIVE-8424.1.patch, HIVE-8424.patch
>
>
> Under non-impersonation mode, all MR jobs run as the hive system user. The default scheduler queue mapping is one queue per user. This is problematic for users who use the queues to regulate and track their MR resource usage.
> Yarn exposes an API to retrieve the fair scheduler queue mapping, which we can use to set the appropriate MR queue for the current user.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)