[jira] [Comment Edited] (HIVE-13120) propagate doAs when generating ORC splits

["Sergey Shelukhin (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-13120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15645398#comment-15645398 ] 

Sergey Shelukhin edited comment on HIVE-13120 at 11/7/16 8:46 PM:
------------------------------------------------------------------

Updated the description with the callstack. The repro is not reliable since this is a concurrency issue... Running beeline repeatedly as two users (user1, then user2, then user1, etc.), with simple selects against two corresponding tables, such as that each user only has access to his own table, on fresh HS2, might do the trick. Running the same from multiple terminals in parallel might help too.

IIRC we have a backport to branch-1 lying around somewhere, I can try to find it if this is the issue you are hitting.


was (Author: sershe):
Updated the description with the callstack. The repro is not reliable since this is a concurrency issue... Running beeline repeatedly as two users (user1, then user2, then user1, etc.), with simple selects against two corresponding tables, such as that each user only has access to his own table, on fresh HS2, might do the trick. Running the same from multiple machines might help too.

IIRC we have a backport to branch-1 lying around somewhere, I can try to find it if this is the issue you are hitting.

> propagate doAs when generating ORC splits
> -----------------------------------------
>
>                 Key: HIVE-13120
>                 URL: https://issues.apache.org/jira/browse/HIVE-13120
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Yi Zhang
>            Assignee: Sergey Shelukhin
>             Fix For: 2.1.0, 2.0.1
>
>         Attachments: HIVE-13120.patch
>
>
> ORC+HS2+doAs+FetchTask conversion = weird permission errors, e.g. 
> {noformat}
> 2016-02-22 17:24:39,005 WARN  [HiveServer2-Handler-Pool: Thread-587]: thrift.ThriftCLIService (ThriftCLIService.java:FetchResults(681)) - Error fetching results:
> org.apache.hive.service.cli.HiveSQLException: java.io.IOException: java.lang.RuntimeException: serious problem
>         at org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:352)
> [snip]
> Caused by: java.io.IOException: java.lang.RuntimeException: serious problem
>         at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:508)
>         at org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:415)
>         at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:140)
>         at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:1720)
>         at org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:347)
>         ... 24 more
> Caused by: java.lang.RuntimeException: serious problem
>         at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.generateSplitsInfo(OrcInputFormat.java:1059)
>         at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getSplits(OrcInputFormat.java:1086)
>         at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextSplits(FetchOperator.java:363)
>         at org.apache.hadoop.hive.ql.exec.FetchOperator.getRecordReader(FetchOperator.java:295)
>         at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:446)
>         ... 28 more
> Caused by: java.util.concurrent.ExecutionException: org.apache.hadoop.security.AccessControlException: Permission denied: user=[snip], access=READ_EXECUTE, inode=[snip]
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)