You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Zhang Jianguo (Jira)" <ji...@apache.org> on 2020/12/17 09:53:00 UTC

[jira] [Created] (SPARK-33826) InsertIntoHiveTable generate HDFS file with invalid user

Zhang Jianguo created SPARK-33826:
-------------------------------------

             Summary: InsertIntoHiveTable generate HDFS file with invalid user
                 Key: SPARK-33826
                 URL: https://issues.apache.org/jira/browse/SPARK-33826
             Project: Spark
          Issue Type: Bug
          Components: Spark Core
    Affects Versions: 3.0.0, 2.3.2
            Reporter: Zhang Jianguo


*Arch:* Hive on Spark.

 

*Version:* Spark 2.3.2

 

*Conf:*

Enable user impersonation

hive.server2.enable.doAs=true

 

*Scenario:*

Thriftserver is running with loginUser A, and Task  run as User A too.

Client execute SQL with user B

 

Data generated by sql "insert into TABLE  \[tbl\] select XXX form XXXX." is written to HDFS on executor, executor doesn't know B.

 

*{color:#de350b}So the user file written to HDFS will be user A which should be B.{color}*

 

I also check the inplementation of Spark 3.0.0, It could have the same issue.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org