You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "mcdull_zhang (Jira)" <ji...@apache.org> on 2020/04/16 13:05:00 UTC

[jira] [Created] (SPARK-31459) When using the insert overwrite directory syntax, if the target path is an existing file, the final run result is incorrect

mcdull_zhang created SPARK-31459:
------------------------------------

             Summary: When using the insert overwrite directory syntax, if the target path is an existing file, the final run result is incorrect
                 Key: SPARK-31459
                 URL: https://issues.apache.org/jira/browse/SPARK-31459
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 2.4.5, 3
         Environment: spark2.4.5
            Reporter: mcdull_zhang


When using the insert overwrite directory syntax, if the target path is an existing file, the final operation result is incorrect.
At present, Spark will not delete the existing files. After the calculation is completed, one of the result files will be renamed to the result path.
This is different from hive's behavior. Hive will delete the existing target file.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org