You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Peng Zhen (JIRA)" <ji...@apache.org> on 2015/08/31 11:30:45 UTC

[jira] [Created] (SPARK-10363) DataframeWriter write failed when multi applications write the same partitioned directory

Peng Zhen created SPARK-10363:
---------------------------------

             Summary: DataframeWriter write failed when multi applications write the same partitioned directory
                 Key: SPARK-10363
                 URL: https://issues.apache.org/jira/browse/SPARK-10363
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 1.4.1
            Reporter: Peng Zhen


When multi applications write the same partitioned directory(but different partitions) at the same time, no mater what their partitioned keys are, they all create a temporary directory (_temporay) at the root directory. So this will cause APP-1's temporary output may be deleted by APP-2 and vice versa.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org