You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "bb (Jira)" <ji...@apache.org> on 2020/02/08 19:39:00 UTC

[jira] [Created] (ARROW-7805) Apache Arrow HDFS Remove (rm) operation defaults to SkipTrash

bb created ARROW-7805:
-------------------------

             Summary: Apache Arrow HDFS Remove (rm) operation defaults to SkipTrash
                 Key: ARROW-7805
                 URL: https://issues.apache.org/jira/browse/ARROW-7805
             Project: Apache Arrow
          Issue Type: Improvement
          Components: Python
    Affects Versions: 0.13.0
            Reporter: bb


The Pyarrow lib (using LIBHDFS) appears to default to a SkipTrash option (which is _not_ the Hadoop default behavior).  This turned out to be a pretty major issue for a project.  The HadoopFileSystem `delete` method currently has a default behavior of `recursive=False` I would believe a similar `skipTrash=False` default would be appropriate here.

 
{code:java}
# test to prove that default hdfs behavior moves a file to the Trash{code}
 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)