You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Benjamin Kietzman (JIRA)" <ji...@apache.org> on 2019/08/06 16:47:00 UTC
[jira] [Comment Edited] (ARROW-6055) [C++] Refactor arrow/io/hdfs.h
to use common FileSystem API
[ https://issues.apache.org/jira/browse/ARROW-6055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16901210#comment-16901210 ]
Benjamin Kietzman edited comment on ARROW-6055 at 8/6/19 4:46 PM:
------------------------------------------------------------------
In addition to removing io::FileSystem and io::FileStatistics, should HdfsPathInfo be replaced with fs::FileStats? It carries more information than fs::FileStats: last access time in addition to last modified time (though in seconds rather than ns since the epoch), block size, replication, and permissions. io-hdfs.pxi passes all of this for {{some_hdfs.ls(some_path, detail=True)}} but the docstring does not provide specifics about what metadata is guaranteed and test_hdfs.py doesn't even call {{ls(... detail=True)}}
was (Author: bkietz):
In addition to removing io::FileSystem and io::FileStatistics, should HdfsPathInfo be replaced with fs::FileStats? It carries more information than fs::FileStats: last access time in addition to last modified time (though in seconds rather than ns since the epoch), block size, replication, and permissions
> [C++] Refactor arrow/io/hdfs.h to use common FileSystem API
> -----------------------------------------------------------
>
> Key: ARROW-6055
> URL: https://issues.apache.org/jira/browse/ARROW-6055
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++
> Reporter: Wes McKinney
> Assignee: Benjamin Kietzman
> Priority: Major
> Fix For: 1.0.0
>
>
> As part of this refactor, the FileSystem-related classes in https://github.com/apache/arrow/blob/master/cpp/src/arrow/io/interfaces.h#L51 should be removed. The files should probably be moved also to arrow/filesystem
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)