You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2019/06/14 13:52:00 UTC
[jira] [Work logged] (BEAM-7561) HdfsFileSystem is unable to match
a directory
[ https://issues.apache.org/jira/browse/BEAM-7561?focusedWorklogId=260430&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-260430 ]
ASF GitHub Bot logged work on BEAM-7561:
----------------------------------------
Author: ASF GitHub Bot
Created on: 14/Jun/19 13:51
Start Date: 14/Jun/19 13:51
Worklog Time Spent: 10m
Work Description: dmvk commented on issue #8849: [BEAM-7561] HdfsFileSystems.match can match a directory.
URL: https://github.com/apache/beam/pull/8849#issuecomment-502117178
nit: I'm curious whether it would be possible to abstract `FileSystems` test cases as it is an universal interface, to make sure that all impls. have correct behavior.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 260430)
Time Spent: 10m
Remaining Estimate: 0h
> HdfsFileSystem is unable to match a directory
> ---------------------------------------------
>
> Key: BEAM-7561
> URL: https://issues.apache.org/jira/browse/BEAM-7561
> Project: Beam
> Issue Type: Bug
> Components: io-java-hadoop-file-system
> Affects Versions: 2.13.0
> Reporter: David Moravek
> Assignee: David Moravek
> Priority: Major
> Fix For: 2.14.0
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> [FileSystems.match|https://beam.apache.org/releases/javadoc/2.3.0/org/apache/beam/sdk/io/FileSystems.html#match-java.util.List-] method should be able to match a directory according to javadoc. Unlike _HdfsFileSystems_, _LocalFileSystems_ behaves as I would so I'm assuming this is a bug on _HdfsFileSystems_ side.
> *Current behavior:*
> _HadoopFileSystem.match("hdfs:///tmp/dir")_ returns a _MatchResult_ with an empty metadata
> *Expected behavior:*
> _HadoopFileSystem.match("hdfs:///tmp/dir")_ returns a _MatchResult_ with metadata about the directory
> **
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)