You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Till Rohrmann (JIRA)" <ji...@apache.org> on 2018/11/22 16:50:00 UTC

[jira] [Created] (FLINK-10989) OrcRowInputFormat uses two different file systems

Till Rohrmann created FLINK-10989:
-------------------------------------

             Summary: OrcRowInputFormat uses two different file systems
                 Key: FLINK-10989
                 URL: https://issues.apache.org/jira/browse/FLINK-10989
             Project: Flink
          Issue Type: Bug
          Components: Batch Connectors and Input/Output Formats
    Affects Versions: 1.7.0
            Reporter: Till Rohrmann


The {{OrcRowInputFormat}} seems to use two different {{FileSystem}}. The Flink {{FileSystem}} for listing the files and generating the {{InputSplits}} and then Hadoop's {{FileSystem}} to actually read the input splits. This can be problematic if one only configures Flink's S3 {{FileSystem}} but does not provide a S3 implementation for Hadoop's {{FileSystem}}.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)