You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@gobblin.apache.org by "Tilak Patidar (JIRA)" <ji...@apache.org> on 2018/08/25 11:10:00 UTC

[jira] [Created] (GOBBLIN-568) FsDataWriter lacks support for multiple files per partition using record count or block size

Tilak Patidar created GOBBLIN-568:
-------------------------------------

             Summary: FsDataWriter lacks support for multiple files per partition using record count or block size
                 Key: GOBBLIN-568
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-568
             Project: Apache Gobblin
          Issue Type: Improvement
          Components: gobblin-core
            Reporter: Tilak Patidar
            Assignee: Abhishek Tiwari


Currently, FsDataWriter writer one file per partition which is not optimal when writing files like 
Parquet where one would want to land an optimal size either based on file size or records per file.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)