You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@gobblin.apache.org by "Tilak Patidar (JIRA)" <ji...@apache.org> on 2018/08/26 14:27:00 UTC

[jira] [Commented] (GOBBLIN-568) FsDataWriter lacks support for multiple files per partition using record count or block size

    [ https://issues.apache.org/jira/browse/GOBBLIN-568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16592908#comment-16592908 ] 

Tilak Patidar commented on GOBBLIN-568:
---------------------------------------

PR link [https://github.com/apache/incubator-gobblin/pull/2433|https://github.com/apache/incubator-gobblin/pull/2433]

> FsDataWriter lacks support for multiple files per partition using record count or block size
> --------------------------------------------------------------------------------------------
>
>                 Key: GOBBLIN-568
>                 URL: https://issues.apache.org/jira/browse/GOBBLIN-568
>             Project: Apache Gobblin
>          Issue Type: Improvement
>          Components: gobblin-core
>            Reporter: Tilak Patidar
>            Assignee: Abhishek Tiwari
>            Priority: Major
>
> Currently, FsDataWriter writer one file per partition which is not optimal when writing files like 
> Parquet where one would want to land an optimal size either based on file size or records per file.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)