You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@gobblin.apache.org by "Sudarshan Vasudevan (Jira)" <ji...@apache.org> on 2021/03/29 17:20:01 UTC

[jira] [Created] (GOBBLIN-1417) Make row batch size in ORC Mapreduce writer configurable

Sudarshan Vasudevan created GOBBLIN-1417:
--------------------------------------------

             Summary: Make row batch size in ORC Mapreduce writer configurable
                 Key: GOBBLIN-1417
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-1417
             Project: Apache Gobblin
          Issue Type: Improvement
          Components: gobblin-compaction
    Affects Versions: 0.15.0
            Reporter: Sudarshan Vasudevan
            Assignee: Issac Buenrostro
             Fix For: 0.16.0


Current behavior enforces the default row batch size of 1024. To prevent OOMs during writes, this config may need to be overridden.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)