[GitHub] [incubator-paimon] liming30 commented on a diff in pull request #1350: [format] Supports estimation of data size in memory for better control of file size.

["liming30 (via GitHub)" <gi...@apache.org>]

liming30 commented on code in PR #1350:
URL: https://github.com/apache/incubator-paimon/pull/1350#discussion_r1226172690


##########
paimon-format/src/main/java/org/apache/paimon/format/orc/writer/OrcBulkWriter.java:
##########
@@ -67,4 +89,43 @@ public void finish() throws IOException {
         flush();
         writer.close();
     }
+
+    @Override
+    public long length() throws IOException {
+        long estimateMemory = treeWriter.estimateMemory();
+
+        long dataLength = 0;

Review Comment:
   This is mainly the in-memory incompletely generated stripe size, the default value is 64MB or 256MB.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org