You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@paimon.apache.org by lz...@apache.org on 2024/08/05 03:43:59 UTC

(paimon) branch master updated: [avro] Do not flush on every block for DataFileWriter (#3893)

This is an automated email from the ASF dual-hosted git repository.

lzljs3620320 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/paimon.git


The following commit(s) were added to refs/heads/master by this push:
     new 64889d7da [avro] Do not flush on every block for DataFileWriter (#3893)
64889d7da is described below

commit 64889d7da29357eeca6462ef38f5ee0b93658088
Author: Jingsong Lee <ji...@gmail.com>
AuthorDate: Mon Aug 5 11:43:54 2024 +0800

    [avro] Do not flush on every block for DataFileWriter (#3893)
---
 .../src/main/java/org/apache/paimon/format/avro/AvroFileFormat.java      | 1 +
 1 file changed, 1 insertion(+)

diff --git a/paimon-format/src/main/java/org/apache/paimon/format/avro/AvroFileFormat.java b/paimon-format/src/main/java/org/apache/paimon/format/avro/AvroFileFormat.java
index c390b1cbe..0a9f5e092 100644
--- a/paimon-format/src/main/java/org/apache/paimon/format/avro/AvroFileFormat.java
+++ b/paimon-format/src/main/java/org/apache/paimon/format/avro/AvroFileFormat.java
@@ -124,6 +124,7 @@ public class AvroFileFormat extends FileFormat {
                                         new DataFileWriter<>(datumWriter);
                                 dataFileWriter.setCodec(createCodecFactory(compression));
                                 dataFileWriter.create(schema, out);
+                                dataFileWriter.setFlushOnEveryBlock(false);
                                 return dataFileWriter;
                             });
         }