You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@iceberg.apache.org by xiaokun ding <di...@gmail.com> on 2020/01/09 07:41:10 UTC
While batch write iceberg from spark why cannot keeping multiple
files open.
Hi Ryan, aokolnychyi:
I find in Writer.java#L506
<https://github.com/apache/incubator-iceberg/blob/master/spark/src/main/java/org/apache/iceberg/spark/source/Writer.java#L506>,
that should group data with the partition key before writing data into
iceberg file. May I know your consideration for that design?
[image: image.png]