You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "dentiny (via GitHub)" <gi...@apache.org> on 2025/05/28 17:54:39 UTC
[I] Feature request: expose `DataFile` builder as public [iceberg-rust]
dentiny opened a new issue, #1392:
URL: https://github.com/apache/iceberg-rust/issues/1392
### Is your feature request related to a problem or challenge?
My workflow looks like
- Accumulate arrow batches in-memory, flush to local filesystem when it reaches certain threshold
- Periodically import local parquet files to iceberg table
iceberg-rust doesn't provide a util function or class to generate `DataFile`, which is needed for fast append action (apart from `DataFileWriter`), so I have to read the whole arrow batches and write it with `DataFileWriter`, which is definitely inefficient.
I would like to expose `DataFileBuilder` as a public struct, so I could construct these fields myself.
### Describe the solution you'd like
Expose `DataFileBuilder` as public
### Willingness to contribute
I can contribute to this feature independently
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Feature request: expose `DataFile` builder as public [iceberg-rust]
Posted by "dentiny (via GitHub)" <gi...@apache.org>.
dentiny commented on issue #1392:
URL: https://github.com/apache/iceberg-rust/issues/1392#issuecomment-2917202154
Sorry I get fooled by gpt and deepseek, the default visibility is public
Ref: https://docs.rs/derive_builder/latest/derive_builder/#setter-visibility
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Feature request: expose `DataFile` builder as public [iceberg-rust]
Posted by "dentiny (via GitHub)" <gi...@apache.org>.
dentiny closed issue #1392: Feature request: expose `DataFile` builder as public
URL: https://github.com/apache/iceberg-rust/issues/1392
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org