You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "leaves12138 (via GitHub)" <gi...@apache.org> on 2026/05/09 10:43:42 UTC

[PR] [codex] Add blob null-on-unreadable write option [paimon]

leaves12138 opened a new pull request, #7798:
URL: https://github.com/apache/paimon/pull/7798

   ## What changed
   
   - Added table option `blob-write-null-on-unreadable`, defaulting to `false`.
   - Threaded the option through blob file format creation, dedicated blob writers, and external-storage blob writers.
   - Updated `BlobFormatWriter` to attempt `newInputStream()` before writing a blob entry; when enabled, unreadable blobs are written as `NULL` and the blob consumer receives a null descriptor.
   - Documented the option and added focused format/table coverage.
   
   ## Why
   
   Some blob values may reference data that cannot open a fresh input stream at write time. This option lets those values be persisted as `NULL` instead of failing the entire write, while preserving the existing fail-fast behavior by default.
   
   ## Validation
   
   - `mvn -pl paimon-format -am -Pfast-build -DfailIfNoTests=false -Dtest=BlobFileFormatTest test`
   - `mvn -pl paimon-core -am -Pfast-build -DfailIfNoTests=false -Dtest=BlobTableTest#testUnreadableExternalStorageBlobWritesNull test`
   - `git diff --check`


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [core] Add Flink blob null-on-missing-file option [paimon]

Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi merged PR #7798:
URL: https://github.com/apache/paimon/pull/7798


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [core] Add Flink blob null-on-missing-file option [paimon]

Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi commented on PR #7798:
URL: https://github.com/apache/paimon/pull/7798#issuecomment-4475553900

   +1


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org