[GitHub] [incubator-paimon] JingsongLi opened a new pull request, #680: [flink] Limit should not rely on assign all splits in StaticFileStoreSplitEnumerator

["JingsongLi (via GitHub)" <gi...@apache.org>]

JingsongLi opened a new pull request, #680:
URL: https://github.com/apache/incubator-paimon/pull/680

   
   ### Purpose
   
   Limit should not rely on assign all splits in StaticFileStoreSplitEnumerator.
   
   Assign all splits in one time will produce exceed `akka.framesize` to exceptions.
   
   We can add a global limiter in `FileStoreSourceReader`, limiter is created in SourceReader, it can be shared in all split readers.
   
   ### Tests
   
   Test Exists.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-paimon] SteNicholas merged pull request #680: [flink] Limit should not rely on assign all splits in StaticFileStoreSplitEnumerator

["SteNicholas (via GitHub)" <gi...@apache.org>]

SteNicholas merged PR #680:
URL: https://github.com/apache/incubator-paimon/pull/680


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org