You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "Aitozi (via GitHub)" <gi...@apache.org> on 2023/11/21 11:38:51 UTC

[I] [Feature] Maintain the limited L0 files in write-only mode [incubator-paimon]

Aitozi opened a new issue, #2360:
URL: https://github.com/apache/incubator-paimon/issues/2360

   ### Search before asking
   
   - [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar.
   
   
   ### Motivation
   
   Currently, when we using `write-only` mode with a dedicated compaction job, then the frontend write job's speed are not limited by the compaction job. It may lead to mismatch speed of the whole pipeline. This will lead to much merge read process during query. So, I think a Write-Stall for the multi write job if the L0 files exceed the `num-sorted-run.stop-trigger` may do good to the whole pipeline.
   
   ### Solution
   
   _No response_
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [X] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org