You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by GitBox <gi...@apache.org> on 2022/11/30 11:06:50 UTC

[GitHub] [flink] HuangXingBo opened a new pull request, #21430: [BP-1.15][FLINK-29155][python] Improve the default configuration to make gRPC server more stable

HuangXingBo opened a new pull request, #21430:
URL: https://github.com/apache/flink/pull/21430

   ## What is the purpose of the change
   
   *This pull request will change some configs to make grpc server stable in PyFlink Process Mode.*
   
   
   ## Brief change log
   
     - *Port Beam `ServerFactory` class to flink-python module*
     - *Change default `KEEP_ALIVE_TIME_SEC` to 19. The BDP ping period is locally-decided and the keep alive time is 20 seconds in client side, so we choose the server to allow pings every 19 seconds. For details, you can refer to the discussion in https://github.com/grpc/grpc/issues/17667*
     - *Adjust the default value of bundle size and arrow batch size. The default value of bundle size is 100000. But in most scenarios, this default value is unreasonable, and it is easy to cause instability of the grpc server, so we adjust the default value to 1000.*
   
   ## Verifying this change
   
   This change added tests and can be verified as follows:
   
     - *Original tests*
     - *Manual test a job which takes 1min in a udf*
   
   ## Does this pull request potentially affect one of the following parts:
   
     - Dependencies (does it add or upgrade a dependency): (no)
     - The public API, i.e., is any changed class annotated with `@Public(Evolving)`: (no)
     - The serializers: (no)
     - The runtime per-record code paths (performance sensitive): (no)
     - Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: (no)
     - The S3 file system connector: (no)
   
   ## Documentation
   
     - Does this pull request introduce a new feature? (no)
     - If yes, how is the feature documented? (not applicable)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [flink] HuangXingBo closed pull request #21430: [BP-1.15][FLINK-29155][python] Improve the default configuration to make gRPC server more stable

Posted by GitBox <gi...@apache.org>.
HuangXingBo closed pull request #21430: [BP-1.15][FLINK-29155][python] Improve the default configuration to make gRPC server more stable
URL: https://github.com/apache/flink/pull/21430


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [flink] flinkbot commented on pull request #21430: [BP-1.15][FLINK-29155][python] Improve the default configuration to make gRPC server more stable

Posted by GitBox <gi...@apache.org>.
flinkbot commented on PR #21430:
URL: https://github.com/apache/flink/pull/21430#issuecomment-1331988552

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "89f6ccd6d54fba4550263d547e6141e50763b36d",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "89f6ccd6d54fba4550263d547e6141e50763b36d",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 89f6ccd6d54fba4550263d547e6141e50763b36d UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org