You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@streampark.apache.org by GitBox <gi...@apache.org> on 2022/10/07 13:16:31 UTC

[GitHub] [incubator-streampark] 1996fanrui opened a new issue, #1762: [Feature] Distinguish between Flink parameters and user parameters when starting a Flink job

1996fanrui opened a new issue, #1762:
URL: https://github.com/apache/incubator-streampark/issues/1762

   ### Search before asking
   
   - [X] I had searched in the [feature](https://github.com/apache/streampark/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.
   
   
   ### Description
   
   Distinguish between Flink parameters and user parameters when starting a Flink job.
   
   
   ```
   // This is flinkConf
   Configuration flinkConf = new Configuration();
   StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment(flinkConf);
   
   // This is userConf
   Configuration userConf = new Configuration();
   env.getConfig().setGlobalJobParameters(userConf);
   ```
   
   
   ### Usage Scenario
   
   _No response_
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-streampark] 1996fanrui commented on issue #1762: [Feature] Distinguish between Flink parameters and user parameters when starting a Flink job

Posted by GitBox <gi...@apache.org>.
1996fanrui commented on issue #1762:
URL: https://github.com/apache/incubator-streampark/issues/1762#issuecomment-1271797393

   Thanks for your clarification~


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-streampark] wolfboys commented on issue #1762: [Feature] Distinguish between Flink parameters and user parameters when starting a Flink job

Posted by GitBox <gi...@apache.org>.
wolfboys commented on issue #1762:
URL: https://github.com/apache/incubator-streampark/issues/1762#issuecomment-1271792584

   to be clear, flinkConf only read the parameters from `flink.deployment.property`, userConf is all params,  Include `flink.deployment.property` and `user.parameter`, because it is uncertain whether users will use `flink.deployment.property`. If these parameters are not exposed, users cannot obtain these parameters in the program.
   
    like this:
   
   ```yaml
   flink:
     deployment:
       property: 
         $key: $value #All parameters that can be set in Flink
   
         ....
   
   user.parameter:
      kafka.source:
         ....
   ```
   
   ```
   // just from flink.deployment.property:
   Configuration flinkConf = new Configuration();
   StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment(flinkConf);
   ```
   
   ```
   
   // all params,  Include flink.deployment.property and user.parameter,  
   
   Configuration userConf = new Configuration();
   env.getConfig().setGlobalJobParameters(userConf);
   
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-streampark] wolfboys closed issue #1762: [Feature] Distinguish between Flink parameters and user parameters when starting a Flink job

Posted by GitBox <gi...@apache.org>.
wolfboys closed issue #1762: [Feature] Distinguish between Flink parameters and user parameters when starting a Flink job
URL: https://github.com/apache/incubator-streampark/issues/1762


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org