You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by GitBox <gi...@apache.org> on 2022/05/23 16:27:39 UTC

[GitHub] [flink] wolfboys opened a new pull request, #19798: [FLINK-27299][Runtime/Configuration] flink parsing parameter bug fixed.

wolfboys opened a new pull request, #19798:
URL: https://github.com/apache/flink/pull/19798

   ## What is the purpose of the change
   
   When I am running a flink job, I specify a running parameter with a "#" sign in it. The parsing fails.
   
   e.g: flink run com.myJob --sink.password db@123#123 
   
   only parse the content in front of "#", after reading the source code It is found that the parameters are intercepted according to "#" in the loadYAMLResource method of GlobalConfiguration. This part needs to be improved
   
   ## Brief change log
     -  before: `line.split("#", 2) ` after: `line.split("\\s+#", 2)` Following yaml's parameter parsing rules, the content after " #" ( space + #) is the real comment part, which should be discarded when parsing parameters
   
   ## Verifying this change
   
   This change is a trivial rework / code cleanup without any test coverage.
   
   ## Does this pull request potentially affect one of the following parts:
   
     - Dependencies (does it add or upgrade a dependency): no
     - The public API, i.e., is any changed class annotated with `@Public(Evolving)`: no
     - The serializers: no
     - The runtime per-record code paths (performance sensitive): don't know
     - Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: no
     - The S3 file system connector: no
   
   ## Documentation
   
     - Does this pull request introduce a new feature?  no
     - If yes, how is the feature documented?  not applicable


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [FLINK-27299][Runtime/Configuration] flink parsing parameter bug fixed. [flink]

Posted by "wolfboys (via GitHub)" <gi...@apache.org>.
wolfboys closed pull request #19798: [FLINK-27299][Runtime/Configuration] flink parsing parameter bug fixed.
URL: https://github.com/apache/flink/pull/19798


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [flink] wolfboys commented on pull request #19798: [FLINK-27299][Runtime/Configuration] flink parsing parameter bug fixed.

Posted by GitBox <gi...@apache.org>.
wolfboys commented on PR #19798:
URL: https://github.com/apache/flink/pull/19798#issuecomment-1135697297

   @flinkbot run azure


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [flink] wolfboys commented on pull request #19798: [FLINK-27299][Runtime/Configuration] flink parsing parameter bug fixed.

Posted by "wolfboys (via GitHub)" <gi...@apache.org>.
wolfboys commented on PR #19798:
URL: https://github.com/apache/flink/pull/19798#issuecomment-1429986099

   cc @tisonkun @gaoyunhaii can this pr be merged?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [flink] gaoyunhaii commented on pull request #19798: [FLINK-27299][Runtime/Configuration] flink parsing parameter bug fixed.

Posted by "gaoyunhaii (via GitHub)" <gi...@apache.org>.
gaoyunhaii commented on PR #19798:
URL: https://github.com/apache/flink/pull/19798#issuecomment-1429938683

   Very thanks @tisonkun for pointing out the issue! That's indeed a blocker. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [flink] gaoyunhaii commented on pull request #19798: [FLINK-27299][Runtime/Configuration] flink parsing parameter bug fixed.

Posted by "gaoyunhaii (via GitHub)" <gi...@apache.org>.
gaoyunhaii commented on PR #19798:
URL: https://github.com/apache/flink/pull/19798#issuecomment-1432658405

   Hi @wolfboys , sorry that based on the above point we have to postpone merging this PR. Logically we could postpone it till a main version bump, like Flink 2.0. We also have some other similar PRs, like providing more efficient serializers for some types, that are also blocked by the compatibility. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [flink] flinkbot commented on pull request #19798: [FLINK-27299][Runtime/Configuration] flink parsing parameter bug fixed.

Posted by GitBox <gi...@apache.org>.
flinkbot commented on PR #19798:
URL: https://github.com/apache/flink/pull/19798#issuecomment-1134890110

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "07cd9648b6ebef44b068d2b793727e7e53f33611",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "07cd9648b6ebef44b068d2b793727e7e53f33611",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 07cd9648b6ebef44b068d2b793727e7e53f33611 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [flink] link3280 commented on pull request #19798: [FLINK-27299][Runtime/Configuration] flink parsing parameter bug fixed.

Posted by "link3280 (via GitHub)" <gi...@apache.org>.
link3280 commented on PR #19798:
URL: https://github.com/apache/flink/pull/19798#issuecomment-1592254363

   I think we have a good reason to consider it as a bug: pyflink uses `#` as a separator in the configurations (e.g. [python.requirements)](https://nightlies.apache.org/flink/flink-docs-release-1.17/docs/dev/python/python_config/#python-requirements) and they're unexpectedly truncated on K8s.
   
   @wolfboys @gaoyunhaii @tisonkun 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org