You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@streampark.apache.org by GitBox <gi...@apache.org> on 2022/10/17 04:32:49 UTC
[GitHub] [incubator-streampark] avatarTaier opened a new issue, #1856: [Bug] 不支持flinksql 的set语法
avatarTaier opened a new issue, #1856:
URL: https://github.com/apache/incubator-streampark/issues/1856
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/streampark/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
### What happened
不支持flinksql 的set语法，set 'table.exec.emit.early-fire.enabled' =true; set 'table.exec.emit.early-fire.delay'='10s'等等
### StreamPark Version
1.2.4
### Java Version
1.8
### Flink Version
1.14.6
### Scala Version of Flink
2.12
### Error Exception
```log
页面提示不支持改语法
```
### Screenshots
页面提示不支持改语法
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-streampark] prosscode commented on issue #1856: [Bug] 不支持flinksql 的set语法
Posted by GitBox <gi...@apache.org>.
prosscode commented on issue #1856:
URL: https://github.com/apache/incubator-streampark/issues/1856#issuecomment-1290845865
The two parameters mentioned are not displayed on the flink configuration page, because they are experimental config and may be removed later.
[table.exec.emit.early-fire.enabled] the meaning of Early fire is to output the result before the watermark reaches the end time point of the window and is an emit strategy before watermark advanced to end of window.
[table.exec.emit.early-fire.delay] the meaning of time interval for early fire results. If the value is greater than 0, it means to output the result every specified time. If the value is 0, the result will be output every time an element arrives.
<img width="724" alt="image" src="https://user-images.githubusercontent.com/26180481/197831677-0dcbef4f-eb27-44dc-80fc-85dbfd210b75.png">
BTW, I think for the parameters definitions supported by Flink, we still need to do availability verification. Avoid setting parameters by the user and it will take effect, but in fact the parameter Key is not written correctly.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-streampark] ziqiang-wang commented on issue #1856: [Bug] 不支持flinksql 的set语法
Posted by GitBox <gi...@apache.org>.
ziqiang-wang commented on issue #1856:
URL: https://github.com/apache/incubator-streampark/issues/1856#issuecomment-1280382540
table.exec.emit.early-fire.enabled
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-streampark] ziqiang-wang commented on issue #1856: [Bug] 不支持flinksql 的set语法
Posted by GitBox <gi...@apache.org>.
ziqiang-wang commented on issue #1856:
URL: https://github.com/apache/incubator-streampark/issues/1856#issuecomment-1280386909
# 错误原因
table.exec.emit.early-fire.enabled
table.exec.emit.early-fire.delay
我在 flink 官网和 flink 源码中搜索了这两个配置参数，均没有搜索到，不过查阅一些博客时，查到了这两个参数，说明这两个参数是可用的。
咱们的平台中，设置了对 set 的参数 key 的校验，但是由于源码的那些 options 类中并没有这两个参数，所以平台直接报错了。
# 修复方案
我建议的修复方案为：直接去掉对用户 sql 语句中 set 后面 key 是否合法的校验，看是否可行。
@wolfboys
---------------------------------------------------------------------------------------------
# Reason for error
table.exec.emit.early-fire.enabled
table.exec.emit.early-fire.delay
I searched for these two parameters in the flink official website and flink source code, and found none. However, when I checked some blogs, I found these two parameters, indicating that these two parameters are available.
Our platform, set to the set parameter key verification, but because the source code of those options classes do not have these two parameters, so the platform directly reported an error.
# Fix Solution
My suggested solution is: directly remove the verification of the key after the set in the user sql statement to see if it is feasible.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-streampark] ziqiang-wang commented on issue #1856: [Bug] 不支持flinksql 的set语法
Posted by GitBox <gi...@apache.org>.
ziqiang-wang commented on issue #1856:
URL: https://github.com/apache/incubator-streampark/issues/1856#issuecomment-1283569135
English under the chinese.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-streampark] 1996fanrui closed issue #1856: [Bug] 不支持flinksql 的set语法
Posted by GitBox <gi...@apache.org>.
1996fanrui closed issue #1856: [Bug] 不支持flinksql 的set语法
URL: https://github.com/apache/incubator-streampark/issues/1856
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-streampark] wuchunfu commented on issue #1856: [Bug] 不支持flinksql 的set语法
Posted by GitBox <gi...@apache.org>.
wuchunfu commented on issue #1856:
URL: https://github.com/apache/incubator-streampark/issues/1856#issuecomment-1283434167
@ziqiang-wang Please describe your error message in English, thanks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-streampark] ziqiang-wang commented on issue #1856: [Bug] 不支持flinksql 的set语法
Posted by GitBox <gi...@apache.org>.
ziqiang-wang commented on issue #1856:
URL: https://github.com/apache/incubator-streampark/issues/1856#issuecomment-1294932938
@prosscode
I agree to your suggestion.
It seems that the parameters not recommended by flink will not appear in the parameter configuration description on the official website.
These two parameters, as mentioned above, can be solved using flink's **cumulate** window.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org