You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2021/03/02 06:12:50 UTC
[GitHub] [incubator-dolphinscheduler] syb853553110 opened a new issue #4924: [Improvement][dolphinscheduler-server] Flink tasks do not support yarn-per-job mode
syb853553110 opened a new issue #4924:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4924
*Please review https://dolphinscheduler.apache.org/en-us/community/development/issue.html when describe an issue.*
**Describe the question**
(1)Flink deployment modes currently not supported：yarn-per-job
(2) Some parameters cannot be selected
**What are the current deficiencies and the benefits of improvement**
It is more convenient to submit Flink tasks
**Which version of DolphinScheduler:**
-[1.3.5-release]
**Describe alternatives you've considered**
（1）Add Options for Generic CLI mode:
-t,--target <arg> For the "run" action the currently available
targets are: "remote", "local", "kubernetes-session",
"yarn-per-job", "yarn-session". For the
"run-application" action the currently available
targets are: "kubernetes-application",
"yarn-application".
（2）It is recommended to add a few parameters:
-d,--detached
-p,--parallelism <parallelism>
-s,--fromSavepoint <savepointPath>
--allowNonRestoredState
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] chengshiwen edited a comment on issue #4924: [Improvement][dolphinscheduler-server] Flink tasks do not support yarn-per-job mode
Posted by GitBox <gi...@apache.org>.
chengshiwen edited a comment on issue #4924:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4924#issuecomment-788672813
@syb853553110 `yarn-per-job` mode is supported in Flink task, since it's just equivalent to `yarn-cluster` mode
(1) `Generic CLI` mode you said does not support, because the mode is just supported from flink 1.10.
`Attention`: `yarn-per-job` in `Generic CLI` mode is still replaced with `yarn-cluster` mode which is just equivalent to `yarn-per-job` mode.
We will consider to support `Generic CLI` mode in future.
(2) You can specific the following options in `Option parameters`:
```
-d,--detached
-p,--parallelism
-s,--fromSavepoint
--allowNonRestoredState
```
(3) We plan to add `-p,--parallelism` as a new parameter Input
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] CalvinKirs closed issue #4924: [Improvement][Flink] Flink tasks do not support Generic CLI mode
Posted by GitBox <gi...@apache.org>.
CalvinKirs closed issue #4924:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4924
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] chengshiwen commented on issue #4924: [Improvement][dolphinscheduler-server] Flink tasks do not support yarn-per-job mode
Posted by GitBox <gi...@apache.org>.
chengshiwen commented on issue #4924:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4924#issuecomment-789407644
@syb853553110 Could you please rename the title to `[Improvement][Flink] Flink tasks do not support Generic CLI mode`? Thx so much!
`
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] chengshiwen edited a comment on issue #4924: [Improvement][dolphinscheduler-server] Flink tasks do not support yarn-per-job mode
Posted by GitBox <gi...@apache.org>.
chengshiwen edited a comment on issue #4924:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4924#issuecomment-788672813
@syb853553110 `yarn-per-job` mode is supported in Flink task.
(1) `Generic CLI` mode you said does not support, because the mode is supported from flink 1.10.
`Attention`: `yarn-per-job` in `Generic CLI` mode is still replaced with `yarn-cluster` mode which is just equivalent to `yarn-per-job` mode
(2) You can specific the following options in `Option parameters`:
```
-d,--detached
-p,--parallelism
-s,--fromSavepoint
--allowNonRestoredState
```
(3) We plan to add `-p,--parallelism` as a new parameter Input
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] chengshiwen edited a comment on issue #4924: [Improvement][dolphinscheduler-server] Flink tasks do not support yarn-per-job mode
Posted by GitBox <gi...@apache.org>.
chengshiwen edited a comment on issue #4924:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4924#issuecomment-788672813
@syb853553110 `yarn-per-job` mode is supported in Flink task, since it's just equivalent to `yarn-cluster` mode
(1) `Generic CLI` mode you said does not support, because the mode is just supported from flink 1.10.
`Attention`: `yarn-per-job` in `Generic CLI` mode is is just equivalent to `yarn-cluster` mode.
We will consider to support `Generic CLI` mode in future.
(2) You can specific the following options in `Option parameters`:
```
-d,--detached
-p,--parallelism
-s,--fromSavepoint
--allowNonRestoredState
```
(3) We plan to add `-p,--parallelism` as a new parameter Input
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] chengshiwen commented on issue #4924: [Improvement][dolphinscheduler-server] Flink tasks do not support yarn-per-job mode
Posted by GitBox <gi...@apache.org>.
chengshiwen commented on issue #4924:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4924#issuecomment-788672813
@syb853553110 `yarn-per-job` mode is supported in Flink task.
`Generic CLI` mode you said does not support, because the mode is supported from flink 1.10.
`Attention`: `Generic CLI` mode is still replaced with `yarn-cluster` mode which is just equivalent to `yarn-per-job` mode
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] CalvinKirs commented on issue #4924: [Improvement][Flink] Flink tasks do not support Generic CLI mode
Posted by GitBox <gi...@apache.org>.
CalvinKirs commented on issue #4924:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4924#issuecomment-800784102
close by #4937
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] chengshiwen edited a comment on issue #4924: [Improvement][dolphinscheduler-server] Flink tasks do not support yarn-per-job mode
Posted by GitBox <gi...@apache.org>.
chengshiwen edited a comment on issue #4924:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4924#issuecomment-788672813
@syb853553110 `yarn-per-job` mode is supported in Flink task, since it's just equivalent to `yarn-cluster` mode
(1) `Generic CLI` mode you said does not support, because the mode is just supported from flink 1.10.
`Attention`: `yarn-per-job` in `Generic CLI` mode is is just equivalent to `yarn-cluster` mode.
We will consider to support `Generic CLI` mode in future.
(2) You can specific the following options in `Option parameters`:
```
-d,--detached
-p,--parallelism
-s,--fromSavepoint
--allowNonRestoredState
```
(3) We also have added `-p,--parallelism` as a new parameter Input in #4937
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] chengshiwen edited a comment on issue #4924: [Improvement][dolphinscheduler-server] Flink tasks do not support yarn-per-job mode
Posted by GitBox <gi...@apache.org>.
chengshiwen edited a comment on issue #4924:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4924#issuecomment-788672813
@syb853553110 `yarn-per-job` mode is supported in Flink task, since it's just equivalent to `yarn-cluster` mode
(1) `Generic CLI` mode you said does not support, because the mode is just supported from flink 1.10.
`Attention`: `yarn-per-job` in `Generic CLI` mode is still replaced with `yarn-cluster` mode which is just equivalent to `yarn-per-job` mode
(2) You can specific the following options in `Option parameters`:
```
-d,--detached
-p,--parallelism
-s,--fromSavepoint
--allowNonRestoredState
```
(3) We plan to add `-p,--parallelism` as a new parameter Input
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] chengshiwen edited a comment on issue #4924: [Improvement][dolphinscheduler-server] Flink tasks do not support yarn-per-job mode
Posted by GitBox <gi...@apache.org>.
chengshiwen edited a comment on issue #4924:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4924#issuecomment-788672813
@syb853553110 `yarn-per-job` mode is supported in Flink task, since it's just equivalent to `yarn-cluster` mode
(1) `Generic CLI` mode you said does not support, because the mode is supported from flink 1.10.
`Attention`: `yarn-per-job` in `Generic CLI` mode is still replaced with `yarn-cluster` mode which is just equivalent to `yarn-per-job` mode
(2) You can specific the following options in `Option parameters`:
```
-d,--detached
-p,--parallelism
-s,--fromSavepoint
--allowNonRestoredState
```
(3) We plan to add `-p,--parallelism` as a new parameter Input
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] chengshiwen edited a comment on issue #4924: [Improvement][dolphinscheduler-server] Flink tasks do not support yarn-per-job mode
Posted by GitBox <gi...@apache.org>.
chengshiwen edited a comment on issue #4924:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4924#issuecomment-788672813
@syb853553110 `yarn-per-job` mode is supported in Flink task.
(1) `Generic CLI` mode you said does not support, because the mode is supported from flink 1.10.
`Attention`: `yarn-per-job` in `Generic CLI` mode is still replaced with `yarn-cluster` mode which is just equivalent to `yarn-per-job` mode
(2) You can specific the following options in `Option parameters`:
```
-d,--detached
-p,--parallelism
-s,--fromSavepoint
--allowNonRestoredState
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] chengshiwen edited a comment on issue #4924: [Improvement][dolphinscheduler-server] Flink tasks do not support yarn-per-job mode
Posted by GitBox <gi...@apache.org>.
chengshiwen edited a comment on issue #4924:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4924#issuecomment-788672813
@syb853553110 `yarn-per-job` mode is supported in Flink task, since it's just equivalent to `yarn-cluster` mode
(1) `Generic CLI` mode you said does not support, because the mode is just supported from flink 1.10.
`Attention`: `yarn-per-job` in `Generic CLI` mode is is just equivalent to `yarn-cluster` mode.
We will consider to support `Generic CLI` mode in future.
(2) You can specific the following options in `Option parameters`:
```
-d,--detached
-p,--parallelism
-s,--fromSavepoint
--allowNonRestoredState
```
(3) We have added `-p,--parallelism` as a new parameter Input in #4937
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org