You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2020/03/18 12:53:10 UTC

[GitHub] [incubator-dolphinscheduler] oceanos opened a new issue #2226: [QUESTION] Which version of Flink is used in DolphinScheduler

oceanos opened a new issue #2226: [QUESTION] Which version of Flink is used in DolphinScheduler
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2226
 
 
   
   **Describe**
   Cmd:
   flink run -m yarn-cluster -ys 1 -yn 1 -yjm 1G -ytm 1G -d -c org.apache.flink.examples.java.wordcount.WordCount WordCount.jar
   
   Error:
   Caused by: java.io.FileNotFoundException: JAR file does not exist: -ys
   	at org.apache.flink.client.cli.CliFrontend.getJarFile(CliFrontend.java:819)
   	at org.apache.flink.client.cli.CliFrontend.buildProgram(CliFrontend.java:796)
   	at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:196)
   
   **Version of DolphinScheduler:**
    -[1.2.0]
   
   **Version of Flink:**
    -[1.9.0]
    -[1.10.0]
   
   **Requirement or improvement**
   - Some flink command line arguments may not be compatible with the new version.
   - Please add more infomation about flink task in DolphinScheduler, such as  the adaptation version.
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [incubator-dolphinscheduler] dailidong commented on issue #2226: [QUESTION] Which version of Flink is used in DolphinScheduler

Posted by GitBox <gi...@apache.org>.
dailidong commented on issue #2226: [QUESTION] Which version of Flink is used in DolphinScheduler
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2226#issuecomment-601535198
 
 
   #711 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [incubator-dolphinscheduler] huzekang commented on issue #2226: [QUESTION] Which version of Flink is used in DolphinScheduler

Posted by GitBox <gi...@apache.org>.
huzekang commented on issue #2226: [QUESTION] Which version of Flink is used in DolphinScheduler
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2226#issuecomment-608345104
 
 
   I user flink 1.10 test is ok!
   1. I remove  `-yn 1`  in the command (maybe `-yn` dosen't work in flink 1.10)
   2. I add below  in the `conf/env/dolphinscheduler-env.sh` file
   ```
   export HADOOP_CLASSPATH=`${HADOOP_HOME}/bin/hadoop classpath`
   ```
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [incubator-dolphinscheduler] dailidong commented on issue #2226: [QUESTION] Which version of Flink is used in DolphinScheduler

Posted by GitBox <gi...@apache.org>.
dailidong commented on issue #2226: [QUESTION] Which version of Flink is used in DolphinScheduler
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2226#issuecomment-605461336
 
 
   @oceanos 
   because you use shell task , you can set FLINK_HOME under the conf/env/dolphinscheduler-env.sh,  you can use any version if you like

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [incubator-dolphinscheduler] dailidong commented on issue #2226: [QUESTION] Which version of Flink is used in DolphinScheduler

Posted by GitBox <gi...@apache.org>.
dailidong commented on issue #2226: [QUESTION] Which version of Flink is used in DolphinScheduler
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2226#issuecomment-601534941
 
 
   @LoveEvenWong  could you answer this issue?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [incubator-dolphinscheduler] huzekang edited a comment on issue #2226: [QUESTION] Which version of Flink is used in DolphinScheduler

Posted by GitBox <gi...@apache.org>.
huzekang edited a comment on issue #2226: [QUESTION] Which version of Flink is used in DolphinScheduler
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2226#issuecomment-608345104
 
 
   I use flink 1.10 test is ok!
   1. I remove  `-yn 1`  in the command (maybe `-yn` dosen't work in flink 1.10)
   2. I add below  in the `conf/env/dolphinscheduler-env.sh` file
   ```
   export HADOOP_CLASSPATH=`${HADOOP_HOME}/bin/hadoop classpath`
   ```
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [incubator-dolphinscheduler] xingchun-chen closed issue #2226: [QUESTION] Which version of Flink is used in DolphinScheduler

Posted by GitBox <gi...@apache.org>.
xingchun-chen closed issue #2226:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2226


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org