You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2022/08/28 05:51:16 UTC

[GitHub] [dolphinscheduler] zhongjiajie commented on issue #11488: [Feature][datax] Hopefully Datax can submit to YARN

zhongjiajie commented on issue #11488:
URL: https://github.com/apache/dolphinscheduler/issues/11488#issuecomment-1229382461

   > @kezhenxu94 Jar is configured in environment variables,With the shell startup,Pom import Hadoop dependencies are easily conflicted
   > 
   > ```
   > /usr/bin/yarn jar /mnt/dss/211/datax-on-yarn-1.0.0.jar com.on.yarn.Client \
   >   -jar_path /mnt/dss/211/datax-on-yarn-1.0.0.jar \
   >   -appname DemoApp \
   >   -master_memory 1024 \
   >   -queue default \
   >   -proxy_user  hanmin.du \
   >   -datax_job /mnt/dss/datax/job/t2.json \
   >   -datax_home_hdfs /tmp/linkis/hadoop/datax.tar.gz
   > ```
   
   So you call `datax-on-yarn` by shell? if in this case, we can ignore the license issue because we never add this dependent in our source code base. User should download/build the dist jar by themself and put it into worker server


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org