[GitHub] [incubator-dolphinscheduler] lo0o0ong opened a new issue #1222: [Feature]

[GitBox <gi...@apache.org>]

lo0o0ong opened a new issue #1222: [Feature] 
URL: https://github.com/apache/incubator-dolphinscheduler/issues/1222
 
 
   it wourld waste lot of ROM space  when executing a spark task if a resource jar size is very large. because every time spark will copy the dependent jar file to execute instance dictonary.
   当spark执行时候依赖了很大的jar包的时候会导致服务器空间的浪费因为spark每个实例任务会在 worker机器上创建一个目录并且把依赖文件复制过去。
   
   So create a shared dictonary on HDFS and link to spark call would be a good way. or try other better way.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services