You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@dolphinscheduler.apache.org by "Radeity (via GitHub)" <gi...@apache.org> on 2023/02/15 12:58:55 UTC

[GitHub] [dolphinscheduler] Radeity commented on pull request #13550: [Feature-13511] Submit Spark task directly on Kubernetes

Radeity commented on PR #13550:
URL: https://github.com/apache/dolphinscheduler/pull/13550#issuecomment-1431329390

   > @Radeity If you want to manage the life cycle of spark driver pod and worry about losing driver logs, what about querying the logs of driver pod before deleting it and keep it at DS side? The driver log could be kept as DS spark task log.
   
   Hi, @EricGao888, good idea! Can we directly append write log of driver pod into DS's task log file? In this way, maybe we can delete the driver pod if spark task runs successfully.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org