You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2021/05/14 02:12:40 UTC
[GitHub] [dolphinscheduler] SbloodyS opened a new issue #5466: [Improvement][Shell] kill shell command when using shell to run flume would cause flume exit not gracefully
SbloodyS opened a new issue #5466:
URL: https://github.com/apache/dolphinscheduler/issues/5466
/usr/local/service/flume/bin/flume-ng agent -c /usr/local/service/flume/conf/ -f /data/dolphinscheduler/data/hadoop/resources/appsflyer/appsflyer_flume.properties -n agent -Dflume.root.logger=INFO,console
Start the Flume agent with above shell command. After it has written a few files to HDFS, kill it using webui kill command. Check the hdfs dir. There will be a .tmp file. If we restart the Flume agent, it will resume writing data to HDFS, but it will not close/cleanup the .tmp file.
I think the correct scenario is that use kill -15 instead of of kill -9, so that flume agent can exit gracefully and it can perform these tasks before stopping the agent.
**Which version of DolphinScheduler:**
-[1.3.6]
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] ruanwenjun commented on issue #5466: [Improvement][Shell] kill shell command when using shell to run flume would cause flume exit not gracefully
Posted by GitBox <gi...@apache.org>.
ruanwenjun commented on issue #5466:
URL: https://github.com/apache/dolphinscheduler/issues/5466#issuecomment-840965408
I think it would be better to provide the two-way, let users choose the kill way when they need to stop the workflow. Because sometimes we need force kill.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] closed issue #5466: [Improvement][Shell] kill shell command when using shell to run flume would cause flume exit not gracefully
Posted by GitBox <gi...@apache.org>.
github-actions[bot] closed issue #5466:
URL: https://github.com/apache/dolphinscheduler/issues/5466
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #5466: [Improvement][Shell] kill shell command when using shell to run flume would cause flume exit not gracefully
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #5466:
URL: https://github.com/apache/dolphinscheduler/issues/5466#issuecomment-1056002011
This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #5466: [Improvement][Shell] kill shell command when using shell to run flume would cause flume exit not gracefully
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #5466:
URL: https://github.com/apache/dolphinscheduler/issues/5466#issuecomment-1048334943
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #5466: [Improvement][Shell] kill shell command when using shell to run flume would cause flume exit not gracefully
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #5466:
URL: https://github.com/apache/dolphinscheduler/issues/5466#issuecomment-840958277
Hi:
* Thank you for your feedback, we have received your issue, Please wait patiently for a reply.
* In order for us to understand your request as soon as possible, please provide detailed information、version or pictures.
* If you haven't received a reply for a long time, you can subscribe to the developer's email，Mail subscription steps reference https://dolphinscheduler.apache.org/zh-cn/community/development/subscribe.html ,Then write the issue URL in the email content and send question to dev@dolphinscheduler.apache.org.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org