You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2020/11/27 02:11:47 UTC
[GitHub] [incubator-dolphinscheduler] baijun opened a new issue #4114: [Question] data.basedir.path cleanup problem.
baijun opened a new issue #4114:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4114
1, I have modified the data. The basedir. Path from/tmp/dolphinscheduler to /mydata/dolphinscheduler/tmp/.
2. Developer mode is false.
3, /mydata/dolphinscheduler/tmp folder read and write access to normal, ds is perfectly normal.
4, after running for a period of time only, find/data/dolphinscheduler files in the/tmp directory cannot be automatically deleted, lead to disk pile up.
Q: Can temporary files in this directory only be removed manually?Cannot automatically delete??
1、我修改了data.basedir.path从/tmp/dolphinscheduler/ 到数据盘/data/dolphinscheduler/tmp.
2、开发者模式为false.
3、/data/dolphinscheduler/tmp文件夹读写权限正常，ds工作完全正常.
4、在运行了一段时间只有，发现/data/dolphinscheduler/tmp目录中的文件不能自动删除，导致磁盘被占满.
问题：这个目录中的临时文件只能手动删除么？不能自动删除？？？
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] xingchun-chen commented on issue #4114: [Question] data.basedir.path cleanup problem.
Posted by GitBox <gi...@apache.org>.
xingchun-chen commented on issue #4114:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4114#issuecomment-735588006
I am using version 1.3.3, which version is yours？
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] xingchun-chen commented on issue #4114: [Question] data.basedir.path cleanup problem.
Posted by GitBox <gi...@apache.org>.
xingchun-chen commented on issue #4114:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4114#issuecomment-735567588
I did not reproduce your question. the authority of the directory and file, that is the deployment user?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] baijun edited a comment on issue #4114: [Question] data.basedir.path cleanup problem.
Posted by GitBox <gi...@apache.org>.
baijun edited a comment on issue #4114:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4114#issuecomment-735582491
@xingchun-chen
The directory belongs to the Dolphinscheduler account. Files in the directory are not automatically cleared.
目录所属用户就是dolphinscheduler账户，目录中的文件并不会被自动清除。
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] xingchun-chen commented on issue #4114: [Question] data.basedir.path cleanup problem.
Posted by GitBox <gi...@apache.org>.
xingchun-chen commented on issue #4114:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4114#issuecomment-735595777
Is the service restarted after the developer mode is changed to false
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] baijun commented on issue #4114: [Question] data.basedir.path cleanup problem.
Posted by GitBox <gi...@apache.org>.
baijun commented on issue #4114:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4114#issuecomment-735647573
thx
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] baijun commented on issue #4114: [Question] data.basedir.path cleanup problem.
Posted by GitBox <gi...@apache.org>.
baijun commented on issue #4114:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4114#issuecomment-735582491
@xingchun-chen
目录所属用户就是dolphinscheduler账户，目录中的文件并不会被自动清除。
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] baijun edited a comment on issue #4114: [Question] data.basedir.path cleanup problem.
Posted by GitBox <gi...@apache.org>.
baijun edited a comment on issue #4114:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4114#issuecomment-735597562
@xingchun-chen
This configuration has not been changed, the default is false, and the cluster has not been changed since sh install.
这个配置并没有动过，默认就是false, sh install之后就没在动过集群.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] xingchun-chen commented on issue #4114: [Question] data.basedir.path cleanup problem.
Posted by GitBox <gi...@apache.org>.
xingchun-chen commented on issue #4114:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4114#issuecomment-735615997
Found the reason, because the assigned worker and master are not on the same node, the files in the directory are not deleted
Thank you very much for your feedback, this problem will be fixed in version 1.3.4
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] baijun commented on issue #4114: [Question] data.basedir.path cleanup problem.
Posted by GitBox <gi...@apache.org>.
baijun commented on issue #4114:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4114#issuecomment-735592090
@xingchun-chen 1.3.3 release
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] baijun closed issue #4114: [Question] data.basedir.path cleanup problem.
Posted by GitBox <gi...@apache.org>.
baijun closed issue #4114:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4114
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] baijun commented on issue #4114: [Question] data.basedir.path cleanup problem.
Posted by GitBox <gi...@apache.org>.
baijun commented on issue #4114:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4114#issuecomment-735597562
This configuration has not been changed, the default is false, and the cluster has not been changed since sh install.
这个配置并没有动过，默认就是false, sh install之后就没在动过集群.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] baijun edited a comment on issue #4114: [Question] data.basedir.path cleanup problem.
Posted by GitBox <gi...@apache.org>.
baijun edited a comment on issue #4114:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4114#issuecomment-735582491
@xingchun-chen
The directory belongs to the Dolphinscheduler account. Files in the directory are not automatically cleared.
目录所属用户就是dolphinscheduler账户，目录中的文件并不会被自动清除。
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org