You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by "DamoLong (via GitHub)" <gi...@apache.org> on 2025/10/21 07:43:34 UTC
[I] [Bug] [Module Name] 使用租户拉取hdfs文件,报没有权限,然后日志疯狂打印 [dolphinscheduler]
DamoLong opened a new issue, #17589:
URL: https://github.com/apache/dolphinscheduler/issues/17589
### Search before asking
- [x] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
### What happened
[INFO] 2025-10-21 15:27:46.503 +0800 - Executing shell command : sudo -u test_real -i /tmp/dolphinscheduler/exec/process/test_real /152672486149536/155234759000417_4/2290/18081/2290_18081.sh
[INFO] 2025-10-21 15:27:46.505 +0800 - process start, process id is: 28383
[INFO] 2025-10-21 15:27:48.505 +0800 - ->
get: /tmp/dolphinscheduler/exec/process/test_real /152672486149536/155234759000417_4/2290/18081/app.properties._COPYING_ (权限不够)
get: /tmp/dolphinscheduler/exec/process/test_real /152672486149536/155234759000417_4/2290/18081/offline-test.tar.gz._COPYING_ (权限不够)
get: /tmp/dolphinscheduler/exec/process/test_real /152672486149536/155234759000417_4/2290/18081/submit.sh._COPYING_ (权限不够)
然后控制台一直打印下列日志,停不下来,日志文件也在一直增长,如果这个bug应该会导致磁盘一直增长,只有重启
234, logPath:/data/dolphinscheduler-3.2.2-bin-standalone/standalone-server/logs/20251021/155234759000417/4/2289/18077.log
[INFO] 2025-10-21 15:30:39.849 +0800 o.a.d.a.s.i.LoggerServiceImpl:[189] - Query task instance log, taskInstanceId:18077, taskInstanceName:test-offline-tag, host: 10.208.64.205:1234, logPath:/data/dolphinscheduler-3.2.2-bin-standalone/standalone-server/logs/20251021/155234759000417/4/2289/18077.log
[INFO] 2025-10-21 15:30:39.854 +0800 o.a.d.a.s.i.LoggerServiceImpl:[189] - Query task instance log, taskInstanceId:18077, taskInstanceName:test-offline-tag, host: 10.208.64.205:1234, logPath:/data/dolphinscheduler-3.2.2-bin-standalone/standalone-server/logs/20251021/155234759000417/4/2289/18077.log
### What you expected to happen
日志打印出现问题,及时中止
### How to reproduce
使用租户test_real 上传文件,然后使用租户test_real 启动,设置了环境变量export HADOOP_USER_NAME=test_real
SCRIPT_DIR=$( cd -- "$( dirname -- "${BASH_SOURCE[0]}" )" &> /dev/null && pwd )
work_dir=/dolphinscheduler/test_real /resources
#下载程序包路径
hdfs dfs -get ${work_dir}/${packagePath}/* ./
### Anything else
_No response_
### Version
3.2.x
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Module Name] Use the tenant to pull hdfs files, but it reports that there is no permission, and then the logs are printed like crazy [dolphinscheduler]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #17589:
URL: https://github.com/apache/dolphinscheduler/issues/17589#issuecomment-3425223112
### Search before asking
- [x] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
### What happened
[INFO] 2025-10-21 15:27:46.503 +0800 - Executing shell command: sudo -u test_real -i /tmp/dolphinscheduler/exec/process/test_real /152672486149536/155234759000417_4/2290/18081/2290_18081.sh
[INFO] 2025-10-21 15:27:46.505 +0800 - process start, process id is: 28383
[INFO] 2025-10-21 15:27:48.505 +0800 - ->
get: /tmp/dolphinscheduler/exec/process/test_real /152672486149536/155234759000417_4/2290/18081/app.properties._COPYING_ (insufficient permissions)
get: /tmp/dolphinscheduler/exec/process/test_real /152672486149536/155234759000417_4/2290/18081/offline-test.tar.gz._COPYING_ (insufficient permissions)
get: /tmp/dolphinscheduler/exec/process/test_real /152672486149536/155234759000417_4/2290/18081/submit.sh._COPYING_ (insufficient permissions)
Then the console keeps printing the following logs and cannot stop, and the log files keep growing. If this bug should cause the disk to keep growing, the only way is to restart.
234, logPath:/data/dolphinscheduler-3.2.2-bin-standalone/standalone-server/logs/20251021/155234759000417/4/2289/18077.log
[INFO] 2025-10-21 15:30:39.849 +0800 o.a.d.a.s.i.LoggerServiceImpl:[189] - Query task instance log, taskInstanceId:18077, taskInstanceName:test-offline-tag, host: 10.208.64.205:1234, logPath:/data/dolphinscheduler-3.2.2-bin-standalone/standalone-server/logs/20251021/155234759000417/4/2289/18077.log
[INFO] 2025-10-21 15:30:39.854 +0800 o.a.d.a.s.i.LoggerServiceImpl:[189] - Query task instance log, taskInstanceId:18077, taskInstanceName:test-offline-tag, host: 10.208.64.205:1234, logPath:/data/dolphinscheduler-3.2.2-bin-standalone/standalone-server/logs/20251021/155234759000417/4/2289/18077.log
### What you expected to happen
If there is a problem with log printing, stop it immediately.
### How to reproduce
Use tenant test_real to upload files, then use tenant test_real to start, and set the environment variable export HADOOP_USER_NAME=test_real
SCRIPT_DIR=$( cd -- "$( dirname -- "${BASH_SOURCE[0]}" )" &> /dev/null && pwd )
work_dir=/dolphinscheduler/test_real /resources
#Download package path
hdfs dfs -get ${work_dir}/${packagePath}/* ./
### Anything else
_No response_
### Version
3.2.x
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Module Name] Use the tenant to pull hdfs files, but it reports that there is no permission, and then the logs are printed like crazy [dolphinscheduler]
Posted by "SbloodyS (via GitHub)" <gi...@apache.org>.
SbloodyS closed issue #17589: [Bug] [Module Name] Use the tenant to pull hdfs files, but it reports that there is no permission, and then the logs are printed like crazy
URL: https://github.com/apache/dolphinscheduler/issues/17589
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Module Name] Use the tenant to pull hdfs files, but it reports that there is no permission, and then the logs are printed like crazy [dolphinscheduler]
Posted by "DamoLong (via GitHub)" <gi...@apache.org>.
DamoLong commented on issue #17589:
URL: https://github.com/apache/dolphinscheduler/issues/17589#issuecomment-3430863834
这个如果实在3.2.2没办法升级的时候,请问修改哪些地方可以解决权限和那个日志打印的问题呢?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Module Name] Use the tenant to pull hdfs files, but it reports that there is no permission, and then the logs are printed like crazy [dolphinscheduler]
Posted by "SbloodyS (via GitHub)" <gi...@apache.org>.
SbloodyS commented on issue #17589:
URL: https://github.com/apache/dolphinscheduler/issues/17589#issuecomment-3430848706
Fixed in `3.3.X`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org