You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2022/06/30 06:36:44 UTC
[GitHub] [dolphinscheduler] huanzui opened a new issue, #10691: [Bug] [Module Name] S3Utils FlinkTasks download the file isn`t exists
huanzui opened a new issue, #10691:
URL: https://github.com/apache/dolphinscheduler/issues/10691
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
### What happened
3.0版本的也有这个问题，当用minio时能上传，路径自己创建了一个文件夹，如/jars/WordCount.jar，结果下载时全路径 dstFile = /logs/dolphinscheduler/exec/process/6001613416160/6026624232736_7/62/139/jars/WordCount.jar，jars路径无法自动创建，下载就报异常the file isn`t exists，在代码 S3Utils .java 163行 FileOutputStream fos = new FileOutputStream(new File(dstFile)))
### What you expected to happen
自定义路径能自动创建
### How to reproduce
检测下载路径，创建不存在的文件夹
### Anything else
_No response_
### Version
3.0.0-beta-1
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #10691: [Bug] [Module Name] S3Utils FlinkTasks download the file isn`t exists
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #10691:
URL: https://github.com/apache/dolphinscheduler/issues/10691#issuecomment-1170825471
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
### What happened
The 3.0 version also has this problem. When using minio, it can be uploaded. The path creates a folder by itself, such as /jars/WordCount.jar. When downloading the result, the full path dstFile = /logs/dolphinscheduler/exec/process/6001613416160/6026624232736_7/ 62/139/jars/WordCount.jar, the jars path cannot be created automatically, the file isn't exists is reported abnormally when downloading, in the code S3Utils.java line 163 FileOutputStream fos = new FileOutputStream(new File(dstFile)))
### What you expected to happen
Custom paths can be created automatically
### How to reproduce
Detect download paths, create non-existing folders
### Anything else
_No response_
### Version
3.0.0-beta-1
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] SbloodyS commented on issue #10691: [Bug] [Module Name] S3Utils FlinkTasks download the file isn`t exists
Posted by GitBox <gi...@apache.org>.
SbloodyS commented on issue #10691:
URL: https://github.com/apache/dolphinscheduler/issues/10691#issuecomment-1171046241
Dupliated with #10665.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #10691: [Bug] [Module Name] S3Utils FlinkTasks download the file isn`t exists
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #10691:
URL: https://github.com/apache/dolphinscheduler/issues/10691#issuecomment-1170825641
Thank you for your feedback, we have received your issue, Please wait patiently for a reply.
* In order for us to understand your request as soon as possible, please provide detailed information、version or pictures.
* If you haven't received a reply for a long time, you can [join our slack](https://s.apache.org/dolphinscheduler-slack) and send your question to channel `#troubleshooting`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] SbloodyS closed issue #10691: [Bug] [Module Name] S3Utils FlinkTasks download the file isn`t exists
Posted by GitBox <gi...@apache.org>.
SbloodyS closed issue #10691: [Bug] [Module Name] S3Utils FlinkTasks download the file isn`t exists
URL: https://github.com/apache/dolphinscheduler/issues/10691
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org