You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by "kiwi-field (via GitHub)" <gi...@apache.org> on 2024/07/30 13:20:48 UTC
[I] [Feature][resource center ] Can the resource center support Tencent Cloud COS [dolphinscheduler]
kiwi-field opened a new issue, #16396:
URL: https://github.com/apache/dolphinscheduler/issues/16396
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar feature requirement.
### Description
I am currently using HDFS in the resource center and I want to migrate to Tencent Cloud COS uniformly. What changes do I need to make? Tencent Cloud's bucket is public read
### Use case
After switching to Tencent Cloud COS, you can perform upload, download, and preview operations in the resource center
### Related issues
_No response_
### Are you willing to submit a PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature][resource center ] Can the resource center support Tencent Cloud COS [dolphinscheduler]
Posted by "kiwi-field (via GitHub)" <gi...@apache.org>.
kiwi-field commented on issue #16396:
URL: https://github.com/apache/dolphinscheduler/issues/16396#issuecomment-2259455112
Can I connect to Tencent Cloud COS through the dependency of S3Utils and AWS Java SDK S3
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature][resource center] Can the resource center support Tencent Cloud COS [dolphinscheduler]
Posted by "fuchanghai (via GitHub)" <gi...@apache.org>.
fuchanghai commented on issue #16396:
URL: https://github.com/apache/dolphinscheduler/issues/16396#issuecomment-2308887382
for me ,it work
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature][resource center] Can the resource center support Tencent Cloud COS [dolphinscheduler]
Posted by "kiwi-field (via GitHub)" <gi...@apache.org>.
kiwi-field commented on issue #16396:
URL: https://github.com/apache/dolphinscheduler/issues/16396#issuecomment-2259465149
It is obvious that AWS Java SDK S3 is designed for Amazon S3 cloud services, not the S3 protocol
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature][resource center] Can the resource center support Tencent Cloud COS [dolphinscheduler]
Posted by "SbloodyS (via GitHub)" <gi...@apache.org>.
SbloodyS closed issue #16396: [Feature][resource center] Can the resource center support Tencent Cloud COS
URL: https://github.com/apache/dolphinscheduler/issues/16396
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature][resource center] Can the resource center support Tencent Cloud COS [dolphinscheduler]
Posted by "kiwi-field (via GitHub)" <gi...@apache.org>.
kiwi-field commented on issue #16396:
URL: https://github.com/apache/dolphinscheduler/issues/16396#issuecomment-2259505409
@SbloodyS
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature][resource center] Can the resource center support Tencent Cloud COS [dolphinscheduler]
Posted by "Mighten (via GitHub)" <gi...@apache.org>.
Mighten commented on issue #16396:
URL: https://github.com/apache/dolphinscheduler/issues/16396#issuecomment-2323307224
Hi, I am currently working on feature #16396 to support Tencent Cloud COS as a storage plugin in DS.
Could you please assign this issue to me?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature][resource center ] Can the resource center support Tencent Cloud COS [dolphinscheduler]
Posted by "SbloodyS (via GitHub)" <gi...@apache.org>.
SbloodyS commented on issue #16396:
URL: https://github.com/apache/dolphinscheduler/issues/16396#issuecomment-2259433400
Currently there are no plans to support it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature][resource center ] Can the resource center support Tencent Cloud COS [dolphinscheduler]
Posted by "SbloodyS (via GitHub)" <gi...@apache.org>.
SbloodyS commented on issue #16396:
URL: https://github.com/apache/dolphinscheduler/issues/16396#issuecomment-2259459616
You can try it, but cos doesn't work well with S3.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature][resource center] Can the resource center support Tencent Cloud COS [dolphinscheduler]
Posted by "kiwi-field (via GitHub)" <gi...@apache.org>.
kiwi-field commented on issue #16396:
URL: https://github.com/apache/dolphinscheduler/issues/16396#issuecomment-2259467106
The optional regions are shown in the above figure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature][resource center] Can the resource center support Tencent Cloud COS [dolphinscheduler]
Posted by "fuchanghai (via GitHub)" <gi...@apache.org>.
fuchanghai commented on issue #16396:
URL: https://github.com/apache/dolphinscheduler/issues/16396#issuecomment-2324385192
> Hi, I am currently working on this feature (#16396) to support Tencent Cloud COS as a storage plugin in DS.
>
> Could you please assign this issue to me?
>
> This work is due by September 30, 2024.
done
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature][resource center] Can the resource center support Tencent Cloud COS [dolphinscheduler]
Posted by "kiwi-field (via GitHub)" <gi...@apache.org>.
kiwi-field commented on issue #16396:
URL: https://github.com/apache/dolphinscheduler/issues/16396#issuecomment-2259463882
The above picture shows our program configuration, and when downloading from the resource center, the following error occurred。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org