You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2022/04/07 09:33:59 UTC

[GitHub] [dolphinscheduler] zhongjiajie opened a new issue, #9385: [Feature][resource] Add doc about how to config local file system or and `local` type of file system

zhongjiajie opened a new issue, #9385:
URL: https://github.com/apache/dolphinscheduler/issues/9385

   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar feature requirement.
   
   
   ### Description
   
   Currently, our config file of the resource center only supports `s3` and `hdfs`. https://github.com/apache/dolphinscheduler/blob/0e3cafec1d0a6529c6bb5371429a9b51bd60fd5a/dolphinscheduler-common/src/main/resources/common.properties#L22
   but our docs https://dolphinscheduler.apache.org/en-us/docs/latest/user_doc/guide/resource.html said we support a local file system.
   we could find some config demo in https://github.com/apache/dolphinscheduler/issues/5099. and we should add config demo about local file system by:
   * Just change our doc and add the demo config according to https://github.com/apache/dolphinscheduler/issues/5099
   * Add new type named `local`(a shortcut to set config `resource.storage.type=HDFS` and `fs.defaultFS=file:///`) to `resource.storage.type` and add some docs about it.
   
   ### Use case
   
   _No response_
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [dolphinscheduler] zhongjiajie commented on issue #9385: [Feature][resource] Add doc about how to config local file system or and `local` type of file system

Posted by GitBox <gi...@apache.org>.
zhongjiajie commented on issue #9385:
URL: https://github.com/apache/dolphinscheduler/issues/9385#issuecomment-1092393979

   > I think it's better to add a `local` type, which is easier to understand. But the complexity and difficulty of the adaptation need to evaluate.
   
   I think so, and I will go depth next week when I have time.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [dolphinscheduler] zhongjiajie commented on issue #9385: [Feature][resource] Add doc about how to config local file system or and `local` type of file system

Posted by "zhongjiajie (via GitHub)" <gi...@apache.org>.
zhongjiajie commented on issue #9385:
URL: https://github.com/apache/dolphinscheduler/issues/9385#issuecomment-1412033704

   close in #13303


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [dolphinscheduler] 106umao commented on issue #9385: [Feature][resource] Add doc about how to config local file system or and `local` type of file system

Posted by GitBox <gi...@apache.org>.
106umao commented on issue #9385:
URL: https://github.com/apache/dolphinscheduler/issues/9385#issuecomment-1139271861

   i will solve it @zhongjiajie 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [dolphinscheduler] zhongjiajie commented on issue #9385: [Feature][resource] Add doc about how to config local file system or and `local` type of file system

Posted by GitBox <gi...@apache.org>.
zhongjiajie commented on issue #9385:
URL: https://github.com/apache/dolphinscheduler/issues/9385#issuecomment-1091430778

   WDYT? @caishunfeng @ruanwenjun @nobolity what is your prefer solution or do you have a better solution?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [dolphinscheduler] SbloodyS commented on issue #9385: [Feature][resource] Add doc about how to config local file system or and `local` type of file system

Posted by GitBox <gi...@apache.org>.
SbloodyS commented on issue #9385:
URL: https://github.com/apache/dolphinscheduler/issues/9385#issuecomment-1139296112

   > i will solve it @zhongjiajie
   
   I have assigned to you. Looking forward to your contribution.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #9385: [Feature][resource] Add doc about how to config local file system or and `local` type of file system

Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #9385:
URL: https://github.com/apache/dolphinscheduler/issues/9385#issuecomment-1091429025

   Hi:
   * Thank you for your feedback, we have received your issue, Please wait patiently for a reply.
   * In order for us to understand your request as soon as possible, please provide detailed information、version or pictures.
   * If you haven't received a reply for a long time, you can subscribe to the developer's email,Mail subscription steps reference https://dolphinscheduler.apache.org/en-us/community/development/subscribe.html ,Then write the issue URL in the email content and send question to dev@dolphinscheduler.apache.org.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [dolphinscheduler] caishunfeng commented on issue #9385: [Feature][resource] Add doc about how to config local file system or and `local` type of file system

Posted by GitBox <gi...@apache.org>.
caishunfeng commented on issue #9385:
URL: https://github.com/apache/dolphinscheduler/issues/9385#issuecomment-1091682876

   I think it's better to add a `local` type, which is easier to understand. But the complexity and difficulty of the adaptation need to evaluate.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [dolphinscheduler] ruanwenjun commented on issue #9385: [Feature][resource] Add doc about how to config local file system or and `local` type of file system

Posted by GitBox <gi...@apache.org>.
ruanwenjun commented on issue #9385:
URL: https://github.com/apache/dolphinscheduler/issues/9385#issuecomment-1091527802

   > WDYT? @caishunfeng @ruanwenjun @nobolity what is your perfer solution or do you have a better solution?
   
   Both the two solutions are good to me. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [dolphinscheduler] zhongjiajie closed issue #9385: [Feature][resource] Add doc about how to config local file system or and `local` type of file system

Posted by "zhongjiajie (via GitHub)" <gi...@apache.org>.
zhongjiajie closed issue #9385: [Feature][resource] Add doc about how to config local file system or and `local` type of file system
URL: https://github.com/apache/dolphinscheduler/issues/9385


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org