You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by "voyagertanyao (via GitHub)" <gi...@apache.org> on 2023/07/17 08:59:32 UTC

[GitHub] [seatunnel] voyagertanyao opened a new issue, #5098: [Feature][connector-v2] Support file path with wildcard for source connectors like SFTP/FTP

voyagertanyao opened a new issue, #5098:
URL: https://github.com/apache/seatunnel/issues/5098

   ### Search before asking
   
   - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.
   
   
   ### Description
   
   Seatunnel source connector sftp/ftp ,file path do not support wildcard format , e.g /dir1/dir2/*.csv.      /dir1/prifix_*.txt
   
   ### Usage Scenario
   
   _No response_
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [seatunnel] FlechazoW commented on issue #5098: [Feature][connector-v2] Support file path with wildcard for source connectors like SFTP/FTP

Posted by "FlechazoW (via GitHub)" <gi...@apache.org>.
FlechazoW commented on issue #5098:
URL: https://github.com/apache/seatunnel/issues/5098#issuecomment-1648831730

   I got it. I'll follow this issue. Please assign to me.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [seatunnel] voyagertanyao commented on issue #5098: [Feature][connector-v2] Support file path with wildcard for source connectors like SFTP/FTP

Posted by "voyagertanyao (via GitHub)" <gi...@apache.org>.
voyagertanyao commented on issue #5098:
URL: https://github.com/apache/seatunnel/issues/5098#issuecomment-1661352443

   > PR merged.
   
   Thanks So much


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [seatunnel] FlechazoW commented on issue #5098: [Feature][connector-v2] Support file path with wildcard for source connectors like SFTP/FTP

Posted by "FlechazoW (via GitHub)" <gi...@apache.org>.
FlechazoW commented on issue #5098:
URL: https://github.com/apache/seatunnel/issues/5098#issuecomment-1643562932

   Can you provide more detail?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [seatunnel] FlechazoW commented on issue #5098: [Feature][connector-v2] Support file path with wildcard for source connectors like SFTP/FTP

Posted by "FlechazoW (via GitHub)" <gi...@apache.org>.
FlechazoW commented on issue #5098:
URL: https://github.com/apache/seatunnel/issues/5098#issuecomment-1658219547

   PR merged.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [seatunnel] voyagertanyao commented on issue #5098: [Feature][connector-v2] Support file path with wildcard for source connectors like SFTP/FTP

Posted by "voyagertanyao (via GitHub)" <gi...@apache.org>.
voyagertanyao commented on issue #5098:
URL: https://github.com/apache/seatunnel/issues/5098#issuecomment-1645110461

   > Can you provide more detail?
   
   like this:
   NOW, for sftp/ftp source, the config parameter "path" can only be a single file or a directory, e.g.
   A:      path = "/tmp/user/2023-07-21/"
   B:      path = "/tmp/user/upload/00000_0.csv"
   scene A, we can get all files under path "/tmp/user/2023-07-21/",
   scene B, we can get this css file only under path "/tmp/user/upload/00000_0.csv"
   
   BUT, when I want to get files with format csv(whatever) under a  directory, e.g.
   <img width="774" alt="image" src="https://github.com/apache/seatunnel/assets/20474171/014c9807-6343-44ae-9ce4-f8a025594932">
    I can not config the path parameter like : path = "/tmp/user/2023-07-21/*.csv"
    this will lead to error , no such file found xxxxxx
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [seatunnel] nielifeng closed issue #5098: [Feature][connector-v2] Support file path with wildcard for source connectors like SFTP/FTP

Posted by "nielifeng (via GitHub)" <gi...@apache.org>.
nielifeng closed issue #5098: [Feature][connector-v2] Support file path with wildcard for source connectors like SFTP/FTP  
URL: https://github.com/apache/seatunnel/issues/5098


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [seatunnel] chenhaonan313 commented on issue #5098: [Feature][connector-v2] Support file path with wildcard for source connectors like SFTP/FTP

Posted by "chenhaonan313 (via GitHub)" <gi...@apache.org>.
chenhaonan313 commented on issue #5098:
URL: https://github.com/apache/seatunnel/issues/5098#issuecomment-1649352263

   I'm also looking for a way to do this scene


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org