You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by "voyagertanyao (via GitHub)" <gi...@apache.org> on 2023/07/17 08:59:32 UTC
[GitHub] [seatunnel] voyagertanyao opened a new issue, #5098: [Feature][connector-v2] Support file path with wildcard for source connectors like SFTP/FTP
voyagertanyao opened a new issue, #5098:
URL: https://github.com/apache/seatunnel/issues/5098
### Search before asking
- [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.
### Description
Seatunnel source connector sftp/ftp ,file path do not support wildcard format , e.g /dir1/dir2/*.csv. /dir1/prifix_*.txt
### Usage Scenario
_No response_
### Related issues
_No response_
### Are you willing to submit a PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [seatunnel] FlechazoW commented on issue #5098: [Feature][connector-v2] Support file path with wildcard for source connectors like SFTP/FTP
Posted by "FlechazoW (via GitHub)" <gi...@apache.org>.
FlechazoW commented on issue #5098:
URL: https://github.com/apache/seatunnel/issues/5098#issuecomment-1648831730
I got it. I'll follow this issue. Please assign to me.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [seatunnel] voyagertanyao commented on issue #5098: [Feature][connector-v2] Support file path with wildcard for source connectors like SFTP/FTP
Posted by "voyagertanyao (via GitHub)" <gi...@apache.org>.
voyagertanyao commented on issue #5098:
URL: https://github.com/apache/seatunnel/issues/5098#issuecomment-1661352443
> PR merged.
Thanks So much
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [seatunnel] FlechazoW commented on issue #5098: [Feature][connector-v2] Support file path with wildcard for source connectors like SFTP/FTP
Posted by "FlechazoW (via GitHub)" <gi...@apache.org>.
FlechazoW commented on issue #5098:
URL: https://github.com/apache/seatunnel/issues/5098#issuecomment-1643562932
Can you provide more detail?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [seatunnel] FlechazoW commented on issue #5098: [Feature][connector-v2] Support file path with wildcard for source connectors like SFTP/FTP
Posted by "FlechazoW (via GitHub)" <gi...@apache.org>.
FlechazoW commented on issue #5098:
URL: https://github.com/apache/seatunnel/issues/5098#issuecomment-1658219547
PR merged.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [seatunnel] voyagertanyao commented on issue #5098: [Feature][connector-v2] Support file path with wildcard for source connectors like SFTP/FTP
Posted by "voyagertanyao (via GitHub)" <gi...@apache.org>.
voyagertanyao commented on issue #5098:
URL: https://github.com/apache/seatunnel/issues/5098#issuecomment-1645110461
> Can you provide more detail?
like this:
NOW, for sftp/ftp source, the config parameter "path" can only be a single file or a directory, e.g.
A: path = "/tmp/user/2023-07-21/"
B: path = "/tmp/user/upload/00000_0.csv"
scene A, we can get all files under path "/tmp/user/2023-07-21/",
scene B, we can get this css file only under path "/tmp/user/upload/00000_0.csv"
BUT, when I want to get files with format csv(whatever) under a directory, e.g.
<img width="774" alt="image" src="https://github.com/apache/seatunnel/assets/20474171/014c9807-6343-44ae-9ce4-f8a025594932">
I can not config the path parameter like : path = "/tmp/user/2023-07-21/*.csv"
this will lead to error , no such file found xxxxxx
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [seatunnel] nielifeng closed issue #5098: [Feature][connector-v2] Support file path with wildcard for source connectors like SFTP/FTP
Posted by "nielifeng (via GitHub)" <gi...@apache.org>.
nielifeng closed issue #5098: [Feature][connector-v2] Support file path with wildcard for source connectors like SFTP/FTP
URL: https://github.com/apache/seatunnel/issues/5098
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [seatunnel] chenhaonan313 commented on issue #5098: [Feature][connector-v2] Support file path with wildcard for source connectors like SFTP/FTP
Posted by "chenhaonan313 (via GitHub)" <gi...@apache.org>.
chenhaonan313 commented on issue #5098:
URL: https://github.com/apache/seatunnel/issues/5098#issuecomment-1649352263
I'm also looking for a way to do this scene
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org