You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hop.apache.org by "usbrandon (via GitHub)" <gi...@apache.org> on 2023/02/16 14:34:04 UTC
[GitHub] [hop] usbrandon opened a new issue, #2394: [Feature Request]: SFTP Transform to return as list of folders and files in a site.
usbrandon opened a new issue, #2394:
URL: https://github.com/apache/hop/issues/2394
### What would you like to happen?
Some of our vendors distribute files to us nightly contained in a folder named using a timestamp of when they produced the files.
I need a transform that can give me a list of folders and files within folders so I can narrow the list down to what I need to download.
Real scenario
The vendor creates timestamped folders representing when the data was prepared for us.
I need a way to figure out the latest folder in that list, then list the files inside the folder and commence downloading and processing them into our data warehouse.
I could use the same step twice, once to get a list of folders, then pass the latest to the step again so it will get me a file listing in that folder. Then I could send that file listing to an SFTP Get File step where it will download each one from my file list in the rowset.
### Issue Priority
Priority: 2
### Issue Component
Component: Transforms
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hop] hansva commented on issue #2394: [Feature Request]: SFTP Transform to return as list of folders and files in a site.
Posted by "hansva (via GitHub)" <gi...@apache.org>.
hansva commented on issue #2394:
URL: https://github.com/apache/hop/issues/2394#issuecomment-1473662546
Related (old) ticket: https://issues.apache.org/jira/browse/HOP-3797
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org