[jira] [Updated] (CAMEL-14947) camel-sftp: check for existance of remote directory using ls is very slow

["Claus Ibsen (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/CAMEL-14947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Claus Ibsen updated CAMEL-14947:
--------------------------------
    Issue Type: Improvement  (was: Bug)

> camel-sftp: check for existance of remote directory using ls is very slow
> -------------------------------------------------------------------------
>
>                 Key: CAMEL-14947
>                 URL: https://issues.apache.org/jira/browse/CAMEL-14947
>             Project: Camel
>          Issue Type: Improvement
>          Components: camel-ftp
>    Affects Versions: 2.25.1
>            Reporter: Christian Nedregård
>            Priority: Major
>
> In CAMEL-12733 the check for existing directories used by autoCreate was changed from {{ChannelSftp.cd}} to {{ChannelSftp.ls}} to fix a Windows specific issue.
> {{cd}} is a remote operation while {{ls}} will actually load the full directory listing and load it over the wire. This happens for every file that are to be written. If the remote directory has a lot of files this has a heavy performance penalty.
> In our case the directory some times contains 50.000+ files. Without autoCreate the writes take a few milliseconds. With autoCreate it takes up to 10 seconds due to the huge directory listing being generated and loaded over the wire for every single file to be written.
> This can be solved by reverting the directory check to a remote operation such as {{cd}} and fixing the Windows specific issue in another way.
> If it turns out that {{ls}} has to be used (unlikely) please note that there is another variant that takes a selector that enables you to abort the actual loading of the listing:
> {code:java}
> ls(String path, LsEntrySelector selector){code}
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)