[jira] [Created] (CAMEL-14947) camel-sftp: check for existance of remote directory using ls is very slow

["Christian Nedregård (Jira)" <ji...@apache.org>]

Christian Nedregård created CAMEL-14947:
-------------------------------------------

             Summary: camel-sftp: check for existance of remote directory using ls is very slow
                 Key: CAMEL-14947
                 URL: https://issues.apache.org/jira/browse/CAMEL-14947
             Project: Camel
          Issue Type: Bug
          Components: camel-ftp
    Affects Versions: 2.25.1
            Reporter: Christian Nedregård


In CAMEL-12733 the check for existing directories used by autoCreate was changed from {{ChannelSftp.cd}} to {{ChannelSftp.ls}} to fix a Windows specific issue.

{{cd}} is a remote operation while {{ls}} will actually load the full directory listing and load it over the wire. This happens for every file that are to be written. If the remote directory has a lot of files this has a heavy performance penalty.

In our case the directory some times contains 50.000+ files. Without autoCreate the writes take a few milliseconds. With autoCreate it takes up to 10 seconds due to the huge directory listing being generated and loaded over the wire for every single file to be written.

This can be solved by reverting the directory check to a remote operation such as {{cd}} and fixing the Windows specific issue in another way.

If it turns out that {{ls}} has to be used (unlikely) please note that there is another variant that takes a selector that enables you to abort the actual loading of the listing:
{code:java}
ls(String path, LsEntrySelector selector){code}
 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)