You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@kafka.apache.org by vishnu murali <vi...@gmail.com> on 2020/05/18 13:44:39 UTC

Exception in SFTP CSV SOURCE

Hi Guys

By Trying SFTP CSV SOURCE i am getting this exception by using this
configuration.


what is the issue and how to resolve it?

can anyone know?

*Config:*
{
    "name": "CsvSFTP1",
    "config": {
        "tasks.max": "1",
        "connector.class":
"io.confluent.connect.sftp.SftpCsvSourceConnector",
        "cleanup.policy": "NONE",
        "behavior.on.error": "IGNORE",
        "input.path": "/mnt/c/Users/vmuralidharan/Desktop",
        "error.path": "/mnt/c/Users/vmuralidharan/Desktop/error",
        "finished.path": "/mnt/c/Users/vmuralidharan/Desktop/finished",
        "input.file.pattern": "orm.csv",
        "kafka.topic": "sftp-testing-topic",
        "csv.first.row.as.header": "true",
        "schema.generation.enabled": "false"
    }
}

*Exception StackTrace:*
org.apache.kafka.connect.errors.ConnectException: Can not get connection to
SFTP:
        at
io.confluent.connect.sftp.connection.SftpConnection.init(SftpConnection.java:115)
        at
io.confluent.connect.sftp.connection.SftpConnection.<init>(SftpConnection.java:66)
        at
io.confluent.connect.sftp.source.AbstractSftpSourceConnectorConfig.getSftpConnection(AbstractSftpSourceConnectorConfig.java:557)
        at
io.confluent.connect.sftp.source.AbstractSftpSourceConnectorConfig.<init>(AbstractSftpSourceConnectorConfig.java:242)
        at
io.confluent.connect.sftp.source.SftpSourceConnectorConfig.<init>(SftpSourceConnectorConfig.java:101)
        at
io.confluent.connect.sftp.source.SftpCsvSourceConnectorConfig.<init>(SftpCsvSourceConnectorConfig.java:157)
        at
io.confluent.connect.sftp.SftpCsvSourceConnector.start(SftpCsvSourceConnector.java:47)
        at
org.apache.kafka.connect.runtime.WorkerConnector.doStart(WorkerConnector.java:111)
        at
org.apache.kafka.connect.runtime.WorkerConnector.start(WorkerConnector.java:136)
        at
org.apache.kafka.connect.runtime.WorkerConnector.transitionTo(WorkerConnector.java:196)
        at
org.apache.kafka.connect.runtime.Worker.startConnector(Worker.java:260)
        at
org.apache.kafka.connect.runtime.distributed.DistributedHerder.startConnector(DistributedHerder.java:1183)
        at
org.apache.kafka.connect.runtime.distributed.DistributedHerder.access$1400(DistributedHerder.java:125)
        at
org.apache.kafka.connect.runtime.distributed.DistributedHerder$15.call(DistributedHerder.java:1199)
        at
org.apache.kafka.connect.runtime.distributed.DistributedHerder$15.call(DistributedHerder.java:1195)
        at
java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
        at
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: com.jcraft.jsch.JSchException: java.net.ConnectException:
Connection refused (Connection refused)
        at com.jcraft.jsch.Util.createSocket(Util.java:394)
        at com.jcraft.jsch.Session.connect(Session.java:215)
        at com.jcraft.jsch.Session.connect(Session.java:183)
        at
io.confluent.connect.sftp.connection.SftpConnection.init(SftpConnection.java:109)
        ... 18 more
Caused by: java.net.ConnectException: Connection refused (Connection
refused)
        at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
        at
java.base/java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:399)
        at
java.base/java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:242)
        at
java.base/java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:224)
        at
java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:403)
        at java.base/java.net.Socket.connect(Socket.java:609)
        at java.base/java.net.Socket.connect(Socket.java:558)
        at java.base/java.net.Socket.<init>(Socket.java:454)
        at java.base/java.net.Socket.<init>(Socket.java:231)
        at com.jcraft.jsch.Util$1.run(Util.java:362)

Re: Exception in SFTP CSV SOURCE

Posted by vishnu murali <vi...@gmail.com>.

I forwarded wrongly I suppose..

So is there any solution for that above exception...

On Tue, May 19, 2020, 22:35 Robin Moffatt <ro...@confluent.io> wrote:

> Hi Vishnu,
>
> I think there is a problem with your email client, it's just sent a
> duplicate of each of your emails from yesterday?
>
> thanks, Robin.
>
> On Tue, 19 May 2020 at 16:44, vishnu murali <vi...@gmail.com>
> wrote:
>
> > Hi Guys
> >
> > By Trying SFTP CSV SOURCE i am getting this exception by using this
> > configuration.
> >
> >
> > what is the issue and how to resolve it?
> >
> > can anyone know?
> >
> > *Config:*
> > {
> >     "name": "CsvSFTP1",
> >     "config": {
> >         "tasks.max": "1",
> >         "connector.class":
> > "io.confluent.connect.sftp.SftpCsvSourceConnector",
> >         "cleanup.policy": "NONE",
> >         "behavior.on.error": "IGNORE",
> >         "input.path": "/mnt/c/Users/vmuralidharan/Desktop",
> >         "error.path": "/mnt/c/Users/vmuralidharan/Desktop/error",
> >         "finished.path": "/mnt/c/Users/vmuralidharan/Desktop/finished",
> >         "input.file.pattern": "orm.csv",
> >         "kafka.topic": "sftp-testing-topic",
> >         "csv.first.row.as.header": "true",
> >         "schema.generation.enabled": "false"
> >     }
> > }
> >
> > *Exception StackTrace:*
> > org.apache.kafka.connect.errors.ConnectException: Can not get connection
> to
> > SFTP:
> >         at
> >
> >
> io.confluent.connect.sftp.connection.SftpConnection.init(SftpConnection.java:115)
> >         at
> >
> >
> io.confluent.connect.sftp.connection.SftpConnection.<init>(SftpConnection.java:66)
> >         at
> >
> >
> io.confluent.connect.sftp.source.AbstractSftpSourceConnectorConfig.getSftpConnection(AbstractSftpSourceConnectorConfig.java:557)
> >         at
> >
> >
> io.confluent.connect.sftp.source.AbstractSftpSourceConnectorConfig.<init>(AbstractSftpSourceConnectorConfig.java:242)
> >         at
> >
> >
> io.confluent.connect.sftp.source.SftpSourceConnectorConfig.<init>(SftpSourceConnectorConfig.java:101)
> >         at
> >
> >
> io.confluent.connect.sftp.source.SftpCsvSourceConnectorConfig.<init>(SftpCsvSourceConnectorConfig.java:157)
> >         at
> >
> >
> io.confluent.connect.sftp.SftpCsvSourceConnector.start(SftpCsvSourceConnector.java:47)
> >         at
> >
> >
> org.apache.kafka.connect.runtime.WorkerConnector.doStart(WorkerConnector.java:111)
> >         at
> >
> >
> org.apache.kafka.connect.runtime.WorkerConnector.start(WorkerConnector.java:136)
> >         at
> >
> >
> org.apache.kafka.connect.runtime.WorkerConnector.transitionTo(WorkerConnector.java:196)
> >         at
> > org.apache.kafka.connect.runtime.Worker.startConnector(Worker.java:260)
> >         at
> >
> >
> org.apache.kafka.connect.runtime.distributed.DistributedHerder.startConnector(DistributedHerder.java:1183)
> >         at
> >
> >
> org.apache.kafka.connect.runtime.distributed.DistributedHerder.access$1400(DistributedHerder.java:125)
> >         at
> >
> >
> org.apache.kafka.connect.runtime.distributed.DistributedHerder$15.call(DistributedHerder.java:1199)
> >         at
> >
> >
> org.apache.kafka.connect.runtime.distributed.DistributedHerder$15.call(DistributedHerder.java:1195)
> >         at
> > java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> >         at
> >
> >
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> >         at
> >
> >
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> >         at java.base/java.lang.Thread.run(Thread.java:834)
> > Caused by: com.jcraft.jsch.JSchException: java.net.ConnectException:
> > Connection refused (Connection refused)
> >         at com.jcraft.jsch.Util.createSocket(Util.java:394)
> >         at com.jcraft.jsch.Session.connect(Session.java:215)
> >         at com.jcraft.jsch.Session.connect(Session.java:183)
> >         at
> >
> >
> io.confluent.connect.sftp.connection.SftpConnection.init(SftpConnection.java:109)
> >         ... 18 more
> > Caused by: java.net.ConnectException: Connection refused (Connection
> > refused)
> >         at java.base/java.net.PlainSocketImpl.socketConnect(Native
> Method)
> >         at
> > java.base/java.net
> > .AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:399)
> >         at
> > java.base/java.net
> >
> .AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:242)
> >         at
> > java.base/java.net
> > .AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:224)
> >         at
> > java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:403)
> >         at java.base/java.net.Socket.connect(Socket.java:609)
> >         at java.base/java.net.Socket.connect(Socket.java:558)
> >         at java.base/java.net.Socket.<init>(Socket.java:454)
> >         at java.base/java.net.Socket.<init>(Socket.java:231)
> >         at com.jcraft.jsch.Util$1.run(Util.java:362)
> >
>

Re: Exception in SFTP CSV SOURCE

Posted by Robin Moffatt <ro...@confluent.io>.

Hi Vishnu,

I think there is a problem with your email client, it's just sent a
duplicate of each of your emails from yesterday?

thanks, Robin.

On Tue, 19 May 2020 at 16:44, vishnu murali <vi...@gmail.com>
wrote:

> Hi Guys
>
> By Trying SFTP CSV SOURCE i am getting this exception by using this
> configuration.
>
>
> what is the issue and how to resolve it?
>
> can anyone know?
>
> *Config:*
> {
>     "name": "CsvSFTP1",
>     "config": {
>         "tasks.max": "1",
>         "connector.class":
> "io.confluent.connect.sftp.SftpCsvSourceConnector",
>         "cleanup.policy": "NONE",
>         "behavior.on.error": "IGNORE",
>         "input.path": "/mnt/c/Users/vmuralidharan/Desktop",
>         "error.path": "/mnt/c/Users/vmuralidharan/Desktop/error",
>         "finished.path": "/mnt/c/Users/vmuralidharan/Desktop/finished",
>         "input.file.pattern": "orm.csv",
>         "kafka.topic": "sftp-testing-topic",
>         "csv.first.row.as.header": "true",
>         "schema.generation.enabled": "false"
>     }
> }
>
> *Exception StackTrace:*
> org.apache.kafka.connect.errors.ConnectException: Can not get connection to
> SFTP:
>         at
>
> io.confluent.connect.sftp.connection.SftpConnection.init(SftpConnection.java:115)
>         at
>
> io.confluent.connect.sftp.connection.SftpConnection.<init>(SftpConnection.java:66)
>         at
>
> io.confluent.connect.sftp.source.AbstractSftpSourceConnectorConfig.getSftpConnection(AbstractSftpSourceConnectorConfig.java:557)
>         at
>
> io.confluent.connect.sftp.source.AbstractSftpSourceConnectorConfig.<init>(AbstractSftpSourceConnectorConfig.java:242)
>         at
>
> io.confluent.connect.sftp.source.SftpSourceConnectorConfig.<init>(SftpSourceConnectorConfig.java:101)
>         at
>
> io.confluent.connect.sftp.source.SftpCsvSourceConnectorConfig.<init>(SftpCsvSourceConnectorConfig.java:157)
>         at
>
> io.confluent.connect.sftp.SftpCsvSourceConnector.start(SftpCsvSourceConnector.java:47)
>         at
>
> org.apache.kafka.connect.runtime.WorkerConnector.doStart(WorkerConnector.java:111)
>         at
>
> org.apache.kafka.connect.runtime.WorkerConnector.start(WorkerConnector.java:136)
>         at
>
> org.apache.kafka.connect.runtime.WorkerConnector.transitionTo(WorkerConnector.java:196)
>         at
> org.apache.kafka.connect.runtime.Worker.startConnector(Worker.java:260)
>         at
>
> org.apache.kafka.connect.runtime.distributed.DistributedHerder.startConnector(DistributedHerder.java:1183)
>         at
>
> org.apache.kafka.connect.runtime.distributed.DistributedHerder.access$1400(DistributedHerder.java:125)
>         at
>
> org.apache.kafka.connect.runtime.distributed.DistributedHerder$15.call(DistributedHerder.java:1199)
>         at
>
> org.apache.kafka.connect.runtime.distributed.DistributedHerder$15.call(DistributedHerder.java:1195)
>         at
> java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
>         at
>
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
>         at
>
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
>         at java.base/java.lang.Thread.run(Thread.java:834)
> Caused by: com.jcraft.jsch.JSchException: java.net.ConnectException:
> Connection refused (Connection refused)
>         at com.jcraft.jsch.Util.createSocket(Util.java:394)
>         at com.jcraft.jsch.Session.connect(Session.java:215)
>         at com.jcraft.jsch.Session.connect(Session.java:183)
>         at
>
> io.confluent.connect.sftp.connection.SftpConnection.init(SftpConnection.java:109)
>         ... 18 more
> Caused by: java.net.ConnectException: Connection refused (Connection
> refused)
>         at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
>         at
> java.base/java.net
> .AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:399)
>         at
> java.base/java.net
> .AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:242)
>         at
> java.base/java.net
> .AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:224)
>         at
> java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:403)
>         at java.base/java.net.Socket.connect(Socket.java:609)
>         at java.base/java.net.Socket.connect(Socket.java:558)
>         at java.base/java.net.Socket.<init>(Socket.java:454)
>         at java.base/java.net.Socket.<init>(Socket.java:231)
>         at com.jcraft.jsch.Util$1.run(Util.java:362)
>

Fwd: Exception in SFTP CSV SOURCE

Posted by vishnu murali <vi...@gmail.com>.

Hi Guys

By Trying SFTP CSV SOURCE i am getting this exception by using this
configuration.


what is the issue and how to resolve it?

can anyone know?

*Config:*
{
    "name": "CsvSFTP1",
    "config": {
        "tasks.max": "1",
        "connector.class":
"io.confluent.connect.sftp.SftpCsvSourceConnector",
        "cleanup.policy": "NONE",
        "behavior.on.error": "IGNORE",
        "input.path": "/mnt/c/Users/vmuralidharan/Desktop",
        "error.path": "/mnt/c/Users/vmuralidharan/Desktop/error",
        "finished.path": "/mnt/c/Users/vmuralidharan/Desktop/finished",
        "input.file.pattern": "orm.csv",
        "kafka.topic": "sftp-testing-topic",
        "csv.first.row.as.header": "true",
        "schema.generation.enabled": "false"
    }
}

*Exception StackTrace:*
org.apache.kafka.connect.errors.ConnectException: Can not get connection to
SFTP:
        at
io.confluent.connect.sftp.connection.SftpConnection.init(SftpConnection.java:115)
        at
io.confluent.connect.sftp.connection.SftpConnection.<init>(SftpConnection.java:66)
        at
io.confluent.connect.sftp.source.AbstractSftpSourceConnectorConfig.getSftpConnection(AbstractSftpSourceConnectorConfig.java:557)
        at
io.confluent.connect.sftp.source.AbstractSftpSourceConnectorConfig.<init>(AbstractSftpSourceConnectorConfig.java:242)
        at
io.confluent.connect.sftp.source.SftpSourceConnectorConfig.<init>(SftpSourceConnectorConfig.java:101)
        at
io.confluent.connect.sftp.source.SftpCsvSourceConnectorConfig.<init>(SftpCsvSourceConnectorConfig.java:157)
        at
io.confluent.connect.sftp.SftpCsvSourceConnector.start(SftpCsvSourceConnector.java:47)
        at
org.apache.kafka.connect.runtime.WorkerConnector.doStart(WorkerConnector.java:111)
        at
org.apache.kafka.connect.runtime.WorkerConnector.start(WorkerConnector.java:136)
        at
org.apache.kafka.connect.runtime.WorkerConnector.transitionTo(WorkerConnector.java:196)
        at
org.apache.kafka.connect.runtime.Worker.startConnector(Worker.java:260)
        at
org.apache.kafka.connect.runtime.distributed.DistributedHerder.startConnector(DistributedHerder.java:1183)
        at
org.apache.kafka.connect.runtime.distributed.DistributedHerder.access$1400(DistributedHerder.java:125)
        at
org.apache.kafka.connect.runtime.distributed.DistributedHerder$15.call(DistributedHerder.java:1199)
        at
org.apache.kafka.connect.runtime.distributed.DistributedHerder$15.call(DistributedHerder.java:1195)
        at
java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
        at
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: com.jcraft.jsch.JSchException: java.net.ConnectException:
Connection refused (Connection refused)
        at com.jcraft.jsch.Util.createSocket(Util.java:394)
        at com.jcraft.jsch.Session.connect(Session.java:215)
        at com.jcraft.jsch.Session.connect(Session.java:183)
        at
io.confluent.connect.sftp.connection.SftpConnection.init(SftpConnection.java:109)
        ... 18 more
Caused by: java.net.ConnectException: Connection refused (Connection
refused)
        at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
        at
java.base/java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:399)
        at
java.base/java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:242)
        at
java.base/java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:224)
        at
java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:403)
        at java.base/java.net.Socket.connect(Socket.java:609)
        at java.base/java.net.Socket.connect(Socket.java:558)
        at java.base/java.net.Socket.<init>(Socket.java:454)
        at java.base/java.net.Socket.<init>(Socket.java:231)
        at com.jcraft.jsch.Util$1.run(Util.java:362)