You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@oodt.apache.org by YunHee Kang <yu...@gmail.com> on 2012/08/06 07:27:59 UTC
The problem occurred when downloading a file by using a protocol
"sftp" in pushpull
Hi Brian,
I tried to download a file with sftp protocol in pushpull framework
and got two warnings and a severe error message as follows:
WARNING: Error occurred while connecting to RemoteSite: alias =
'SCPTESL2CO2' url = 'sftp://agent.bu.ac.kr' username = 'yhkang'
cdTestDir = 'null' maxConnections = '-1' : Failed to connect to host
agent.bu.ac.kr : reject HostKey: agent.bu.ac.kr
Aug 6, 2012 2:13:48 PM
org.apache.oodt.cas.pushpull.protocol.ProtocolHandler
getAppropriateProtocolBySite
WARNING: ProtocolFactory
org.apache.oodt.cas.protocol.sftp.JschSftpProtocolFactory is not
compatible with server at sftp://agent.bu.ac.kr
Aug 6, 2012 2:13:48 PM
org.apache.oodt.cas.pushpull.retrievalsystem.RetrievalSetup
retrieveFiles
SEVERE: Failed to finish downloading per property files
/home/yhkang/oodt-0.5/cas-pushpull/etc/examples/DirStructXmlParserFiles/SCPTESL2CO2.xml
: Failed to get appropriate protocol for RemoteSite: alias =
'SCPTESL2CO2' url = 'sftp://agent.bu.ac.kr' username = 'yhkang'
cdTestDir = 'null' maxConnections = '-1'
org.apache.oodt.cas.protocol.exceptions.ProtocolException: Failed to
get appropriate protocol for RemoteSite: alias = 'SCPTESL2CO2' url =
'sftp://agent.bu.ac.kr' username = 'yhkang' cdTestDir = 'null'
maxConnections = '-1'
at org.apache.oodt.cas.pushpull.protocol.ProtocolHandler.getAppropriateProtocolBySite(ProtocolHandler.java:166)
at org.apache.oodt.cas.pushpull.retrievalsystem.FileRetrievalSystem.changeToDir(FileRetrievalSystem.java:304)
at org.apache.oodt.cas.pushpull.retrievalmethod.RemoteCrawler.processPropFile(RemoteCrawler.java:104)
at org.apache.oodt.cas.pushpull.retrievalsystem.RetrievalSetup.retrieveFiles(RetrievalSetup.java:109)
at org.apache.oodt.cas.pushpull.daemon.Daemon$1.run(Daemon.java:218)
at java.lang.Thread.run(Thread.java:662)
Aug 6, 2012 2:13:48 PM org.apache.oodt.cas.pushpull.daemon.Daemon$1 run
INFO: Daemon with ID = 90121 on RMI registry port 9012 is shutting down
I think the warning message is related with an exception occurred in
the method connect() of JschSftpClient.java:
protected void connect(String host, final String username,
final String password) throws ProtocolException {
try {
System.out.println(System.getProperty("user.home") + "/.ssh/known_hosts");
jsch.setKnownHosts(System.getProperty("user.home") + "/.ssh/known_hosts");
session = jsch.getSession(username, this.getRemoteSite().getURL()
.getHost(), 22);
session.setPassword(password);
session.connect();
sftpChannel = (ChannelSftp) session.openChannel("sftp");
sftpChannel.connect();
} catch (Exception e) {
throw new ProtocolException("Failed to connect to host " + host + " : "
+ e.getMessage());
}
}
I make sure that there is no problem when downloading a file by scp
command without any password as follows:
scp yhkang@agent.bu.ac.kr://home/yhkang/oodt-0.5/TL2CO2N.005/2004.09.20/TES-Aura_L2-CO2-Nadir_r0000002147_F06_09.he5
.
TES-Aura_L2-CO2-Nadir_r0000002147_F06_09.he5 100% 88MB 87.9MB/s 00:01
Let me know how to fix the problem.
Thanks,
Yunhee
Re: The problem occurred when downloading a file by using a protocol
"sftp" in pushpull
Posted by YunHee Kang <yu...@gmail.com>.
Hi Chris,
Yes, I will do that.
Thanks,
Yunhee
2012/8/7 Mattmann, Chris A (388J) <ch...@jpl.nasa.gov>:
> Hi YunHee,
>
> Great job. Can you please file a JIRA issue for this and upload
> a patch file?
>
> Thank you!
>
> Cheers,
> Chris
>
> On Aug 6, 2012, at 1:28 AM, YunHee Kang wrote:
>
>> Hi Brian,
>>
>> I just have fixed the problem I had related with sftp protocol in
>> pushpull framework.
>> To fix it, I just added the following statement in the method
>> connect() in the file JschSftpProtocol.java.
>> session.setConfig("StrictHostKeyChecking", "no");
>>
>> You can get more details about the above statement in the following:
>> http://www.mail-archive.com/jsch-users@lists.sourceforge.net/msg00393.html
>>
>> Thanks,
>> Yunhee
>>
>>
>>
>>
>> 2012/8/6 YunHee Kang <yu...@gmail.com>:
>>> Hi Brian,
>>>
>>> I tried to download a file with sftp protocol in pushpull framework
>>> and got two warnings and a severe error message as follows:
>>> WARNING: Error occurred while connecting to RemoteSite: alias =
>>> 'SCPTESL2CO2' url = 'sftp://agent.bu.ac.kr' username = 'yhkang'
>>> cdTestDir = 'null' maxConnections = '-1' : Failed to connect to host
>>> agent.bu.ac.kr : reject HostKey: agent.bu.ac.kr
>>> Aug 6, 2012 2:13:48 PM
>>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler
>>> getAppropriateProtocolBySite
>>> WARNING: ProtocolFactory
>>> org.apache.oodt.cas.protocol.sftp.JschSftpProtocolFactory is not
>>> compatible with server at sftp://agent.bu.ac.kr
>>> Aug 6, 2012 2:13:48 PM
>>> org.apache.oodt.cas.pushpull.retrievalsystem.RetrievalSetup
>>> retrieveFiles
>>> SEVERE: Failed to finish downloading per property files
>>> /home/yhkang/oodt-0.5/cas-pushpull/etc/examples/DirStructXmlParserFiles/SCPTESL2CO2.xml
>>> : Failed to get appropriate protocol for RemoteSite: alias =
>>> 'SCPTESL2CO2' url = 'sftp://agent.bu.ac.kr' username = 'yhkang'
>>> cdTestDir = 'null' maxConnections = '-1'
>>> org.apache.oodt.cas.protocol.exceptions.ProtocolException: Failed to
>>> get appropriate protocol for RemoteSite: alias = 'SCPTESL2CO2' url =
>>> 'sftp://agent.bu.ac.kr' username = 'yhkang' cdTestDir = 'null'
>>> maxConnections = '-1'
>>> at org.apache.oodt.cas.pushpull.protocol.ProtocolHandler.getAppropriateProtocolBySite(ProtocolHandler.java:166)
>>> at org.apache.oodt.cas.pushpull.retrievalsystem.FileRetrievalSystem.changeToDir(FileRetrievalSystem.java:304)
>>> at org.apache.oodt.cas.pushpull.retrievalmethod.RemoteCrawler.processPropFile(RemoteCrawler.java:104)
>>> at org.apache.oodt.cas.pushpull.retrievalsystem.RetrievalSetup.retrieveFiles(RetrievalSetup.java:109)
>>> at org.apache.oodt.cas.pushpull.daemon.Daemon$1.run(Daemon.java:218)
>>> at java.lang.Thread.run(Thread.java:662)
>>> Aug 6, 2012 2:13:48 PM org.apache.oodt.cas.pushpull.daemon.Daemon$1 run
>>> INFO: Daemon with ID = 90121 on RMI registry port 9012 is shutting down
>>>
>>> I think the warning message is related with an exception occurred in
>>> the method connect() of JschSftpClient.java:
>>> protected void connect(String host, final String username,
>>> final String password) throws ProtocolException {
>>> try {
>>> System.out.println(System.getProperty("user.home") + "/.ssh/known_hosts");
>>> jsch.setKnownHosts(System.getProperty("user.home") + "/.ssh/known_hosts");
>>> session = jsch.getSession(username, this.getRemoteSite().getURL()
>>> .getHost(), 22);
>>> session.setPassword(password);
>>> session.connect();
>>> sftpChannel = (ChannelSftp) session.openChannel("sftp");
>>> sftpChannel.connect();
>>> } catch (Exception e) {
>>> throw new ProtocolException("Failed to connect to host " + host + " : "
>>> + e.getMessage());
>>> }
>>> }
>>>
>>> I make sure that there is no problem when downloading a file by scp
>>> command without any password as follows:
>>> scp yhkang@agent.bu.ac.kr://home/yhkang/oodt-0.5/TL2CO2N.005/2004.09.20/TES-Aura_L2-CO2-Nadir_r0000002147_F06_09.he5
>>> .
>>> TES-Aura_L2-CO2-Nadir_r0000002147_F06_09.he5 100% 88MB 87.9MB/s 00:01
>>>
>>> Let me know how to fix the problem.
>>>
>>> Thanks,
>>> Yunhee
>
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Chris Mattmann, Ph.D.
> Senior Computer Scientist
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 171-266B, Mailstop: 171-246
> Email: chris.a.mattmann@nasa.gov
> WWW: http://sunset.usc.edu/~mattmann/
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Adjunct Assistant Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
Re: The problem occurred when downloading a file by using a protocol
"sftp" in pushpull
Posted by YunHee Kang <yu...@gmail.com>.
Hi Chris,
Yes, I will do that.
Thanks,
Yunhee
2012/8/7 Mattmann, Chris A (388J) <ch...@jpl.nasa.gov>:
> Hi YunHee,
>
> Great job. Can you please file a JIRA issue for this and upload
> a patch file?
>
> Thank you!
>
> Cheers,
> Chris
>
> On Aug 6, 2012, at 1:28 AM, YunHee Kang wrote:
>
>> Hi Brian,
>>
>> I just have fixed the problem I had related with sftp protocol in
>> pushpull framework.
>> To fix it, I just added the following statement in the method
>> connect() in the file JschSftpProtocol.java.
>> session.setConfig("StrictHostKeyChecking", "no");
>>
>> You can get more details about the above statement in the following:
>> http://www.mail-archive.com/jsch-users@lists.sourceforge.net/msg00393.html
>>
>> Thanks,
>> Yunhee
>>
>>
>>
>>
>> 2012/8/6 YunHee Kang <yu...@gmail.com>:
>>> Hi Brian,
>>>
>>> I tried to download a file with sftp protocol in pushpull framework
>>> and got two warnings and a severe error message as follows:
>>> WARNING: Error occurred while connecting to RemoteSite: alias =
>>> 'SCPTESL2CO2' url = 'sftp://agent.bu.ac.kr' username = 'yhkang'
>>> cdTestDir = 'null' maxConnections = '-1' : Failed to connect to host
>>> agent.bu.ac.kr : reject HostKey: agent.bu.ac.kr
>>> Aug 6, 2012 2:13:48 PM
>>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler
>>> getAppropriateProtocolBySite
>>> WARNING: ProtocolFactory
>>> org.apache.oodt.cas.protocol.sftp.JschSftpProtocolFactory is not
>>> compatible with server at sftp://agent.bu.ac.kr
>>> Aug 6, 2012 2:13:48 PM
>>> org.apache.oodt.cas.pushpull.retrievalsystem.RetrievalSetup
>>> retrieveFiles
>>> SEVERE: Failed to finish downloading per property files
>>> /home/yhkang/oodt-0.5/cas-pushpull/etc/examples/DirStructXmlParserFiles/SCPTESL2CO2.xml
>>> : Failed to get appropriate protocol for RemoteSite: alias =
>>> 'SCPTESL2CO2' url = 'sftp://agent.bu.ac.kr' username = 'yhkang'
>>> cdTestDir = 'null' maxConnections = '-1'
>>> org.apache.oodt.cas.protocol.exceptions.ProtocolException: Failed to
>>> get appropriate protocol for RemoteSite: alias = 'SCPTESL2CO2' url =
>>> 'sftp://agent.bu.ac.kr' username = 'yhkang' cdTestDir = 'null'
>>> maxConnections = '-1'
>>> at org.apache.oodt.cas.pushpull.protocol.ProtocolHandler.getAppropriateProtocolBySite(ProtocolHandler.java:166)
>>> at org.apache.oodt.cas.pushpull.retrievalsystem.FileRetrievalSystem.changeToDir(FileRetrievalSystem.java:304)
>>> at org.apache.oodt.cas.pushpull.retrievalmethod.RemoteCrawler.processPropFile(RemoteCrawler.java:104)
>>> at org.apache.oodt.cas.pushpull.retrievalsystem.RetrievalSetup.retrieveFiles(RetrievalSetup.java:109)
>>> at org.apache.oodt.cas.pushpull.daemon.Daemon$1.run(Daemon.java:218)
>>> at java.lang.Thread.run(Thread.java:662)
>>> Aug 6, 2012 2:13:48 PM org.apache.oodt.cas.pushpull.daemon.Daemon$1 run
>>> INFO: Daemon with ID = 90121 on RMI registry port 9012 is shutting down
>>>
>>> I think the warning message is related with an exception occurred in
>>> the method connect() of JschSftpClient.java:
>>> protected void connect(String host, final String username,
>>> final String password) throws ProtocolException {
>>> try {
>>> System.out.println(System.getProperty("user.home") + "/.ssh/known_hosts");
>>> jsch.setKnownHosts(System.getProperty("user.home") + "/.ssh/known_hosts");
>>> session = jsch.getSession(username, this.getRemoteSite().getURL()
>>> .getHost(), 22);
>>> session.setPassword(password);
>>> session.connect();
>>> sftpChannel = (ChannelSftp) session.openChannel("sftp");
>>> sftpChannel.connect();
>>> } catch (Exception e) {
>>> throw new ProtocolException("Failed to connect to host " + host + " : "
>>> + e.getMessage());
>>> }
>>> }
>>>
>>> I make sure that there is no problem when downloading a file by scp
>>> command without any password as follows:
>>> scp yhkang@agent.bu.ac.kr://home/yhkang/oodt-0.5/TL2CO2N.005/2004.09.20/TES-Aura_L2-CO2-Nadir_r0000002147_F06_09.he5
>>> .
>>> TES-Aura_L2-CO2-Nadir_r0000002147_F06_09.he5 100% 88MB 87.9MB/s 00:01
>>>
>>> Let me know how to fix the problem.
>>>
>>> Thanks,
>>> Yunhee
>
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Chris Mattmann, Ph.D.
> Senior Computer Scientist
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 171-266B, Mailstop: 171-246
> Email: chris.a.mattmann@nasa.gov
> WWW: http://sunset.usc.edu/~mattmann/
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Adjunct Assistant Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
Re: The problem occurred when downloading a file by using a
protocol "sftp" in pushpull
Posted by "Mattmann, Chris A (388J)" <ch...@jpl.nasa.gov>.
Hi YunHee,
Great job. Can you please file a JIRA issue for this and upload
a patch file?
Thank you!
Cheers,
Chris
On Aug 6, 2012, at 1:28 AM, YunHee Kang wrote:
> Hi Brian,
>
> I just have fixed the problem I had related with sftp protocol in
> pushpull framework.
> To fix it, I just added the following statement in the method
> connect() in the file JschSftpProtocol.java.
> session.setConfig("StrictHostKeyChecking", "no");
>
> You can get more details about the above statement in the following:
> http://www.mail-archive.com/jsch-users@lists.sourceforge.net/msg00393.html
>
> Thanks,
> Yunhee
>
>
>
>
> 2012/8/6 YunHee Kang <yu...@gmail.com>:
>> Hi Brian,
>>
>> I tried to download a file with sftp protocol in pushpull framework
>> and got two warnings and a severe error message as follows:
>> WARNING: Error occurred while connecting to RemoteSite: alias =
>> 'SCPTESL2CO2' url = 'sftp://agent.bu.ac.kr' username = 'yhkang'
>> cdTestDir = 'null' maxConnections = '-1' : Failed to connect to host
>> agent.bu.ac.kr : reject HostKey: agent.bu.ac.kr
>> Aug 6, 2012 2:13:48 PM
>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler
>> getAppropriateProtocolBySite
>> WARNING: ProtocolFactory
>> org.apache.oodt.cas.protocol.sftp.JschSftpProtocolFactory is not
>> compatible with server at sftp://agent.bu.ac.kr
>> Aug 6, 2012 2:13:48 PM
>> org.apache.oodt.cas.pushpull.retrievalsystem.RetrievalSetup
>> retrieveFiles
>> SEVERE: Failed to finish downloading per property files
>> /home/yhkang/oodt-0.5/cas-pushpull/etc/examples/DirStructXmlParserFiles/SCPTESL2CO2.xml
>> : Failed to get appropriate protocol for RemoteSite: alias =
>> 'SCPTESL2CO2' url = 'sftp://agent.bu.ac.kr' username = 'yhkang'
>> cdTestDir = 'null' maxConnections = '-1'
>> org.apache.oodt.cas.protocol.exceptions.ProtocolException: Failed to
>> get appropriate protocol for RemoteSite: alias = 'SCPTESL2CO2' url =
>> 'sftp://agent.bu.ac.kr' username = 'yhkang' cdTestDir = 'null'
>> maxConnections = '-1'
>> at org.apache.oodt.cas.pushpull.protocol.ProtocolHandler.getAppropriateProtocolBySite(ProtocolHandler.java:166)
>> at org.apache.oodt.cas.pushpull.retrievalsystem.FileRetrievalSystem.changeToDir(FileRetrievalSystem.java:304)
>> at org.apache.oodt.cas.pushpull.retrievalmethod.RemoteCrawler.processPropFile(RemoteCrawler.java:104)
>> at org.apache.oodt.cas.pushpull.retrievalsystem.RetrievalSetup.retrieveFiles(RetrievalSetup.java:109)
>> at org.apache.oodt.cas.pushpull.daemon.Daemon$1.run(Daemon.java:218)
>> at java.lang.Thread.run(Thread.java:662)
>> Aug 6, 2012 2:13:48 PM org.apache.oodt.cas.pushpull.daemon.Daemon$1 run
>> INFO: Daemon with ID = 90121 on RMI registry port 9012 is shutting down
>>
>> I think the warning message is related with an exception occurred in
>> the method connect() of JschSftpClient.java:
>> protected void connect(String host, final String username,
>> final String password) throws ProtocolException {
>> try {
>> System.out.println(System.getProperty("user.home") + "/.ssh/known_hosts");
>> jsch.setKnownHosts(System.getProperty("user.home") + "/.ssh/known_hosts");
>> session = jsch.getSession(username, this.getRemoteSite().getURL()
>> .getHost(), 22);
>> session.setPassword(password);
>> session.connect();
>> sftpChannel = (ChannelSftp) session.openChannel("sftp");
>> sftpChannel.connect();
>> } catch (Exception e) {
>> throw new ProtocolException("Failed to connect to host " + host + " : "
>> + e.getMessage());
>> }
>> }
>>
>> I make sure that there is no problem when downloading a file by scp
>> command without any password as follows:
>> scp yhkang@agent.bu.ac.kr://home/yhkang/oodt-0.5/TL2CO2N.005/2004.09.20/TES-Aura_L2-CO2-Nadir_r0000002147_F06_09.he5
>> .
>> TES-Aura_L2-CO2-Nadir_r0000002147_F06_09.he5 100% 88MB 87.9MB/s 00:01
>>
>> Let me know how to fix the problem.
>>
>> Thanks,
>> Yunhee
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattmann@nasa.gov
WWW: http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Re: The problem occurred when downloading a file by using a
protocol "sftp" in pushpull
Posted by "Mattmann, Chris A (388J)" <ch...@jpl.nasa.gov>.
Hi YunHee,
Great job. Can you please file a JIRA issue for this and upload
a patch file?
Thank you!
Cheers,
Chris
On Aug 6, 2012, at 1:28 AM, YunHee Kang wrote:
> Hi Brian,
>
> I just have fixed the problem I had related with sftp protocol in
> pushpull framework.
> To fix it, I just added the following statement in the method
> connect() in the file JschSftpProtocol.java.
> session.setConfig("StrictHostKeyChecking", "no");
>
> You can get more details about the above statement in the following:
> http://www.mail-archive.com/jsch-users@lists.sourceforge.net/msg00393.html
>
> Thanks,
> Yunhee
>
>
>
>
> 2012/8/6 YunHee Kang <yu...@gmail.com>:
>> Hi Brian,
>>
>> I tried to download a file with sftp protocol in pushpull framework
>> and got two warnings and a severe error message as follows:
>> WARNING: Error occurred while connecting to RemoteSite: alias =
>> 'SCPTESL2CO2' url = 'sftp://agent.bu.ac.kr' username = 'yhkang'
>> cdTestDir = 'null' maxConnections = '-1' : Failed to connect to host
>> agent.bu.ac.kr : reject HostKey: agent.bu.ac.kr
>> Aug 6, 2012 2:13:48 PM
>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler
>> getAppropriateProtocolBySite
>> WARNING: ProtocolFactory
>> org.apache.oodt.cas.protocol.sftp.JschSftpProtocolFactory is not
>> compatible with server at sftp://agent.bu.ac.kr
>> Aug 6, 2012 2:13:48 PM
>> org.apache.oodt.cas.pushpull.retrievalsystem.RetrievalSetup
>> retrieveFiles
>> SEVERE: Failed to finish downloading per property files
>> /home/yhkang/oodt-0.5/cas-pushpull/etc/examples/DirStructXmlParserFiles/SCPTESL2CO2.xml
>> : Failed to get appropriate protocol for RemoteSite: alias =
>> 'SCPTESL2CO2' url = 'sftp://agent.bu.ac.kr' username = 'yhkang'
>> cdTestDir = 'null' maxConnections = '-1'
>> org.apache.oodt.cas.protocol.exceptions.ProtocolException: Failed to
>> get appropriate protocol for RemoteSite: alias = 'SCPTESL2CO2' url =
>> 'sftp://agent.bu.ac.kr' username = 'yhkang' cdTestDir = 'null'
>> maxConnections = '-1'
>> at org.apache.oodt.cas.pushpull.protocol.ProtocolHandler.getAppropriateProtocolBySite(ProtocolHandler.java:166)
>> at org.apache.oodt.cas.pushpull.retrievalsystem.FileRetrievalSystem.changeToDir(FileRetrievalSystem.java:304)
>> at org.apache.oodt.cas.pushpull.retrievalmethod.RemoteCrawler.processPropFile(RemoteCrawler.java:104)
>> at org.apache.oodt.cas.pushpull.retrievalsystem.RetrievalSetup.retrieveFiles(RetrievalSetup.java:109)
>> at org.apache.oodt.cas.pushpull.daemon.Daemon$1.run(Daemon.java:218)
>> at java.lang.Thread.run(Thread.java:662)
>> Aug 6, 2012 2:13:48 PM org.apache.oodt.cas.pushpull.daemon.Daemon$1 run
>> INFO: Daemon with ID = 90121 on RMI registry port 9012 is shutting down
>>
>> I think the warning message is related with an exception occurred in
>> the method connect() of JschSftpClient.java:
>> protected void connect(String host, final String username,
>> final String password) throws ProtocolException {
>> try {
>> System.out.println(System.getProperty("user.home") + "/.ssh/known_hosts");
>> jsch.setKnownHosts(System.getProperty("user.home") + "/.ssh/known_hosts");
>> session = jsch.getSession(username, this.getRemoteSite().getURL()
>> .getHost(), 22);
>> session.setPassword(password);
>> session.connect();
>> sftpChannel = (ChannelSftp) session.openChannel("sftp");
>> sftpChannel.connect();
>> } catch (Exception e) {
>> throw new ProtocolException("Failed to connect to host " + host + " : "
>> + e.getMessage());
>> }
>> }
>>
>> I make sure that there is no problem when downloading a file by scp
>> command without any password as follows:
>> scp yhkang@agent.bu.ac.kr://home/yhkang/oodt-0.5/TL2CO2N.005/2004.09.20/TES-Aura_L2-CO2-Nadir_r0000002147_F06_09.he5
>> .
>> TES-Aura_L2-CO2-Nadir_r0000002147_F06_09.he5 100% 88MB 87.9MB/s 00:01
>>
>> Let me know how to fix the problem.
>>
>> Thanks,
>> Yunhee
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattmann@nasa.gov
WWW: http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Re: The problem occurred when downloading a file by using a protocol
"sftp" in pushpull
Posted by YunHee Kang <yu...@gmail.com>.
Hi Brian,
I just have fixed the problem I had related with sftp protocol in
pushpull framework.
To fix it, I just added the following statement in the method
connect() in the file JschSftpProtocol.java.
session.setConfig("StrictHostKeyChecking", "no");
You can get more details about the above statement in the following:
http://www.mail-archive.com/jsch-users@lists.sourceforge.net/msg00393.html
Thanks,
Yunhee
2012/8/6 YunHee Kang <yu...@gmail.com>:
> Hi Brian,
>
> I tried to download a file with sftp protocol in pushpull framework
> and got two warnings and a severe error message as follows:
> WARNING: Error occurred while connecting to RemoteSite: alias =
> 'SCPTESL2CO2' url = 'sftp://agent.bu.ac.kr' username = 'yhkang'
> cdTestDir = 'null' maxConnections = '-1' : Failed to connect to host
> agent.bu.ac.kr : reject HostKey: agent.bu.ac.kr
> Aug 6, 2012 2:13:48 PM
> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler
> getAppropriateProtocolBySite
> WARNING: ProtocolFactory
> org.apache.oodt.cas.protocol.sftp.JschSftpProtocolFactory is not
> compatible with server at sftp://agent.bu.ac.kr
> Aug 6, 2012 2:13:48 PM
> org.apache.oodt.cas.pushpull.retrievalsystem.RetrievalSetup
> retrieveFiles
> SEVERE: Failed to finish downloading per property files
> /home/yhkang/oodt-0.5/cas-pushpull/etc/examples/DirStructXmlParserFiles/SCPTESL2CO2.xml
> : Failed to get appropriate protocol for RemoteSite: alias =
> 'SCPTESL2CO2' url = 'sftp://agent.bu.ac.kr' username = 'yhkang'
> cdTestDir = 'null' maxConnections = '-1'
> org.apache.oodt.cas.protocol.exceptions.ProtocolException: Failed to
> get appropriate protocol for RemoteSite: alias = 'SCPTESL2CO2' url =
> 'sftp://agent.bu.ac.kr' username = 'yhkang' cdTestDir = 'null'
> maxConnections = '-1'
> at org.apache.oodt.cas.pushpull.protocol.ProtocolHandler.getAppropriateProtocolBySite(ProtocolHandler.java:166)
> at org.apache.oodt.cas.pushpull.retrievalsystem.FileRetrievalSystem.changeToDir(FileRetrievalSystem.java:304)
> at org.apache.oodt.cas.pushpull.retrievalmethod.RemoteCrawler.processPropFile(RemoteCrawler.java:104)
> at org.apache.oodt.cas.pushpull.retrievalsystem.RetrievalSetup.retrieveFiles(RetrievalSetup.java:109)
> at org.apache.oodt.cas.pushpull.daemon.Daemon$1.run(Daemon.java:218)
> at java.lang.Thread.run(Thread.java:662)
> Aug 6, 2012 2:13:48 PM org.apache.oodt.cas.pushpull.daemon.Daemon$1 run
> INFO: Daemon with ID = 90121 on RMI registry port 9012 is shutting down
>
> I think the warning message is related with an exception occurred in
> the method connect() of JschSftpClient.java:
> protected void connect(String host, final String username,
> final String password) throws ProtocolException {
> try {
> System.out.println(System.getProperty("user.home") + "/.ssh/known_hosts");
> jsch.setKnownHosts(System.getProperty("user.home") + "/.ssh/known_hosts");
> session = jsch.getSession(username, this.getRemoteSite().getURL()
> .getHost(), 22);
> session.setPassword(password);
> session.connect();
> sftpChannel = (ChannelSftp) session.openChannel("sftp");
> sftpChannel.connect();
> } catch (Exception e) {
> throw new ProtocolException("Failed to connect to host " + host + " : "
> + e.getMessage());
> }
> }
>
> I make sure that there is no problem when downloading a file by scp
> command without any password as follows:
> scp yhkang@agent.bu.ac.kr://home/yhkang/oodt-0.5/TL2CO2N.005/2004.09.20/TES-Aura_L2-CO2-Nadir_r0000002147_F06_09.he5
> .
> TES-Aura_L2-CO2-Nadir_r0000002147_F06_09.he5 100% 88MB 87.9MB/s 00:01
>
> Let me know how to fix the problem.
>
> Thanks,
> Yunhee
Re: The problem occurred when downloading a file by using a protocol
"sftp" in pushpull
Posted by YunHee Kang <yu...@gmail.com>.
Hi Brian,
I just have fixed the problem I had related with sftp protocol in
pushpull framework.
To fix it, I just added the following statement in the method
connect() in the file JschSftpProtocol.java.
session.setConfig("StrictHostKeyChecking", "no");
You can get more details about the above statement in the following:
http://www.mail-archive.com/jsch-users@lists.sourceforge.net/msg00393.html
Thanks,
Yunhee
2012/8/6 YunHee Kang <yu...@gmail.com>:
> Hi Brian,
>
> I tried to download a file with sftp protocol in pushpull framework
> and got two warnings and a severe error message as follows:
> WARNING: Error occurred while connecting to RemoteSite: alias =
> 'SCPTESL2CO2' url = 'sftp://agent.bu.ac.kr' username = 'yhkang'
> cdTestDir = 'null' maxConnections = '-1' : Failed to connect to host
> agent.bu.ac.kr : reject HostKey: agent.bu.ac.kr
> Aug 6, 2012 2:13:48 PM
> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler
> getAppropriateProtocolBySite
> WARNING: ProtocolFactory
> org.apache.oodt.cas.protocol.sftp.JschSftpProtocolFactory is not
> compatible with server at sftp://agent.bu.ac.kr
> Aug 6, 2012 2:13:48 PM
> org.apache.oodt.cas.pushpull.retrievalsystem.RetrievalSetup
> retrieveFiles
> SEVERE: Failed to finish downloading per property files
> /home/yhkang/oodt-0.5/cas-pushpull/etc/examples/DirStructXmlParserFiles/SCPTESL2CO2.xml
> : Failed to get appropriate protocol for RemoteSite: alias =
> 'SCPTESL2CO2' url = 'sftp://agent.bu.ac.kr' username = 'yhkang'
> cdTestDir = 'null' maxConnections = '-1'
> org.apache.oodt.cas.protocol.exceptions.ProtocolException: Failed to
> get appropriate protocol for RemoteSite: alias = 'SCPTESL2CO2' url =
> 'sftp://agent.bu.ac.kr' username = 'yhkang' cdTestDir = 'null'
> maxConnections = '-1'
> at org.apache.oodt.cas.pushpull.protocol.ProtocolHandler.getAppropriateProtocolBySite(ProtocolHandler.java:166)
> at org.apache.oodt.cas.pushpull.retrievalsystem.FileRetrievalSystem.changeToDir(FileRetrievalSystem.java:304)
> at org.apache.oodt.cas.pushpull.retrievalmethod.RemoteCrawler.processPropFile(RemoteCrawler.java:104)
> at org.apache.oodt.cas.pushpull.retrievalsystem.RetrievalSetup.retrieveFiles(RetrievalSetup.java:109)
> at org.apache.oodt.cas.pushpull.daemon.Daemon$1.run(Daemon.java:218)
> at java.lang.Thread.run(Thread.java:662)
> Aug 6, 2012 2:13:48 PM org.apache.oodt.cas.pushpull.daemon.Daemon$1 run
> INFO: Daemon with ID = 90121 on RMI registry port 9012 is shutting down
>
> I think the warning message is related with an exception occurred in
> the method connect() of JschSftpClient.java:
> protected void connect(String host, final String username,
> final String password) throws ProtocolException {
> try {
> System.out.println(System.getProperty("user.home") + "/.ssh/known_hosts");
> jsch.setKnownHosts(System.getProperty("user.home") + "/.ssh/known_hosts");
> session = jsch.getSession(username, this.getRemoteSite().getURL()
> .getHost(), 22);
> session.setPassword(password);
> session.connect();
> sftpChannel = (ChannelSftp) session.openChannel("sftp");
> sftpChannel.connect();
> } catch (Exception e) {
> throw new ProtocolException("Failed to connect to host " + host + " : "
> + e.getMessage());
> }
> }
>
> I make sure that there is no problem when downloading a file by scp
> command without any password as follows:
> scp yhkang@agent.bu.ac.kr://home/yhkang/oodt-0.5/TL2CO2N.005/2004.09.20/TES-Aura_L2-CO2-Nadir_r0000002147_F06_09.he5
> .
> TES-Aura_L2-CO2-Nadir_r0000002147_F06_09.he5 100% 88MB 87.9MB/s 00:01
>
> Let me know how to fix the problem.
>
> Thanks,
> Yunhee