You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "Jordi (JIRA)" <ji...@apache.org> on 2016/08/10 14:17:20 UTC

[jira] [Created] (SQOOP-2997) --password-file option triggers FileSystemClosed exception at end of Oozie action

Jordi created SQOOP-2997:
----------------------------

             Summary: --password-file option triggers FileSystemClosed exception at end of Oozie action
                 Key: SQOOP-2997
                 URL: https://issues.apache.org/jira/browse/SQOOP-2997
             Project: Sqoop
          Issue Type: Bug
    Affects Versions: 1.4.6
         Environment: Java 1.8 + CDH5.5.1
            Reporter: Jordi


When using  the --password-file option triggers FileSystemClosed exception at end of Oozie action.

This error was fixed for FilePasswordLoader class for sqoop-1.4.3, but it is also happening at CryptoFileLoader which extends from the fixed one.

https://issues.apache.org/jira/browse/SQOOP-1226

In this case we are using --password-file option with an encrypted file so we need to use CryptoFileLoder.

Error LOG:

Job commit failed: java.io.IOException: Filesystem closed 
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:837) 
at org.apache.hadoop.hdfs.DFSClient.create(DFSClient.java:1720) 
at org.apache.hadoop.hdfs.DFSClient.create(DFSClient.java:1662) 
at org.apache.hadoop.hdfs.DistributedFileSystem$6.doCall(DistributedFileSystem.java:404) 
at org.apache.hadoop.hdfs.DistributedFileSystem$6.doCall(DistributedFileSystem.java:400) 
at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) 
at org.apache.hadoop.hdfs.DistributedFileSystem.create(DistributedFileSystem.java:400) 
at org.apache.hadoop.hdfs.DistributedFileSystem.create(DistributedFileSystem.java:343) 
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:917) 
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:898) 
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:795) 
at org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler$EventProcessor.touchz(CommitterEventHandler.java:265) 
at org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler$EventProcessor.handleJobCommit(CommitterEventHandler.java:271) 
at org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler$EventProcessor.run(CommitterEventHandler.java:237) 
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) 
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
at java.lang.Thread.run(Thread.java:745) 
Average Map Time 57sec




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)