You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Daryn Sharp (JIRA)" <ji...@apache.org> on 2012/07/30 17:46:35 UTC
[jira] [Created] (HADOOP-8635) Cannot cancel paths registered
deleteOnExit
Daryn Sharp created HADOOP-8635:
-----------------------------------
Summary: Cannot cancel paths registered deleteOnExit
Key: HADOOP-8635
URL: https://issues.apache.org/jira/browse/HADOOP-8635
Project: Hadoop Common
Issue Type: Improvement
Components: fs
Affects Versions: 2.0.0-alpha, 0.23.0, 3.0.0
Reporter: Daryn Sharp
Assignee: Daryn Sharp
Priority: Critical
{{FileSystem#deleteOnExit}} does not have a symmetric method to unregister files. Since it's used to register temporary files during a copy operation, this can lead to a lot of unnecessary rpc operations for files successfully copied when the {{FileSystem}} is closed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8635) Cannot cancel paths registered
deleteOnExit
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13425315#comment-13425315 ]
Hudson commented on HADOOP-8635:
--------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #2597 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2597/])
HADOOP-8635. Cannot cancel paths registered deleteOnExit (daryn via bobby) (Revision 1367296)
Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1367296
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFileSystemCaching.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFilterFileSystem.java
> Cannot cancel paths registered deleteOnExit
> -------------------------------------------
>
> Key: HADOOP-8635
> URL: https://issues.apache.org/jira/browse/HADOOP-8635
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs
> Affects Versions: 0.23.0, 2.0.0-alpha, 3.0.0
> Reporter: Daryn Sharp
> Assignee: Daryn Sharp
> Priority: Critical
> Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
> Attachments: HADOOP-8635-1.patch, HADOOP-8635.patch
>
>
> {{FileSystem#deleteOnExit}} does not have a symmetric method to unregister files. Since it's used to register temporary files during a copy operation, this can lead to a lot of unnecessary rpc operations for files successfully copied when the {{FileSystem}} is closed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8635) Cannot cancel paths registered
deleteOnExit
Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13425128#comment-13425128 ]
Robert Joseph Evans commented on HADOOP-8635:
---------------------------------------------
The code is fairly simple, and looks good to me +1, assuming Jenkins comes back OK.
> Cannot cancel paths registered deleteOnExit
> -------------------------------------------
>
> Key: HADOOP-8635
> URL: https://issues.apache.org/jira/browse/HADOOP-8635
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs
> Affects Versions: 0.23.0, 2.0.0-alpha, 3.0.0
> Reporter: Daryn Sharp
> Assignee: Daryn Sharp
> Priority: Critical
> Attachments: HADOOP-8635.patch
>
>
> {{FileSystem#deleteOnExit}} does not have a symmetric method to unregister files. Since it's used to register temporary files during a copy operation, this can lead to a lot of unnecessary rpc operations for files successfully copied when the {{FileSystem}} is closed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8635) Cannot cancel paths registered
deleteOnExit
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13425197#comment-13425197 ]
Hadoop QA commented on HADOOP-8635:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12538398/HADOOP-8635-1.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 2 new or modified test files.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these unit tests in hadoop-common-project/hadoop-common:
org.apache.hadoop.ha.TestZKFailoverController
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/1233//testReport/
Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/1233//console
This message is automatically generated.
> Cannot cancel paths registered deleteOnExit
> -------------------------------------------
>
> Key: HADOOP-8635
> URL: https://issues.apache.org/jira/browse/HADOOP-8635
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs
> Affects Versions: 0.23.0, 2.0.0-alpha, 3.0.0
> Reporter: Daryn Sharp
> Assignee: Daryn Sharp
> Priority: Critical
> Attachments: HADOOP-8635-1.patch, HADOOP-8635.patch
>
>
> {{FileSystem#deleteOnExit}} does not have a symmetric method to unregister files. Since it's used to register temporary files during a copy operation, this can lead to a lot of unnecessary rpc operations for files successfully copied when the {{FileSystem}} is closed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8635) Cannot cancel paths registered
deleteOnExit
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13425310#comment-13425310 ]
Hudson commented on HADOOP-8635:
--------------------------------
Integrated in Hadoop-Common-trunk-Commit #2533 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2533/])
HADOOP-8635. Cannot cancel paths registered deleteOnExit (daryn via bobby) (Revision 1367296)
Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1367296
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFileSystemCaching.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFilterFileSystem.java
> Cannot cancel paths registered deleteOnExit
> -------------------------------------------
>
> Key: HADOOP-8635
> URL: https://issues.apache.org/jira/browse/HADOOP-8635
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs
> Affects Versions: 0.23.0, 2.0.0-alpha, 3.0.0
> Reporter: Daryn Sharp
> Assignee: Daryn Sharp
> Priority: Critical
> Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
> Attachments: HADOOP-8635-1.patch, HADOOP-8635.patch
>
>
> {{FileSystem#deleteOnExit}} does not have a symmetric method to unregister files. Since it's used to register temporary files during a copy operation, this can lead to a lot of unnecessary rpc operations for files successfully copied when the {{FileSystem}} is closed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8635) Cannot cancel paths registered
deleteOnExit
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13425353#comment-13425353 ]
Hudson commented on HADOOP-8635:
--------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #2553 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2553/])
HADOOP-8635. Cannot cancel paths registered deleteOnExit (daryn via bobby) (Revision 1367296)
Result = FAILURE
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1367296
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFileSystemCaching.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFilterFileSystem.java
> Cannot cancel paths registered deleteOnExit
> -------------------------------------------
>
> Key: HADOOP-8635
> URL: https://issues.apache.org/jira/browse/HADOOP-8635
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs
> Affects Versions: 0.23.0, 2.0.0-alpha, 3.0.0
> Reporter: Daryn Sharp
> Assignee: Daryn Sharp
> Priority: Critical
> Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
> Attachments: HADOOP-8635-1.patch, HADOOP-8635.patch
>
>
> {{FileSystem#deleteOnExit}} does not have a symmetric method to unregister files. Since it's used to register temporary files during a copy operation, this can lead to a lot of unnecessary rpc operations for files successfully copied when the {{FileSystem}} is closed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8635) Cannot cancel paths registered
deleteOnExit
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13425138#comment-13425138 ]
Hadoop QA commented on HADOOP-8635:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12538388/HADOOP-8635.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 1 new or modified test files.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these unit tests in hadoop-common-project/hadoop-common:
org.apache.hadoop.fs.TestFilterFileSystem
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/1232//testReport/
Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/1232//console
This message is automatically generated.
> Cannot cancel paths registered deleteOnExit
> -------------------------------------------
>
> Key: HADOOP-8635
> URL: https://issues.apache.org/jira/browse/HADOOP-8635
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs
> Affects Versions: 0.23.0, 2.0.0-alpha, 3.0.0
> Reporter: Daryn Sharp
> Assignee: Daryn Sharp
> Priority: Critical
> Attachments: HADOOP-8635.patch
>
>
> {{FileSystem#deleteOnExit}} does not have a symmetric method to unregister files. Since it's used to register temporary files during a copy operation, this can lead to a lot of unnecessary rpc operations for files successfully copied when the {{FileSystem}} is closed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8635) Cannot cancel paths registered
deleteOnExit
Posted by "Daryn Sharp (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daryn Sharp updated HADOOP-8635:
--------------------------------
Attachment: HADOOP-8635.patch
Add {{cancelDeleteOnExit}}. Add a lot of tests to cover {{deleteOnExit}} behavior.
> Cannot cancel paths registered deleteOnExit
> -------------------------------------------
>
> Key: HADOOP-8635
> URL: https://issues.apache.org/jira/browse/HADOOP-8635
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs
> Affects Versions: 0.23.0, 2.0.0-alpha, 3.0.0
> Reporter: Daryn Sharp
> Assignee: Daryn Sharp
> Priority: Critical
> Attachments: HADOOP-8635.patch
>
>
> {{FileSystem#deleteOnExit}} does not have a symmetric method to unregister files. Since it's used to register temporary files during a copy operation, this can lead to a lot of unnecessary rpc operations for files successfully copied when the {{FileSystem}} is closed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8635) Cannot cancel paths registered
deleteOnExit
Posted by "Daryn Sharp (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daryn Sharp updated HADOOP-8635:
--------------------------------
Status: Patch Available (was: Open)
> Cannot cancel paths registered deleteOnExit
> -------------------------------------------
>
> Key: HADOOP-8635
> URL: https://issues.apache.org/jira/browse/HADOOP-8635
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs
> Affects Versions: 2.0.0-alpha, 0.23.0, 3.0.0
> Reporter: Daryn Sharp
> Assignee: Daryn Sharp
> Priority: Critical
> Attachments: HADOOP-8635.patch
>
>
> {{FileSystem#deleteOnExit}} does not have a symmetric method to unregister files. Since it's used to register temporary files during a copy operation, this can lead to a lot of unnecessary rpc operations for files successfully copied when the {{FileSystem}} is closed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8635) Cannot cancel paths registered
deleteOnExit
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13425717#comment-13425717 ]
Hudson commented on HADOOP-8635:
--------------------------------
Integrated in Hadoop-Hdfs-0.23-Build #330 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/330/])
svn merge -c 1367296 FIXES: HADOOP-8635. Cannot cancel paths registered deleteOnExit (daryn via bobby) (Revision 1367298)
Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1367298
Files :
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFileSystemCaching.java
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFilterFileSystem.java
> Cannot cancel paths registered deleteOnExit
> -------------------------------------------
>
> Key: HADOOP-8635
> URL: https://issues.apache.org/jira/browse/HADOOP-8635
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs
> Affects Versions: 0.23.0, 2.0.0-alpha, 3.0.0
> Reporter: Daryn Sharp
> Assignee: Daryn Sharp
> Priority: Critical
> Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
> Attachments: HADOOP-8635-1.patch, HADOOP-8635.patch
>
>
> {{FileSystem#deleteOnExit}} does not have a symmetric method to unregister files. Since it's used to register temporary files during a copy operation, this can lead to a lot of unnecessary rpc operations for files successfully copied when the {{FileSystem}} is closed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8635) Cannot cancel paths registered
deleteOnExit
Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Joseph Evans updated HADOOP-8635:
----------------------------------------
Resolution: Fixed
Fix Version/s: 2.2.0-alpha
3.0.0
0.23.3
Status: Resolved (was: Patch Available)
Thanks Daryn +1,
I put this into trunk, branch-2, and branch-0.23
> Cannot cancel paths registered deleteOnExit
> -------------------------------------------
>
> Key: HADOOP-8635
> URL: https://issues.apache.org/jira/browse/HADOOP-8635
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs
> Affects Versions: 0.23.0, 2.0.0-alpha, 3.0.0
> Reporter: Daryn Sharp
> Assignee: Daryn Sharp
> Priority: Critical
> Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
> Attachments: HADOOP-8635-1.patch, HADOOP-8635.patch
>
>
> {{FileSystem#deleteOnExit}} does not have a symmetric method to unregister files. Since it's used to register temporary files during a copy operation, this can lead to a lot of unnecessary rpc operations for files successfully copied when the {{FileSystem}} is closed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Closed] (HADOOP-8635) Cannot cancel paths registered
deleteOnExit
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy closed HADOOP-8635.
---------------------------------
> Cannot cancel paths registered deleteOnExit
> -------------------------------------------
>
> Key: HADOOP-8635
> URL: https://issues.apache.org/jira/browse/HADOOP-8635
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs
> Affects Versions: 0.23.0, 2.0.0-alpha, 3.0.0
> Reporter: Daryn Sharp
> Assignee: Daryn Sharp
> Priority: Critical
> Fix For: 0.23.3, 2.0.2-alpha
>
> Attachments: HADOOP-8635-1.patch, HADOOP-8635.patch
>
>
> {{FileSystem#deleteOnExit}} does not have a symmetric method to unregister files. Since it's used to register temporary files during a copy operation, this can lead to a lot of unnecessary rpc operations for files successfully copied when the {{FileSystem}} is closed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8635) Cannot cancel paths registered
deleteOnExit
Posted by "Daryn Sharp (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daryn Sharp updated HADOOP-8635:
--------------------------------
Attachment: HADOOP-8635-1.patch
> Cannot cancel paths registered deleteOnExit
> -------------------------------------------
>
> Key: HADOOP-8635
> URL: https://issues.apache.org/jira/browse/HADOOP-8635
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs
> Affects Versions: 0.23.0, 2.0.0-alpha, 3.0.0
> Reporter: Daryn Sharp
> Assignee: Daryn Sharp
> Priority: Critical
> Attachments: HADOOP-8635-1.patch, HADOOP-8635.patch
>
>
> {{FileSystem#deleteOnExit}} does not have a symmetric method to unregister files. Since it's used to register temporary files during a copy operation, this can lead to a lot of unnecessary rpc operations for files successfully copied when the {{FileSystem}} is closed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira