You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Tom White (JIRA)" <ji...@apache.org> on 2008/05/07 16:30:55 UTC
[jira] Created: (HADOOP-3361) Implement renames for
NativeS3FileSystem
Implement renames for NativeS3FileSystem
----------------------------------------
Key: HADOOP-3361
URL: https://issues.apache.org/jira/browse/HADOOP-3361
Project: Hadoop Core
Issue Type: New Feature
Components: fs/s3
Reporter: Tom White
Amazon S3 now supports a copy object operation (http://docs.amazonwebservices.com/AmazonS3/2006-03-01/UsingCopyingObjects.html). We can use this to properly support renames in NativeS3FileSystem.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3361) Implement renames for
NativeS3FileSystem
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White updated HADOOP-3361:
------------------------------
Status: Patch Available (was: Open)
Resubmitting to hudson.
> Implement renames for NativeS3FileSystem
> ----------------------------------------
>
> Key: HADOOP-3361
> URL: https://issues.apache.org/jira/browse/HADOOP-3361
> Project: Hadoop Core
> Issue Type: New Feature
> Components: fs/s3
> Reporter: Tom White
> Assignee: Tom White
> Fix For: 0.19.0
>
> Attachments: hadoop-3361.patch
>
>
> Amazon S3 now supports a copy object operation (http://docs.amazonwebservices.com/AmazonS3/2006-03-01/UsingCopyingObjects.html). We can use this to properly support renames in NativeS3FileSystem.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3361) Implement renames for
NativeS3FileSystem
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12626315#action_12626315 ]
Hadoop QA commented on HADOOP-3361:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12387820/hadoop-3361.patch
against trunk revision 689548.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 7 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed core unit tests.
-1 contrib tests. The patch failed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3124/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3124/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3124/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3124/console
This message is automatically generated.
> Implement renames for NativeS3FileSystem
> ----------------------------------------
>
> Key: HADOOP-3361
> URL: https://issues.apache.org/jira/browse/HADOOP-3361
> Project: Hadoop Core
> Issue Type: New Feature
> Components: fs/s3
> Reporter: Tom White
> Assignee: Tom White
> Fix For: 0.19.0
>
> Attachments: hadoop-3361.patch
>
>
> Amazon S3 now supports a copy object operation (http://docs.amazonwebservices.com/AmazonS3/2006-03-01/UsingCopyingObjects.html). We can use this to properly support renames in NativeS3FileSystem.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3361) Implement renames for
NativeS3FileSystem
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White updated HADOOP-3361:
------------------------------
Status: Open (was: Patch Available)
> Implement renames for NativeS3FileSystem
> ----------------------------------------
>
> Key: HADOOP-3361
> URL: https://issues.apache.org/jira/browse/HADOOP-3361
> Project: Hadoop Core
> Issue Type: New Feature
> Components: fs/s3
> Reporter: Tom White
> Assignee: Tom White
> Fix For: 0.19.0
>
> Attachments: hadoop-3361.patch
>
>
> Amazon S3 now supports a copy object operation (http://docs.amazonwebservices.com/AmazonS3/2006-03-01/UsingCopyingObjects.html). We can use this to properly support renames in NativeS3FileSystem.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (HADOOP-3361) Implement renames for
NativeS3FileSystem
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White resolved HADOOP-3361.
-------------------------------
Resolution: Fixed
I've just committed this. Thanks Albert!
> Implement renames for NativeS3FileSystem
> ----------------------------------------
>
> Key: HADOOP-3361
> URL: https://issues.apache.org/jira/browse/HADOOP-3361
> Project: Hadoop Core
> Issue Type: New Feature
> Components: fs/s3
> Reporter: Tom White
> Assignee: Tom White
> Fix For: 0.19.0
>
> Attachments: hadoop-3361.patch
>
>
> Amazon S3 now supports a copy object operation (http://docs.amazonwebservices.com/AmazonS3/2006-03-01/UsingCopyingObjects.html). We can use this to properly support renames in NativeS3FileSystem.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3361) Implement renames for
NativeS3FileSystem
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594923#action_12594923 ]
Tom White commented on HADOOP-3361:
-----------------------------------
The Jets3t library (http://jets3t.s3.amazonaws.com/index.html) has added support for copy (and rename), but not in a released version yet.
> Implement renames for NativeS3FileSystem
> ----------------------------------------
>
> Key: HADOOP-3361
> URL: https://issues.apache.org/jira/browse/HADOOP-3361
> Project: Hadoop Core
> Issue Type: New Feature
> Components: fs/s3
> Reporter: Tom White
>
> Amazon S3 now supports a copy object operation (http://docs.amazonwebservices.com/AmazonS3/2006-03-01/UsingCopyingObjects.html). We can use this to properly support renames in NativeS3FileSystem.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3361) Implement renames for
NativeS3FileSystem
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White updated HADOOP-3361:
------------------------------
Fix Version/s: 0.19.0
Assignee: Tom White
Status: Patch Available (was: Open)
> Implement renames for NativeS3FileSystem
> ----------------------------------------
>
> Key: HADOOP-3361
> URL: https://issues.apache.org/jira/browse/HADOOP-3361
> Project: Hadoop Core
> Issue Type: New Feature
> Components: fs/s3
> Reporter: Tom White
> Assignee: Tom White
> Fix For: 0.19.0
>
> Attachments: hadoop-3361.patch
>
>
> Amazon S3 now supports a copy object operation (http://docs.amazonwebservices.com/AmazonS3/2006-03-01/UsingCopyingObjects.html). We can use this to properly support renames in NativeS3FileSystem.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3361) Implement renames for
NativeS3FileSystem
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White updated HADOOP-3361:
------------------------------
Status: Patch Available (was: Open)
Trying hudson again.
> Implement renames for NativeS3FileSystem
> ----------------------------------------
>
> Key: HADOOP-3361
> URL: https://issues.apache.org/jira/browse/HADOOP-3361
> Project: Hadoop Core
> Issue Type: New Feature
> Components: fs/s3
> Reporter: Tom White
> Assignee: Tom White
> Fix For: 0.19.0
>
> Attachments: hadoop-3361.patch
>
>
> Amazon S3 now supports a copy object operation (http://docs.amazonwebservices.com/AmazonS3/2006-03-01/UsingCopyingObjects.html). We can use this to properly support renames in NativeS3FileSystem.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3361) Implement renames for
NativeS3FileSystem
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-3361:
----------------------------------
Status: Open (was: Patch Available)
Tom,
Can you resubmit this patch when the new version is released? Please attach the jar to the jira when it is available.
> Implement renames for NativeS3FileSystem
> ----------------------------------------
>
> Key: HADOOP-3361
> URL: https://issues.apache.org/jira/browse/HADOOP-3361
> Project: Hadoop Core
> Issue Type: New Feature
> Components: fs/s3
> Reporter: Tom White
> Assignee: Tom White
> Fix For: 0.19.0
>
> Attachments: hadoop-3361.patch
>
>
> Amazon S3 now supports a copy object operation (http://docs.amazonwebservices.com/AmazonS3/2006-03-01/UsingCopyingObjects.html). We can use this to properly support renames in NativeS3FileSystem.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3361) Implement renames for
NativeS3FileSystem
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White updated HADOOP-3361:
------------------------------
Status: Open (was: Patch Available)
> Implement renames for NativeS3FileSystem
> ----------------------------------------
>
> Key: HADOOP-3361
> URL: https://issues.apache.org/jira/browse/HADOOP-3361
> Project: Hadoop Core
> Issue Type: New Feature
> Components: fs/s3
> Reporter: Tom White
> Assignee: Tom White
> Fix For: 0.19.0
>
> Attachments: hadoop-3361.patch
>
>
> Amazon S3 now supports a copy object operation (http://docs.amazonwebservices.com/AmazonS3/2006-03-01/UsingCopyingObjects.html). We can use this to properly support renames in NativeS3FileSystem.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3361) Implement renames for
NativeS3FileSystem
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12627940#action_12627940 ]
Tom White commented on HADOOP-3361:
-----------------------------------
Owen,
Sorry, I wasn't clear. The new version of JetS3t (0.6.1) with rename support has been released and I committed it before submitting the patch in this issue to Hudon. The test failures are unrelated, so I believe this can be committed. I'll do it in the next couple of days unless anyone objects.
> Implement renames for NativeS3FileSystem
> ----------------------------------------
>
> Key: HADOOP-3361
> URL: https://issues.apache.org/jira/browse/HADOOP-3361
> Project: Hadoop Core
> Issue Type: New Feature
> Components: fs/s3
> Reporter: Tom White
> Assignee: Tom White
> Fix For: 0.19.0
>
> Attachments: hadoop-3361.patch
>
>
> Amazon S3 now supports a copy object operation (http://docs.amazonwebservices.com/AmazonS3/2006-03-01/UsingCopyingObjects.html). We can use this to properly support renames in NativeS3FileSystem.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3361) Implement renames for
NativeS3FileSystem
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White updated HADOOP-3361:
------------------------------
Attachment: hadoop-3361.patch
Here's a patch based on Albert's work in HADOOP-3912, with a couple of modifications to make the tests pass. This should not be committed until there's a new jets3t release.
This change is needed to use s3n as a MapReduce destination.
> Implement renames for NativeS3FileSystem
> ----------------------------------------
>
> Key: HADOOP-3361
> URL: https://issues.apache.org/jira/browse/HADOOP-3361
> Project: Hadoop Core
> Issue Type: New Feature
> Components: fs/s3
> Reporter: Tom White
> Attachments: hadoop-3361.patch
>
>
> Amazon S3 now supports a copy object operation (http://docs.amazonwebservices.com/AmazonS3/2006-03-01/UsingCopyingObjects.html). We can use this to properly support renames in NativeS3FileSystem.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3361) Implement renames for
NativeS3FileSystem
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12629145#action_12629145 ]
Hudson commented on HADOOP-3361:
--------------------------------
Integrated in Hadoop-trunk #597 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/597/])
> Implement renames for NativeS3FileSystem
> ----------------------------------------
>
> Key: HADOOP-3361
> URL: https://issues.apache.org/jira/browse/HADOOP-3361
> Project: Hadoop Core
> Issue Type: New Feature
> Components: fs/s3
> Reporter: Tom White
> Assignee: Tom White
> Fix For: 0.19.0
>
> Attachments: hadoop-3361.patch
>
>
> Amazon S3 now supports a copy object operation (http://docs.amazonwebservices.com/AmazonS3/2006-03-01/UsingCopyingObjects.html). We can use this to properly support renames in NativeS3FileSystem.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.