You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Aaron Fabbri (JIRA)" <ji...@apache.org> on 2017/08/01 21:00:05 UTC
[jira] [Comment Edited] (HADOOP-13345) S3Guard: Improved
Consistency for S3A
[ https://issues.apache.org/jira/browse/HADOOP-13345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16109690#comment-16109690 ]
Aaron Fabbri edited comment on HADOOP-13345 at 8/1/17 9:00 PM:
---------------------------------------------------------------
I have a clean trunk merge commit ready to push. [~stevel@apache.org] would you like me to proceed?
I still have one key on a different bucket that gives me 400 errors. I have an AWS ticket open, no response yet.
On my new bucket, I ran:
mvn clean verify -Dit.test="ITestS3A*,ITestS3G*" -Dtest=none -Ds3guard
with zero failures in US West 2.
Edit: Also 100% passed with -Ddynamo in second run:
Results : Tests run: 395, Failures: 0, Errors: 0, Skipped: 57
was (Author: fabbri):
I have a clean trunk merge commit ready to push. [~stevel@apache.org] would you like me to proceed?
I still have one key on a different bucket that gives me 400 errors. I have an AWS ticket open, no response yet.
On my new bucket, I ran:
mvn clean verify -Dit.test="ITestS3A*,ITestS3G*" -Dtest=none -Ds3guard
with zero failures in US West 2. I'm re-running with dynamo now.
> S3Guard: Improved Consistency for S3A
> -------------------------------------
>
> Key: HADOOP-13345
> URL: https://issues.apache.org/jira/browse/HADOOP-13345
> Project: Hadoop Common
> Issue Type: New Feature
> Components: fs/s3
> Reporter: Chris Nauroth
> Assignee: Chris Nauroth
> Attachments: HADOOP-13345.prototype1.patch, s3c.001.patch, S3C-ConsistentListingonS3-Design.pdf, S3GuardImprovedConsistencyforS3A.pdf, S3GuardImprovedConsistencyforS3AV2.pdf
>
>
> This issue proposes S3Guard, a new feature of S3A, to provide an option for a stronger consistency model than what is currently offered. The solution coordinates with a strongly consistent external store to resolve inconsistencies caused by the S3 eventual consistency model.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org