You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2021/08/11 05:00:03 UTC

[jira] [Work logged] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

     [ https://issues.apache.org/jira/browse/HADOOP-13887?focusedWorklogId=636742&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-636742 ]

ASF GitHub Bot logged work on HADOOP-13887:
-------------------------------------------

                Author: ASF GitHub Bot
            Created on: 11/Aug/21 04:59
            Start Date: 11/Aug/21 04:59
    Worklog Time Spent: 10m 
      Work Description: mehakmeet opened a new pull request #3292:
URL: https://github.com/apache/hadoop/pull/3292


   Region: ap-south-1.
   `mvn clean verify -Dparallel-tests -DtestsThreadCount=4 -Dscale`
   
   ### CSE ON, S3Guard ON
   ```
   [INFO] Results:
   [INFO] 
   [WARNING] Tests run: 575, Failures: 0, Errors: 0, Skipped: 5
   ```
   ```
   [INFO] Results:
   [INFO] 
   [WARNING] Tests run: 1476, Failures: 0, Errors: 0, Skipped: 1277
   ```
   ```
   [INFO] Results:
   [INFO] 
   [WARNING] Tests run: 151, Failures: 0, Errors: 0, Skipped: 125
   ```
   
   ### CSE ON, S3Guard OFF
   
   ```
   [INFO] Results:
   [INFO] 
   [WARNING] Tests run: 575, Failures: 0, Errors: 0, Skipped: 5
   ```
   ```
   [INFO] Results:
   [INFO] 
   [ERROR] Errors: 
   [ERROR]   ITestS3AMiscOperationCost.testGetContentSummaryRoot:96->AbstractS3ACostTest.verifyMetrics:376->lambda$testGetContentSummaryRoot$1:96->getContentSummary:140 » TestTimedOut
   [ERROR]   ITestS3AMiscOperationCost.testGetContentSummaryRoot:96->AbstractS3ACostTest.verifyMetrics:376->lambda$testGetContentSummaryRoot$1:96->getContentSummary:140 » TestTimedOut
   [INFO] 
   [ERROR] Tests run: 1476, Failures: 0, Errors: 2, Skipped: 641
   ```
   ```
   [ERROR] Errors: 
   [ERROR]   ITestS3AContractRootDir>AbstractContractRootDirectoryTest.testRecursiveRootListing:267 » TestTimedOut
   [INFO] 
   [ERROR] Tests run: 151, Failures: 1, Errors: 1, Skipped: 28
   ```
   
   ### CSE OFF, S3Guard ON
   
   ```
   [INFO] Results:
   [INFO] 
   [WARNING] Tests run: 575, Failures: 0, Errors: 0, Skipped: 5
   ```
   ```
   [INFO] Results:
   [INFO] 
   [ERROR] Errors: 
   [ERROR]   ITestS3AFileSystemContract>FileSystemContractBaseTest.testLSRootDir:835->FileSystemContractBaseTest.assertListFilesFinds:850 » TestTimedOut
   [ERROR]   ITestS3AMiscOperationCost.testGetContentSummaryRoot:96->AbstractS3ACostTest.verifyMetrics:376->lambda$testGetContentSummaryRoot$1:96->getContentSummary:140 » TestTimedOut
   [ERROR]   ITestS3AMiscOperationCost.testGetContentSummaryRoot:96->AbstractS3ACostTest.verifyMetrics:376->lambda$testGetContentSummaryRoot$1:96->getContentSummary:140 » TestTimedOut
   [INFO] 
   [ERROR] Tests run: 1476, Failures: 0, Errors: 3, Skipped: 405
   ```
   ```
   [INFO] Results:
   [INFO] 
   [ERROR] Errors: 
   [ERROR]   ITestS3AContractRootDir.testListEmptyRootDirectory:82->AbstractContractRootDirectoryTest.testListEmptyRootDirectory:196 » TestTimedOut
   [ERROR]   ITestS3AContractRootDir>AbstractContractRootDirectoryTest.testRecursiveRootListing:265 » TestTimedOut
   [ERROR]   ITestS3AContractRootDir>AbstractContractRootDirectoryTest.testRmEmptyRootDirNonRecursive:101 » TestTimedOut
   [INFO] 
   [ERROR] Tests run: 11, Failures: 0, Errors: 3, Skipped: 0
   ```
   
   ### CSE OFF, S3Guard OFF
   
   ```
   [INFO] Results:
   [INFO] 
   [WARNING] Tests run: 575, Failures: 0, Errors: 0, Skipped: 5
   ```
   ```
   [INFO] Results:
   [INFO] 
   [ERROR] Errors: 
   [ERROR]   ITestS3AMiscOperationCost.testGetContentSummaryRoot:96->AbstractS3ACostTest.verifyMetrics:376->lambda$testGetContentSummaryRoot$1:96->getContentSummary:140 » TestTimedOut
   [ERROR]   ITestS3AMiscOperationCost.testGetContentSummaryRoot:96->AbstractS3ACostTest.verifyMetrics:376->lambda$testGetContentSummaryRoot$1:96->getContentSummary:140 » TestTimedOut
   [INFO] 
   [ERROR] Tests run: 1476, Failures: 0, Errors: 2, Skipped: 467
   ```
   ```
   [ERROR] Errors: 
   [ERROR]   ITestS3AContractRootDir>AbstractContractRootDirectoryTest.testRecursiveRootListing:267 » TestTimedOut
   [INFO] 
   [ERROR] Tests run: 151, Failures: 1, Errors: 1, Skipped: 28
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

    Worklog Id:     (was: 636742)
    Time Spent: 11h 50m  (was: 11h 40m)

> Encrypt S3A data client-side with AWS SDK (S3-CSE)
> --------------------------------------------------
>
>                 Key: HADOOP-13887
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13887
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>    Affects Versions: 2.8.0
>            Reporter: Jeeyoung Kim
>            Assignee: Mehakmeet Singh
>            Priority: Minor
>              Labels: pull-request-available
>             Fix For: 3.4.0
>
>         Attachments: HADOOP-13887-002.patch, HADOOP-13887-007.patch, HADOOP-13887-branch-2-003.patch, HADOOP-13897-branch-2-004.patch, HADOOP-13897-branch-2-005.patch, HADOOP-13897-branch-2-006.patch, HADOOP-13897-branch-2-008.patch, HADOOP-13897-branch-2-009.patch, HADOOP-13897-branch-2-010.patch, HADOOP-13897-branch-2-012.patch, HADOOP-13897-branch-2-014.patch, HADOOP-13897-trunk-011.patch, HADOOP-13897-trunk-013.patch, HADOOP-14171-001.patch, S3-CSE Proposal.pdf
>
>          Time Spent: 11h 50m
>  Remaining Estimate: 0h
>
> Expose the client-side encryption option documented in Amazon S3 documentation  - http://docs.aws.amazon.com/AmazonS3/latest/dev/UsingClientSideEncryption.html
> When backporting, include HADOOP-17817



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org