You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by GitBox <gi...@apache.org> on 2022/01/18 11:19:31 UTC
[GitHub] [hadoop] anmolanmol1234 opened a new pull request #3901: Hadoop-18032: ABFS: Support for secondary accounts on ABFS Driver for SharedKey Auth
anmolanmol1234 opened a new pull request #3901:
URL: https://github.com/apache/hadoop/pull/3901
In this PR, we have added support for secondary accounts on ABFS Driver mainly for SharedKey Authorization Type.
So we have created a separate field as primaryAccountName for getting the sharedKey credentials which is the same as accountName for primary accounts but we replace "-secondary" string from the accountName for the secondary accounts,
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
[GitHub] [hadoop] hadoop-yetus commented on pull request #3901: Hadoop-18032: ABFS: Support for secondary accounts on ABFS Driver for SharedKey Auth
Posted by GitBox <gi...@apache.org>.
hadoop-yetus commented on pull request #3901:
URL: https://github.com/apache/hadoop/pull/3901#issuecomment-1015383112
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|:----:|----------:|--------:|:--------:|:-------:|
| +0 :ok: | reexec | 0m 56s | | Docker mode activated. |
|||| _ Prechecks _ |
| +1 :green_heart: | dupname | 0m 1s | | No case conflicting files found. |
| +0 :ok: | codespell | 0m 0s | | codespell was not available. |
| +1 :green_heart: | @author | 0m 0s | | The patch does not contain any @author tags. |
| +1 :green_heart: | test4tests | 0m 0s | | The patch appears to include 4 new or modified test files. |
|||| _ trunk Compile Tests _ |
| +1 :green_heart: | mvninstall | 35m 45s | | trunk passed |
| +1 :green_heart: | compile | 0m 36s | | trunk passed with JDK Ubuntu-11.0.13+8-Ubuntu-0ubuntu1.20.04 |
| +1 :green_heart: | compile | 0m 32s | | trunk passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 |
| +1 :green_heart: | checkstyle | 0m 25s | | trunk passed |
| +1 :green_heart: | mvnsite | 0m 38s | | trunk passed |
| +1 :green_heart: | javadoc | 0m 30s | | trunk passed with JDK Ubuntu-11.0.13+8-Ubuntu-0ubuntu1.20.04 |
| +1 :green_heart: | javadoc | 0m 27s | | trunk passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 |
| +1 :green_heart: | spotbugs | 1m 0s | | trunk passed |
| +1 :green_heart: | shadedclient | 23m 17s | | branch has no errors when building and testing our client artifacts. |
|||| _ Patch Compile Tests _ |
| +1 :green_heart: | mvninstall | 0m 31s | | the patch passed |
| +1 :green_heart: | compile | 0m 31s | | the patch passed with JDK Ubuntu-11.0.13+8-Ubuntu-0ubuntu1.20.04 |
| +1 :green_heart: | javac | 0m 31s | | the patch passed |
| +1 :green_heart: | compile | 0m 26s | | the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 |
| +1 :green_heart: | javac | 0m 26s | | the patch passed |
| +1 :green_heart: | blanks | 0m 0s | | The patch has no blanks issues. |
| +1 :green_heart: | checkstyle | 0m 15s | | the patch passed |
| +1 :green_heart: | mvnsite | 0m 29s | | the patch passed |
| +1 :green_heart: | javadoc | 0m 23s | | the patch passed with JDK Ubuntu-11.0.13+8-Ubuntu-0ubuntu1.20.04 |
| +1 :green_heart: | javadoc | 0m 21s | | the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 |
| +1 :green_heart: | spotbugs | 1m 4s | | the patch passed |
| +1 :green_heart: | shadedclient | 22m 55s | | patch has no errors when building and testing our client artifacts. |
|||| _ Other Tests _ |
| +1 :green_heart: | unit | 1m 51s | | hadoop-azure in the patch passed. |
| +1 :green_heart: | asflicense | 0m 30s | | The patch does not generate ASF License warnings. |
| | | 94m 11s | | |
| Subsystem | Report/Notes |
|----------:|:-------------|
| Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3901/1/artifact/out/Dockerfile |
| GITHUB PR | https://github.com/apache/hadoop/pull/3901 |
| Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell |
| uname | Linux d7cb066277a1 4.15.0-162-generic #170-Ubuntu SMP Mon Oct 18 11:38:05 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | dev-support/bin/hadoop.sh |
| git revision | trunk / 9bdca82fd7eab8bf2cea5c5fcbff366b4fa36c36 |
| Default Java | Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 |
| Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.13+8-Ubuntu-0ubuntu1.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07 |
| Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3901/1/testReport/ |
| Max. process+thread count | 523 (vs. ulimit of 5500) |
| modules | C: hadoop-tools/hadoop-azure U: hadoop-tools/hadoop-azure |
| Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3901/1/console |
| versions | git=2.25.1 maven=3.6.3 spotbugs=4.2.2 |
| Powered by | Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org |
This message was automatically generated.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
[GitHub] [hadoop] anmolanmol1234 edited a comment on pull request #3901: Hadoop-18032: ABFS: Support for secondary accounts on ABFS Driver for SharedKey Auth
Posted by GitBox <gi...@apache.org>.
anmolanmol1234 edited a comment on pull request #3901:
URL: https://github.com/apache/hadoop/pull/3901#issuecomment-1015316420
HNS-OAuth
========================
[INFO] Results:
[INFO]
[WARNING] Tests run: 106, Failures: 0, Errors: 0, Skipped: 2
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR] ITestAbfsRestOperationException.testAbfsRestOperationExceptionFormat:78->Assert.assertEquals:633->Assert.assertEquals:647->Assert.failNotEquals:835->Assert.fail:89 expected:<6> but was:<4>
[ERROR] ITestAbfsInputStreamSmallFileReads.testSeekToBeginingAndReadSmallFileWithConfFalse:106->testSeekAndReadWithConf:169->seekReadAndTest:208->ITestAbfsInputStream.assertBuffersAreEqual:216->ITestAbfsInputStream.assertBufferEquality:231->Assert.assertEquals:633->Assert.assertEquals:647->Assert.failNotEquals:835->Assert.fail:89 expected:<4194304> but was:<2676589>
[ERROR] Errors:
[ERROR] ITestAzureBlobFileSystemDelegationSAS.testRename:229 » AccessDenied Operation ...
[ERROR] ITestAzureBlobFileSystemDelegationSAS.testSignatureMask:403 » AbfsRestOperation
[ERROR] ITestAzureBlobFileSystemLease.testAcquireRetry:329 » TestTimedOut test timed o...
[INFO]
[ERROR] Tests run: 566, Failures: 2, Errors: 3, Skipped: 54
[INFO] Results:
[INFO]
[ERROR] Errors:
[ERROR] ITestAzureBlobFileSystemBasics.setUp:49 » TestTimedOut test timed out after 30...
[INFO]
[ERROR] Tests run: 265, Failures: 0, Errors: 1, Skipped: 40
Time taken: 25 mins 2 secs.
HNS-SharedKey
========================
[INFO] Results:
[INFO]
[WARNING] Tests run: 106, Failures: 0, Errors: 0, Skipped: 2
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR] ITestAbfsRestOperationException.testAbfsRestOperationExceptionFormat:78->Assert.assertEquals:633->Assert.assertEquals:647->Assert.failNotEquals:835->Assert.fail:89 expected:<6> but was:<4>
[ERROR] Errors:
[ERROR] ITestAzureBlobFileSystemDelegationSAS.testRename:229 » AccessDenied Operation ...
[ERROR] ITestAzureBlobFileSystemDelegationSAS.testSignatureMask:403 » AbfsRestOperation
[ERROR] ITestAzureBlobFileSystemLease.testAcquireRetry:329 » TestTimedOut test timed o...
[INFO]
[ERROR] Tests run: 566, Failures: 1, Errors: 3, Skipped: 54
[INFO] Results:
[INFO]
[ERROR] Errors:
[ERROR] ITestAzureBlobFileSystemBasics.setUp:49 » TestTimedOut test timed out after 30...
[INFO]
[ERROR] Tests run: 265, Failures: 0, Errors: 1, Skipped: 40
AppendBlob-HNS-OAuth
========================
[INFO] Results:
[INFO]
[WARNING] Tests run: 106, Failures: 0, Errors: 0, Skipped: 2
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR] ITestAbfsRestOperationException.testAbfsRestOperationExceptionFormat:78->Assert.assertEquals:633->Assert.assertEquals:647->Assert.failNotEquals:835->Assert.fail:89 expected:<6> but was:<4>
[ERROR] ITestAbfsStreamStatistics.testAbfsStreamOps:140->Assert.assertTrue:42->Assert.fail:89 The actual value of 99 was not equal to the expected value
[ERROR] Errors:
[ERROR] ITestAzureBlobFileSystemDelegationSAS.testRename:229 » AccessDenied Operation ...
[ERROR] ITestAzureBlobFileSystemDelegationSAS.testSignatureMask:403 » AbfsRestOperation
[ERROR] ITestAzureBlobFileSystemLease.testAcquireRetry:329 » TestTimedOut test timed o...
[ERROR] ITestAzureBlobFileSystemLease.testTwoWritersCreateAppendNoInfiniteLease:177->twoWriters:165 » AbfsRestOperation
[INFO]
[ERROR] Tests run: 566, Failures: 2, Errors: 4, Skipped: 54
[INFO] Results:
[INFO]
[ERROR] Errors:
[ERROR] ITestAzureBlobFileSystemBasics.testListOnFolderWithNoChildren:70 » TestTimedOut
[INFO]
[ERROR] Tests run: 265, Failures: 0, Errors: 1, Skipped: 64
NonHNS-SharedKey
========================
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR] TestAbfsClientThrottlingAnalyzer.testManySuccessAndErrorsAndWaiting:171->fuzzyValidate:49 The actual value 10 is not within the expected range: [5.60, 8.40].
[INFO]
[ERROR] Tests run: 106, Failures: 1, Errors: 0, Skipped: 2
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR] ITestAbfsRestOperationException.testAbfsRestOperationExceptionFormat:78->Assert.assertEquals:633->Assert.assertEquals:647->Assert.failNotEquals:835->Assert.fail:89 expected:<6> but was:<4>
[INFO]
[ERROR] Tests run: 566, Failures: 1, Errors: 0, Skipped: 283
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR] ITestAbfsFileSystemContractEtag>AbstractContractEtagTest.testEtagConsistencyAcrossRename:162
[ERROR] Errors:
[ERROR] ITestAzureBlobFileSystemBasics.setUp:49 » TestTimedOut test timed out after 30...
[ERROR] ITestAzureBlobFileSystemBasics.testListOnfileAndFolder:93 » TestTimedOut test ...
[INFO]
[ERROR] Tests run: 265, Failures: 1, Errors: 2, Skipped: 40
Time taken: 26 mins 5 secs.
Failures tracked in Jiras :-
https://issues.apache.org/jira/browse/HADOOP-18080
https://issues.apache.org/jira/browse/HADOOP-18075
https://issues.apache.org/jira/browse/HADOOP-17826
https://issues.apache.org/jira/browse/HADOOP-17781
https://issues.apache.org/jira/browse/HADOOP-17873
https://issues.apache.org/jira/browse/HADOOP-18084
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
[GitHub] [hadoop] anmolanmol1234 commented on pull request #3901: Hadoop-18032: ABFS: Support for secondary accounts on ABFS Driver for SharedKey Auth
Posted by GitBox <gi...@apache.org>.
anmolanmol1234 commented on pull request #3901:
URL: https://github.com/apache/hadoop/pull/3901#issuecomment-1015316420
HNS-OAuth
========================
[INFO] Results:
[INFO]
[WARNING] Tests run: 106, Failures: 0, Errors: 0, Skipped: 2
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR] ITestAbfsRestOperationException.testAbfsRestOperationExceptionFormat:78->Assert.assertEquals:633->Assert.assertEquals:647->Assert.failNotEquals:835->Assert.fail:89 expected:<6> but was:<4>
[ERROR] ITestAbfsInputStreamSmallFileReads.testSeekToBeginingAndReadSmallFileWithConfFalse:106->testSeekAndReadWithConf:169->seekReadAndTest:208->ITestAbfsInputStream.assertBuffersAreEqual:216->ITestAbfsInputStream.assertBufferEquality:231->Assert.assertEquals:633->Assert.assertEquals:647->Assert.failNotEquals:835->Assert.fail:89 expected:<4194304> but was:<2676589>
[ERROR] Errors:
[ERROR] ITestAzureBlobFileSystemDelegationSAS.testRename:229 » AccessDenied Operation ...
[ERROR] ITestAzureBlobFileSystemDelegationSAS.testSignatureMask:403 » AbfsRestOperation
[ERROR] ITestAzureBlobFileSystemLease.testAcquireRetry:329 » TestTimedOut test timed o...
[INFO]
[ERROR] Tests run: 566, Failures: 2, Errors: 3, Skipped: 54
[INFO] Results:
[INFO]
[ERROR] Errors:
[ERROR] ITestAzureBlobFileSystemBasics.setUp:49 » TestTimedOut test timed out after 30...
[INFO]
[ERROR] Tests run: 265, Failures: 0, Errors: 1, Skipped: 40
Time taken: 25 mins 2 secs.
HNS-SharedKey
========================
[INFO] Results:
[INFO]
[WARNING] Tests run: 106, Failures: 0, Errors: 0, Skipped: 2
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR] ITestAbfsRestOperationException.testAbfsRestOperationExceptionFormat:78->Assert.assertEquals:633->Assert.assertEquals:647->Assert.failNotEquals:835->Assert.fail:89 expected:<6> but was:<4>
[ERROR] Errors:
[ERROR] ITestAzureBlobFileSystemDelegationSAS.testRename:229 » AccessDenied Operation ...
[ERROR] ITestAzureBlobFileSystemDelegationSAS.testSignatureMask:403 » AbfsRestOperation
[ERROR] ITestAzureBlobFileSystemLease.testAcquireRetry:329 » TestTimedOut test timed o...
[INFO]
[ERROR] Tests run: 566, Failures: 1, Errors: 3, Skipped: 54
[INFO] Results:
[INFO]
[ERROR] Errors:
[ERROR] ITestAzureBlobFileSystemBasics.setUp:49 » TestTimedOut test timed out after 30...
[INFO]
[ERROR] Tests run: 265, Failures: 0, Errors: 1, Skipped: 40
AppendBlob-HNS-OAuth
========================
[INFO] Results:
[INFO]
[WARNING] Tests run: 106, Failures: 0, Errors: 0, Skipped: 2
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR] ITestAbfsRestOperationException.testAbfsRestOperationExceptionFormat:78->Assert.assertEquals:633->Assert.assertEquals:647->Assert.failNotEquals:835->Assert.fail:89 expected:<6> but was:<4>
[ERROR] ITestAbfsStreamStatistics.testAbfsStreamOps:140->Assert.assertTrue:42->Assert.fail:89 The actual value of 99 was not equal to the expected value
[ERROR] Errors:
[ERROR] ITestAzureBlobFileSystemDelegationSAS.testRename:229 » AccessDenied Operation ...
[ERROR] ITestAzureBlobFileSystemDelegationSAS.testSignatureMask:403 » AbfsRestOperation
[ERROR] ITestAzureBlobFileSystemLease.testAcquireRetry:329 » TestTimedOut test timed o...
[ERROR] ITestAzureBlobFileSystemLease.testTwoWritersCreateAppendNoInfiniteLease:177->twoWriters:165 » AbfsRestOperation
[INFO]
[ERROR] Tests run: 566, Failures: 2, Errors: 4, Skipped: 54
[INFO] Results:
[INFO]
[ERROR] Errors:
[ERROR] ITestAzureBlobFileSystemBasics.testListOnFolderWithNoChildren:70 » TestTimedOut
[INFO]
[ERROR] Tests run: 265, Failures: 0, Errors: 1, Skipped: 64
NonHNS-SharedKey
========================
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR] TestAbfsClientThrottlingAnalyzer.testManySuccessAndErrorsAndWaiting:171->fuzzyValidate:49 The actual value 10 is not within the expected range: [5.60, 8.40].
[INFO]
[ERROR] Tests run: 106, Failures: 1, Errors: 0, Skipped: 2
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR] ITestAbfsRestOperationException.testAbfsRestOperationExceptionFormat:78->Assert.assertEquals:633->Assert.assertEquals:647->Assert.failNotEquals:835->Assert.fail:89 expected:<6> but was:<4>
[INFO]
[ERROR] Tests run: 566, Failures: 1, Errors: 0, Skipped: 283
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR] ITestAbfsFileSystemContractEtag>AbstractContractEtagTest.testEtagConsistencyAcrossRename:162 [etag of list status (VersionedFileStatus{VersionedFileStatus{path=abfs://testcontainer@anmolasnonhnstest-secondary.dfs.core.windows.net/fork-7/test/testEtagConsistencyAcrossRename/dest; isDirectory=false; length=11; replication=1; blocksize=268435456; modification_time=1642503567000; access_time=0; owner=anmol; group=anmol; permission=rwxrwxrwx; isSymlink=false; hasAcl=false; isEncrypted=false; isErasureCoded=false}; version='0x8D9DA71987E9615'}) compared to HEAD value of VersionedFileStatus{VersionedFileStatus{path=abfs://testcontainer@anmolasnonhnstest-secondary.dfs.core.windows.net/fork-7/test/testEtagConsistencyAcrossRename/src; isDirectory=false; length=11; replication=1; blocksize=268435456; modification_time=1642503566000; access_time=0; owner=anmol; group=anmol; permission=rwxrwxrwx; isSymlink=false; hasAcl=false; isEncrypted=false; isErasureCoded=false}; version='0x8D9D
A7197F27018'}] expected:<"0x8D9DA719[7F27018]"> but was:<"0x8D9DA719[87E9615]">
[ERROR] Errors:
[ERROR] ITestAzureBlobFileSystemBasics.setUp:49 » TestTimedOut test timed out after 30...
[ERROR] ITestAzureBlobFileSystemBasics.testListOnfileAndFolder:93 » TestTimedOut test ...
[INFO]
[ERROR] Tests run: 265, Failures: 1, Errors: 2, Skipped: 40
Time taken: 26 mins 5 secs.
Failures tracked in Jiras :-
https://issues.apache.org/jira/browse/HADOOP-18080
https://issues.apache.org/jira/browse/HADOOP-18075
https://issues.apache.org/jira/browse/HADOOP-17826
https://issues.apache.org/jira/browse/HADOOP-17781
https://issues.apache.org/jira/browse/HADOOP-17873
https://issues.apache.org/jira/browse/HADOOP-18084
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org