You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by GitBox <gi...@apache.org> on 2022/10/19 22:19:00 UTC
[GitHub] [hadoop] gss2002 opened a new pull request, #5046: HADOOP-17705. S3A to add Config to set AWS region
gss2002 opened a new pull request, #5046:
URL: https://github.com/apache/hadoop/pull/5046
### Description of PR
Currently, AWS region is either constructed via the endpoint URL, by making an assumption that the 2nd component after delimiter "." is the region in endpoint URL, which doesn't work for private links and sets the default to us-east-1 thus causing authorization issue w.r.t the private link.
The option fs.s3a.endpoint.region allows this to be explicitly set
### How was this patch tested?
~/apache-maven-3.8.6/bin/mvn integration-test -Dparallel-tests -DtestsThreadCount=50 -Dscale -Ptests-on
[INFO] Scanning for projects...
[INFO] ------------------------------------------------------------------------
[INFO] Detecting the operating system and CPU architecture
[INFO] ------------------------------------------------------------------------
[INFO] os.detected.name: linux
[INFO] os.detected.arch: x86_64
[INFO] os.detected.version: 4.18
[INFO] os.detected.version.major: 4
[INFO] os.detected.version.minor: 18
[INFO] os.detected.release: centos
[INFO] os.detected.release.version: 8
[INFO] os.detected.release.like.centos: true
[INFO] os.detected.release.like.rhel: true
[INFO] os.detected.release.like.fedora: true
[INFO] os.detected.classifier: linux-x86_64
[INFO]
[INFO] --------------------< org.apache.hadoop:hadoop-aws >--------------------
[INFO] Building Apache Hadoop Amazon Web Services support 3.2.5-SNAPSHOT
[INFO] --------------------------------[ jar ]---------------------------------
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-aws ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ hadoop-aws ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hadoop-aws ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-dependency-plugin:3.0.2:list (deplist1) @ hadoop-aws ---
[INFO]
[INFO] --- maven-dependency-plugin:3.0.2:list (deplist2) @ hadoop-aws ---
[INFO]
[INFO] --- hadoop-maven-plugins:3.2.5-SNAPSHOT:parallel-tests-createdir (parallel-tests-createdir) @ hadoop-aws ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ hadoop-aws ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 4 resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ hadoop-aws ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-dependency-plugin:3.0.2:copy-dependencies (copy) @ hadoop-aws ---
[INFO]
[INFO] --- maven-surefire-plugin:3.0.0-M1:test (default-test) @ hadoop-aws ---
[INFO]
[INFO] -------------------------------------------------------
[INFO] T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.apache.hadoop.fs.s3a.TestDataBlocks
[INFO] Running org.apache.hadoop.mapreduce.filecache.TestS3AResourceScope
[INFO] Running org.apache.hadoop.fs.s3a.commit.TestTasks
[INFO] Running org.apache.hadoop.fs.s3a.TestInvoker
[INFO] Running org.apache.hadoop.fs.s3a.commit.TestMagicCommitPaths
[INFO] Running org.apache.hadoop.fs.s3a.commit.staging.TestPaths
[INFO] Running org.apache.hadoop.fs.s3a.commit.staging.TestStagingDirectoryOutputCommitter
[INFO] Running org.apache.hadoop.fs.s3a.s3guard.TestPathMetadataDynamoDBTranslation
[INFO] Running org.apache.hadoop.fs.s3a.TestS3AInputPolicies
[INFO] Running org.apache.hadoop.fs.s3a.TestS3AMultipartUploaderSupport
[INFO] Running org.apache.hadoop.fs.s3a.TestS3AExceptionTranslation
[INFO] Running org.apache.hadoop.fs.s3a.commit.staging.TestStagingPartitionedJobCommit
[INFO] Running org.apache.hadoop.fs.s3a.commit.staging.TestStagingPartitionedTaskCommit
[INFO] Running org.apache.hadoop.fs.s3a.commit.staging.TestStagingPartitionedFileListing
[INFO] Running org.apache.hadoop.fs.s3a.s3guard.TestS3GuardCLI
[INFO] Running org.apache.hadoop.fs.s3a.s3guard.TestNullMetadataStore
[INFO] Running org.apache.hadoop.fs.s3a.TestListing
[INFO] Running org.apache.hadoop.fs.s3a.TestSSEConfiguration
[INFO] Running org.apache.hadoop.fs.s3a.TestS3ABlockOutputStream
[INFO] Running org.apache.hadoop.fs.s3a.s3guard.TestDirListingMetadata
[INFO] Running org.apache.hadoop.fs.s3a.impl.TestDirectoryMarkerPolicy
[INFO] Running org.apache.hadoop.fs.s3a.TestS3AGetFileStatus
[INFO] Running org.apache.hadoop.fs.s3native.TestS3xLoginHelper
[INFO] Running org.apache.hadoop.fs.s3a.commit.staging.TestStagingCommitter
[INFO] Running org.apache.hadoop.fs.s3a.s3guard.TestS3Guard
[INFO] Running org.apache.hadoop.fs.s3a.s3guard.TestLocalMetadataStore
[INFO] Running org.apache.hadoop.fs.s3a.TestStreamChangeTracker
[INFO] Running org.apache.hadoop.fs.s3a.s3guard.TestDynamoDBMiscOperations
[INFO] Running org.apache.hadoop.fs.s3a.TestS3AAWSCredentialsProvider
[INFO] Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.105 s - in org.apache.hadoop.fs.s3native.TestS3xLoginHelper
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.1 s - in org.apache.hadoop.fs.s3a.s3guard.TestS3Guard
[INFO] Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.136 s - in org.apache.hadoop.fs.s3a.TestS3AInputPolicies
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.126 s - in org.apache.hadoop.fs.s3a.TestDataBlocks
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.121 s - in org.apache.hadoop.fs.s3a.TestS3AMultipartUploaderSupport
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.173 s - in org.apache.hadoop.fs.s3a.s3guard.TestDynamoDBMiscOperations
[INFO] Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.165 s - in org.apache.hadoop.fs.s3a.TestS3AExceptionTranslation
[INFO] Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.173 s - in org.apache.hadoop.fs.s3a.s3guard.TestDirListingMetadata
[INFO] Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.202 s - in org.apache.hadoop.fs.s3a.commit.TestMagicCommitPaths
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.21 s - in org.apache.hadoop.mapreduce.filecache.TestS3AResourceScope
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.195 s - in org.apache.hadoop.fs.s3a.TestStreamChangeTracker
[INFO] Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.233 s - in org.apache.hadoop.fs.s3a.s3guard.TestS3GuardCLI
[INFO] Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.253 s - in org.apache.hadoop.fs.s3a.impl.TestDirectoryMarkerPolicy
[INFO] Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.507 s - in org.apache.hadoop.fs.s3a.commit.staging.TestPaths
[INFO] Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.52 s - in org.apache.hadoop.fs.s3a.TestS3AAWSCredentialsProvider
[INFO] Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.559 s - in org.apache.hadoop.fs.s3a.s3guard.TestPathMetadataDynamoDBTranslation
[INFO] Tests run: 22, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.746 s - in org.apache.hadoop.fs.s3a.TestInvoker
[INFO] Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.909 s - in org.apache.hadoop.fs.s3a.s3guard.TestLocalMetadataStore
[INFO] Tests run: 60, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.007 s - in org.apache.hadoop.fs.s3a.commit.TestTasks
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.076 s - in org.apache.hadoop.fs.s3a.TestListing
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.159 s - in org.apache.hadoop.fs.s3a.TestS3ABlockOutputStream
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.275 s - in org.apache.hadoop.fs.s3a.TestS3AGetFileStatus
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.411 s - in org.apache.hadoop.fs.s3a.commit.staging.TestStagingPartitionedJobCommit
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.424 s - in org.apache.hadoop.fs.s3a.commit.staging.TestStagingDirectoryOutputCommitter
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.545 s - in org.apache.hadoop.fs.s3a.commit.staging.TestStagingPartitionedFileListing
[INFO] Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.591 s - in org.apache.hadoop.fs.s3a.TestSSEConfiguration
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.032 s - in org.apache.hadoop.fs.s3a.commit.staging.TestStagingPartitionedTaskCommit
[WARNING] Tests run: 26, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 3.079 s - in org.apache.hadoop.fs.s3a.s3guard.TestNullMetadataStore
[INFO] Tests run: 48, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 235.418 s - in org.apache.hadoop.fs.s3a.commit.staging.TestStagingCommitter
[INFO]
[INFO] Results:
[INFO]
[WARNING] Tests run: 390, Failures: 0, Errors: 0, Skipped: 1
[INFO]
[INFO]
[INFO] --- maven-jar-plugin:2.5:jar (default-jar) @ hadoop-aws ---
[INFO]
[INFO] --- maven-site-plugin:3.6:attach-descriptor (attach-descriptor) @ hadoop-aws ---
[INFO] Skipping because packaging 'jar' is not pom.
[INFO]
[INFO] --- maven-dependency-plugin:3.0.2:copy-dependencies (default) @ hadoop-aws ---
[INFO] org.apache.hadoop:hadoop-common:jar:3.2.5-SNAPSHOT already exists in destination.
[INFO] org.apache.hadoop:hadoop-annotations:jar:3.2.5-SNAPSHOT already exists in destination.
[INFO] jdk.tools:jdk.tools:jar:1.8 already exists in destination.
[INFO] com.google.guava:guava:jar:27.0-jre already exists in destination.
[INFO] com.google.guava:failureaccess:jar:1.0 already exists in destination.
[INFO] com.google.guava:listenablefuture:jar:9999.0-empty-to-avoid-conflict-with-guava already exists in destination.
[INFO] org.checkerframework:checker-qual:jar:2.5.2 already exists in destination.
[INFO] com.google.errorprone:error_prone_annotations:jar:2.2.0 already exists in destination.
[INFO] com.google.j2objc:j2objc-annotations:jar:1.1 already exists in destination.
[INFO] org.codehaus.mojo:animal-sniffer-annotations:jar:1.17 already exists in destination.
[INFO] commons-cli:commons-cli:jar:1.2 already exists in destination.
[INFO] org.apache.commons:commons-math3:jar:3.1.1 already exists in destination.
[INFO] org.apache.httpcomponents:httpclient:jar:4.5.13 already exists in destination.
[INFO] org.apache.httpcomponents:httpcore:jar:4.4.13 already exists in destination.
[INFO] commons-codec:commons-codec:jar:1.11 already exists in destination.
[INFO] commons-io:commons-io:jar:2.8.0 already exists in destination.
[INFO] commons-net:commons-net:jar:3.6 already exists in destination.
[INFO] commons-collections:commons-collections:jar:3.2.2 already exists in destination.
[INFO] javax.servlet:javax.servlet-api:jar:3.1.0 already exists in destination.
[INFO] javax.activation:javax.activation-api:jar:1.2.0 already exists in destination.
[INFO] org.eclipse.jetty:jetty-server:jar:9.4.43.v20210629 already exists in destination.
[INFO] org.eclipse.jetty:jetty-http:jar:9.4.43.v20210629 already exists in destination.
[INFO] org.eclipse.jetty:jetty-io:jar:9.4.43.v20210629 already exists in destination.
[INFO] org.eclipse.jetty:jetty-util:jar:9.4.43.v20210629 already exists in destination.
[INFO] org.eclipse.jetty:jetty-servlet:jar:9.4.43.v20210629 already exists in destination.
[INFO] org.eclipse.jetty:jetty-security:jar:9.4.43.v20210629 already exists in destination.
[INFO] org.eclipse.jetty:jetty-webapp:jar:9.4.43.v20210629 already exists in destination.
[INFO] org.eclipse.jetty:jetty-xml:jar:9.4.43.v20210629 already exists in destination.
[INFO] javax.servlet.jsp:jsp-api:jar:2.1 already exists in destination.
[INFO] com.sun.jersey:jersey-core:jar:1.19 already exists in destination.
[INFO] javax.ws.rs:jsr311-api:jar:1.1.1 already exists in destination.
[INFO] com.sun.jersey:jersey-servlet:jar:1.19 already exists in destination.
[INFO] com.sun.jersey:jersey-json:jar:1.19 already exists in destination.
[INFO] org.codehaus.jettison:jettison:jar:1.1 already exists in destination.
[INFO] com.sun.xml.bind:jaxb-impl:jar:2.2.3-1 already exists in destination.
[INFO] org.codehaus.jackson:jackson-core-asl:jar:1.9.13 already exists in destination.
[INFO] org.codehaus.jackson:jackson-mapper-asl:jar:1.9.13 already exists in destination.
[INFO] org.codehaus.jackson:jackson-jaxrs:jar:1.9.13 already exists in destination.
[INFO] org.codehaus.jackson:jackson-xc:jar:1.9.13 already exists in destination.
[INFO] com.sun.jersey:jersey-server:jar:1.19 already exists in destination.
[INFO] commons-logging:commons-logging:jar:1.1.3 already exists in destination.
[INFO] ch.qos.reload4j:reload4j:jar:1.2.18.3 already exists in destination.
[INFO] commons-beanutils:commons-beanutils:jar:1.9.4 already exists in destination.
[INFO] org.apache.commons:commons-configuration2:jar:2.8.0 already exists in destination.
[INFO] org.apache.commons:commons-lang3:jar:3.7 already exists in destination.
[INFO] org.apache.commons:commons-text:jar:1.9 already exists in destination.
[INFO] org.slf4j:slf4j-api:jar:1.7.35 already exists in destination.
[INFO] org.apache.avro:avro:jar:1.7.7 already exists in destination.
[INFO] com.thoughtworks.paranamer:paranamer:jar:2.3 already exists in destination.
[INFO] org.xerial.snappy:snappy-java:jar:1.0.5 already exists in destination.
[INFO] com.google.re2j:re2j:jar:1.1 already exists in destination.
[INFO] com.google.protobuf:protobuf-java:jar:2.5.0 already exists in destination.
[INFO] com.google.code.gson:gson:jar:2.9.0 already exists in destination.
[INFO] org.apache.hadoop:hadoop-auth:jar:3.2.5-SNAPSHOT already exists in destination.
[INFO] com.nimbusds:nimbus-jose-jwt:jar:9.8.1 already exists in destination.
[INFO] com.github.stephenc.jcip:jcip-annotations:jar:1.0-1 already exists in destination.
[INFO] net.minidev:json-smart:jar:2.4.7 already exists in destination.
[INFO] net.minidev:accessors-smart:jar:2.4.7 already exists in destination.
[INFO] org.ow2.asm:asm:jar:5.0.4 already exists in destination.
[INFO] org.apache.curator:curator-framework:jar:2.13.0 already exists in destination.
[INFO] com.jcraft:jsch:jar:0.1.55 already exists in destination.
[INFO] org.apache.curator:curator-client:jar:2.13.0 already exists in destination.
[INFO] org.apache.curator:curator-recipes:jar:2.13.0 already exists in destination.
[INFO] com.google.code.findbugs:jsr305:jar:3.0.2 already exists in destination.
[INFO] org.apache.htrace:htrace-core4:jar:4.1.0-incubating already exists in destination.
[INFO] org.apache.zookeeper:zookeeper:jar:3.4.14 already exists in destination.
[INFO] com.github.spotbugs:spotbugs-annotations:jar:3.1.9 already exists in destination.
[INFO] org.apache.yetus:audience-annotations:jar:0.5.0 already exists in destination.
[INFO] org.apache.commons:commons-compress:jar:1.21 already exists in destination.
[INFO] org.apache.kerby:kerb-simplekdc:jar:1.0.1 already exists in destination.
[INFO] org.apache.kerby:kerb-client:jar:1.0.1 already exists in destination.
[INFO] org.apache.kerby:kerby-config:jar:1.0.1 already exists in destination.
[INFO] org.apache.kerby:kerb-core:jar:1.0.1 already exists in destination.
[INFO] org.apache.kerby:kerby-pkix:jar:1.0.1 already exists in destination.
[INFO] org.apache.kerby:kerby-asn1:jar:1.0.1 already exists in destination.
[INFO] org.apache.kerby:kerby-util:jar:1.0.1 already exists in destination.
[INFO] org.apache.kerby:kerb-common:jar:1.0.1 already exists in destination.
[INFO] org.apache.kerby:kerb-crypto:jar:1.0.1 already exists in destination.
[INFO] org.apache.kerby:kerb-util:jar:1.0.1 already exists in destination.
[INFO] org.apache.kerby:token-provider:jar:1.0.1 already exists in destination.
[INFO] org.apache.kerby:kerb-admin:jar:1.0.1 already exists in destination.
[INFO] org.apache.kerby:kerb-server:jar:1.0.1 already exists in destination.
[INFO] org.apache.kerby:kerb-identity:jar:1.0.1 already exists in destination.
[INFO] org.apache.kerby:kerby-xdr:jar:1.0.1 already exists in destination.
[INFO] com.fasterxml.jackson.core:jackson-databind:jar:2.10.5.1 already exists in destination.
[INFO] com.fasterxml.jackson.core:jackson-annotations:jar:2.10.5 already exists in destination.
[INFO] com.fasterxml.jackson.core:jackson-core:jar:2.10.5 already exists in destination.
[INFO] org.codehaus.woodstox:stax2-api:jar:4.2.1 already exists in destination.
[INFO] com.fasterxml.woodstox:woodstox-core:jar:5.3.0 already exists in destination.
[INFO] dnsjava:dnsjava:jar:2.1.7 already exists in destination.
[INFO] org.apache.hadoop:hadoop-common:test-jar:tests:3.2.5-SNAPSHOT already exists in destination.
[INFO] org.slf4j:slf4j-reload4j:jar:1.7.35 already exists in destination.
[INFO] com.amazonaws:aws-java-sdk-bundle:jar:1.11.901 already exists in destination.
[INFO] junit:junit:jar:4.13.2 already exists in destination.
[INFO] org.hamcrest:hamcrest-core:jar:1.3 already exists in destination.
[INFO] org.mockito:mockito-all:jar:1.8.5 already exists in destination.
[INFO] org.apache.hadoop:hadoop-mapreduce-client-core:jar:3.2.5-SNAPSHOT already exists in destination.
[INFO] org.apache.hadoop:hadoop-yarn-client:jar:3.2.5-SNAPSHOT already exists in destination.
[INFO] org.apache.hadoop:hadoop-yarn-common:jar:3.2.5-SNAPSHOT already exists in destination.
[INFO] javax.xml.bind:jaxb-api:jar:2.2.11 already exists in destination.
[INFO] com.sun.jersey:jersey-client:jar:1.19 already exists in destination.
[INFO] com.google.inject:guice:jar:4.0 already exists in destination.
[INFO] javax.inject:javax.inject:jar:1 already exists in destination.
[INFO] aopalliance:aopalliance:jar:1.0 already exists in destination.
[INFO] com.sun.jersey.contribs:jersey-guice:jar:1.19 already exists in destination.
[INFO] com.fasterxml.jackson.module:jackson-module-jaxb-annotations:jar:2.10.5 already exists in destination.
[INFO] jakarta.xml.bind:jakarta.xml.bind-api:jar:2.3.2 already exists in destination.
[INFO] jakarta.activation:jakarta.activation-api:jar:1.2.1 already exists in destination.
[INFO] com.fasterxml.jackson.jaxrs:jackson-jaxrs-json-provider:jar:2.10.5 already exists in destination.
[INFO] com.fasterxml.jackson.jaxrs:jackson-jaxrs-base:jar:2.10.5 already exists in destination.
[INFO] org.apache.hadoop:hadoop-hdfs-client:jar:3.2.5-SNAPSHOT already exists in destination.
[INFO] com.squareup.okhttp:okhttp:jar:2.7.5 already exists in destination.
[INFO] com.squareup.okio:okio:jar:1.6.0 already exists in destination.
[INFO] com.google.inject.extensions:guice-servlet:jar:4.0 already exists in destination.
[INFO] io.netty:netty:jar:3.10.6.Final already exists in destination.
[INFO] org.apache.hadoop:hadoop-yarn-server-tests:test-jar:tests:3.2.5-SNAPSHOT already exists in destination.
[INFO] org.apache.hadoop:hadoop-yarn-server-common:jar:3.2.5-SNAPSHOT already exists in destination.
[INFO] org.apache.hadoop:hadoop-yarn-registry:jar:3.2.5-SNAPSHOT already exists in destination.
[INFO] org.apache.geronimo.specs:geronimo-jcache_1.0_spec:jar:1.0-alpha-1 already exists in destination.
[INFO] org.ehcache:ehcache:jar:3.3.1 already exists in destination.
[INFO] com.zaxxer:HikariCP-java7:jar:2.4.12 already exists in destination.
[INFO] com.microsoft.sqlserver:mssql-jdbc:jar:6.2.1.jre7 already exists in destination.
[INFO] org.apache.hadoop:hadoop-yarn-server-nodemanager:jar:3.2.5-SNAPSHOT already exists in destination.
[INFO] io.dropwizard.metrics:metrics-core:jar:3.2.4 already exists in destination.
[INFO] org.apache.hadoop:hadoop-yarn-server-resourcemanager:jar:3.2.5-SNAPSHOT already exists in destination.
[INFO] org.apache.hadoop:hadoop-yarn-server-applicationhistoryservice:jar:3.2.5-SNAPSHOT already exists in destination.
[INFO] org.objenesis:objenesis:jar:1.0 already exists in destination.
[INFO] de.ruedigermoeller:fst:jar:2.50 already exists in destination.
[INFO] com.cedarsoftware:java-util:jar:1.9.0 already exists in destination.
[INFO] com.cedarsoftware:json-io:jar:2.5.1 already exists in destination.
[INFO] org.apache.hadoop:hadoop-yarn-server-timelineservice:jar:3.2.5-SNAPSHOT already exists in destination.
[INFO] org.apache.commons:commons-csv:jar:1.0 already exists in destination.
[INFO] org.apache.hadoop:hadoop-yarn-api:jar:3.2.5-SNAPSHOT already exists in destination.
[INFO] org.apache.hadoop:hadoop-mapreduce-client-hs:jar:3.2.5-SNAPSHOT already exists in destination.
[INFO] org.apache.hadoop:hadoop-hdfs:jar:3.2.5-SNAPSHOT already exists in destination.
[INFO] org.apache.hadoop:hadoop-mapreduce-client-common:jar:3.2.5-SNAPSHOT already exists in destination.
[INFO] org.fusesource.leveldbjni:leveldbjni-all:jar:1.8 already exists in destination.
[INFO] org.apache.hadoop:hadoop-mapreduce-examples:jar:3.2.5-SNAPSHOT already exists in destination.
[INFO] org.apache.hadoop:hadoop-hdfs:test-jar:tests:3.2.5-SNAPSHOT already exists in destination.
[INFO] org.eclipse.jetty:jetty-util-ajax:jar:9.4.43.v20210629 already exists in destination.
[INFO] commons-daemon:commons-daemon:jar:1.0.13 already exists in destination.
[INFO] io.netty:netty-all:jar:4.1.77.Final already exists in destination.
[INFO] io.netty:netty-buffer:jar:4.1.77.Final already exists in destination.
[INFO] io.netty:netty-codec:jar:4.1.77.Final already exists in destination.
[INFO] io.netty:netty-codec-dns:jar:4.1.77.Final already exists in destination.
[INFO] io.netty:netty-codec-haproxy:jar:4.1.77.Final already exists in destination.
[INFO] io.netty:netty-codec-http:jar:4.1.77.Final already exists in destination.
[INFO] io.netty:netty-codec-http2:jar:4.1.77.Final already exists in destination.
[INFO] io.netty:netty-codec-memcache:jar:4.1.77.Final already exists in destination.
[INFO] io.netty:netty-codec-mqtt:jar:4.1.77.Final already exists in destination.
[INFO] io.netty:netty-codec-redis:jar:4.1.77.Final already exists in destination.
[INFO] io.netty:netty-codec-smtp:jar:4.1.77.Final already exists in destination.
[INFO] io.netty:netty-codec-socks:jar:4.1.77.Final already exists in destination.
[INFO] io.netty:netty-codec-stomp:jar:4.1.77.Final already exists in destination.
[INFO] io.netty:netty-codec-xml:jar:4.1.77.Final already exists in destination.
[INFO] io.netty:netty-common:jar:4.1.77.Final already exists in destination.
[INFO] io.netty:netty-handler:jar:4.1.77.Final already exists in destination.
[INFO] io.netty:netty-handler-proxy:jar:4.1.77.Final already exists in destination.
[INFO] io.netty:netty-resolver:jar:4.1.77.Final already exists in destination.
[INFO] io.netty:netty-resolver-dns:jar:4.1.77.Final already exists in destination.
[INFO] io.netty:netty-transport:jar:4.1.77.Final already exists in destination.
[INFO] io.netty:netty-transport-rxtx:jar:4.1.77.Final already exists in destination.
[INFO] io.netty:netty-transport-sctp:jar:4.1.77.Final already exists in destination.
[INFO] io.netty:netty-transport-udt:jar:4.1.77.Final already exists in destination.
[INFO] io.netty:netty-transport-classes-epoll:jar:4.1.77.Final already exists in destination.
[INFO] io.netty:netty-transport-native-unix-common:jar:4.1.77.Final already exists in destination.
[INFO] io.netty:netty-transport-classes-kqueue:jar:4.1.77.Final already exists in destination.
[INFO] io.netty:netty-resolver-dns-classes-macos:jar:4.1.77.Final already exists in destination.
[INFO] io.netty:netty-transport-native-epoll:jar:linux-x86_64:4.1.77.Final already exists in destination.
[INFO] io.netty:netty-transport-native-epoll:jar:linux-aarch_64:4.1.77.Final already exists in destination.
[INFO] io.netty:netty-transport-native-kqueue:jar:osx-x86_64:4.1.77.Final already exists in destination.
[INFO] io.netty:netty-transport-native-kqueue:jar:osx-aarch_64:4.1.77.Final already exists in destination.
[INFO] io.netty:netty-resolver-dns-native-macos:jar:osx-x86_64:4.1.77.Final already exists in destination.
[INFO] io.netty:netty-resolver-dns-native-macos:jar:osx-aarch_64:4.1.77.Final already exists in destination.
[INFO] org.apache.hadoop:hadoop-distcp:jar:3.2.5-SNAPSHOT already exists in destination.
[INFO] org.apache.hadoop:hadoop-distcp:test-jar:tests:3.2.5-SNAPSHOT already exists in destination.
[INFO] org.apache.hadoop:hadoop-mapreduce-client-app:jar:3.2.5-SNAPSHOT already exists in destination.
[INFO] org.apache.hadoop:hadoop-yarn-server-web-proxy:jar:3.2.5-SNAPSHOT already exists in destination.
[INFO] org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:3.2.5-SNAPSHOT already exists in destination.
[INFO] org.apache.hadoop:hadoop-mapreduce-client-app:test-jar:tests:3.2.5-SNAPSHOT already exists in destination.
[INFO] org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:3.2.5-SNAPSHOT already exists in destination.
[INFO] org.apache.hadoop:hadoop-mapreduce-client-jobclient:test-jar:tests:3.2.5-SNAPSHOT already exists in destination.
[INFO]
[INFO] --- maven-failsafe-plugin:3.0.0-M1:integration-test (default-integration-test) @ hadoop-aws ---
[INFO]
[INFO] -------------------------------------------------------
[INFO] T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.apache.hadoop.fs.s3a.scale.ITestS3ADeleteManyFiles
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3AMetrics
[INFO] Running org.apache.hadoop.fs.s3a.commit.ITestS3ACommitterFactory
[INFO] Running org.apache.hadoop.fs.s3a.commit.staging.integration.ITestDirectoryCommitMRJob
[INFO] Running org.apache.hadoop.fs.s3a.scale.ITestS3ADeleteFilesOneByOne
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3AEncryptionSSEKMSUserDefinedKey
[INFO] Running org.apache.hadoop.fs.s3a.commit.ITestCommitOperations
[INFO] Running org.apache.hadoop.fs.s3a.fileContext.ITestS3AFileContextUtil
[INFO] Running org.apache.hadoop.fs.s3a.fileContext.ITestS3AFileContextCreateMkdir
[INFO] Running org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardToolLocal
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3ABlockOutputArray
[INFO] Running org.apache.hadoop.fs.s3a.commit.staging.integration.ITestStagingCommitProtocol
[INFO] Running org.apache.hadoop.fs.s3a.scale.ITestS3ADirectoryPerformance
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3AFileSystemContract
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3GuardEmptyDirs
[INFO] Running org.apache.hadoop.fs.s3a.commit.staging.integration.ITestStagingCommitMRJobBadDest
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3AEncryptionSSES3
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3AContractGetFileStatusV1List
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3ABlocksize
[INFO] Running org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardToolDynamoDB
[INFO] Running org.apache.hadoop.fs.s3a.s3guard.ITestDynamoDBMetadataStore
[INFO] Running org.apache.hadoop.fs.s3a.scale.ITestLocalMetadataStoreScale
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3AEncryptionSSEKMSDefaultKey
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3ARemoteFileChanged
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3AMiscOperations
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3ABlockOutputDisk
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3AFailureHandling
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3ACopyFromLocalFile
[INFO] Running org.apache.hadoop.fs.s3a.scale.ITestS3ACreatePerformance
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3AEncryptionSSES3BlockOutputStream
[INFO] Running org.apache.hadoop.fs.s3a.commit.magic.ITestMagicCommitProtocol
[INFO] Running org.apache.hadoop.fs.s3a.auth.ITestAssumedRoleCommitOperations
[INFO] Running org.apache.hadoop.fs.s3a.fileContext.ITestS3AFileContext
[INFO] Running org.apache.hadoop.fs.s3a.ITestBlockingThreadPoolExecutorService
[INFO] Running org.apache.hadoop.fs.s3a.fileContext.ITestS3AFileContextURI
[INFO] Running org.apache.hadoop.fs.s3a.auth.ITestAssumeRole
[INFO] Running org.apache.hadoop.fs.s3a.commit.magic.ITestMagicCommitMRJob
[INFO] Running org.apache.hadoop.fs.s3a.scale.ITestS3AConcurrentOps
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3AAWSCredentialsProvider
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3ATestUtils
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3GuardListConsistency
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3AClosedFS
[INFO] Running org.apache.hadoop.fs.s3a.fileContext.ITestS3AFileContextMainOperations
[INFO] Running org.apache.hadoop.fs.s3a.commit.staging.integration.ITestPartitionCommitMRJob
[INFO] Running org.apache.hadoop.fs.s3a.performance.ITestDirectoryMarkerListing
[INFO] Running org.apache.hadoop.fs.s3a.commit.staging.integration.ITestPartitionedCommitProtocol
[INFO] Running org.apache.hadoop.fs.s3a.scale.ITestS3AInputStreamPerformance
[INFO] Running org.apache.hadoop.fs.s3a.commit.staging.integration.ITestDirectoryCommitProtocol
[INFO] Running org.apache.hadoop.fs.s3a.commit.staging.integration.ITestStagingCommitMRJob
[INFO] Running org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardConcurrentOps
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.345 s - in org.apache.hadoop.fs.s3a.ITestS3ATestUtils
[WARNING] Tests run: 2, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 0.508 s - in org.apache.hadoop.fs.s3a.ITestS3AEncryptionSSEKMSUserDefinedKey
[WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.573 s - in org.apache.hadoop.fs.s3a.s3guard.ITestDynamoDBMetadataStore
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.892 s - in org.apache.hadoop.fs.s3a.fileContext.ITestS3AFileContext
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.037 s - in org.apache.hadoop.fs.s3a.ITestBlockingThreadPoolExecutorService
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3AEncryptionSSEKMSUserDefinedKeyBlockOutputStream
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3ATemporaryCredentials
[WARNING] Tests run: 2, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 0.324 s - in org.apache.hadoop.fs.s3a.ITestS3AEncryptionSSEKMSUserDefinedKeyBlockOutputStream
[INFO] Running org.apache.hadoop.fs.s3a.yarn.ITestS3AMiniYarnCluster
[INFO] Running org.apache.hadoop.fs.s3a.yarn.ITestS3A
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3AEndpointRegion
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3GuardCreate
[WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 5.344 s - in org.apache.hadoop.fs.s3a.ITestS3GuardEmptyDirs
[WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 5.662 s - in org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardConcurrentOps
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.783 s - in org.apache.hadoop.fs.s3a.ITestS3AAWSCredentialsProvider
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.282 s - in org.apache.hadoop.fs.s3a.commit.ITestS3ACommitterFactory
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3AEmptyDirectory
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3AConfiguration
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3AMultipartUtils
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3GuardWriteBack
[INFO] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.926 s - in org.apache.hadoop.fs.s3a.ITestS3AClosedFS
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.306 s - in org.apache.hadoop.fs.s3a.ITestS3ABlocksize
[WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 3.937 s - in org.apache.hadoop.fs.s3a.ITestS3GuardCreate
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3AEncryptionAlgorithmValidation
[WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.016 s - in org.apache.hadoop.fs.s3a.ITestS3AEncryptionAlgorithmValidation
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3AInconsistency
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.231 s - in org.apache.hadoop.fs.s3a.yarn.ITestS3A
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3ADelayedFNF
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.154 s - in org.apache.hadoop.fs.s3a.ITestS3AMetrics
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.082 s - in org.apache.hadoop.fs.s3a.ITestS3AEndpointRegion
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3ABlockOutputByteBuffer
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.467 s - in org.apache.hadoop.fs.s3a.scale.ITestLocalMetadataStoreScale
[INFO] Running org.apache.hadoop.fs.contract.s3a.ITestS3AContractMultipartUploader
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3AFileOperationCost
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.565 s - in org.apache.hadoop.fs.s3a.ITestS3AFailureHandling
[INFO] Running org.apache.hadoop.fs.contract.s3a.ITestS3AContractCreate
[INFO] Running org.apache.hadoop.fs.contract.s3a.ITestS3AContractOpen
[INFO] Running org.apache.hadoop.fs.contract.s3a.ITestS3AContractGetFileStatus
[WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 3.133 s - in org.apache.hadoop.fs.s3a.ITestS3GuardWriteBack
[INFO] Running org.apache.hadoop.fs.contract.s3a.ITestS3AContractRename
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.652 s - in org.apache.hadoop.fs.s3a.ITestS3AMultipartUtils
[INFO] Running org.apache.hadoop.fs.contract.s3a.ITestS3AContractSeek
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.404 s - in org.apache.hadoop.fs.s3a.ITestS3ABlockOutputArray
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.435 s - in org.apache.hadoop.fs.s3a.ITestS3ADelayedFNF
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.812 s - in org.apache.hadoop.fs.s3a.fileContext.ITestS3AFileContextUtil
[INFO] Running org.apache.hadoop.fs.contract.s3a.ITestS3AContractMkdir
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.853 s - in org.apache.hadoop.fs.s3a.ITestS3AEmptyDirectory
[INFO] Running org.apache.hadoop.fs.contract.s3a.ITestS3AContractDistCp
[WARNING] Tests run: 5, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 13.392 s - in org.apache.hadoop.fs.s3a.ITestS3ABlockOutputDisk
[INFO] Running org.apache.hadoop.fs.contract.s3a.ITestS3AContractDelete
[WARNING] Tests run: 8, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 13.607 s - in org.apache.hadoop.fs.s3a.ITestS3ACopyFromLocalFile
[ERROR] Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 14.875 s <<< FAILURE! - in org.apache.hadoop.fs.s3a.ITestS3ATemporaryCredentials
[ERROR] testSTS(org.apache.hadoop.fs.s3a.ITestS3ATemporaryCredentials) Time elapsed: 13.688 s <<< ERROR!
com.amazonaws.SdkClientException: Unable to find a region via the region provider chain. Must provide an explicit region in the builder or setup environment to supply a region.
at com.amazonaws.client.builder.AwsClientBuilder.setRegion(AwsClientBuilder.java:462)
at com.amazonaws.client.builder.AwsClientBuilder.configureMutableProperties(AwsClientBuilder.java:424)
at com.amazonaws.client.builder.AwsSyncClientBuilder.build(AwsSyncClientBuilder.java:46)
at org.apache.hadoop.fs.s3a.ITestS3ATemporaryCredentials.testSTS(ITestS3ATemporaryCredentials.java:90)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.lang.Thread.run(Thread.java:750)
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.413 s - in org.apache.hadoop.fs.s3a.commit.staging.integration.ITestStagingCommitMRJobBadDest
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.885 s - in org.apache.hadoop.fs.s3a.yarn.ITestS3AMiniYarnCluster
[INFO] Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.92 s - in org.apache.hadoop.fs.s3a.ITestS3AConfiguration
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.109 s - in org.apache.hadoop.fs.s3a.ITestS3ABlockOutputByteBuffer
[WARNING] Tests run: 15, Failures: 0, Errors: 0, Skipped: 15, Time elapsed: 18.536 s - in org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardToolDynamoDB
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.02 s - in org.apache.hadoop.fs.s3a.ITestS3AEncryptionSSES3
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.965 s - in org.apache.hadoop.fs.s3a.ITestS3AEncryptionSSES3BlockOutputStream
[WARNING] Tests run: 16, Failures: 0, Errors: 0, Skipped: 16, Time elapsed: 19.741 s - in org.apache.hadoop.fs.s3a.auth.ITestAssumedRoleCommitOperations
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.116 s - in org.apache.hadoop.fs.contract.s3a.ITestS3AContractOpen
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.679 s - in org.apache.hadoop.fs.s3a.ITestS3AInconsistency
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.979 s - in org.apache.hadoop.fs.s3a.ITestS3AEncryptionSSEKMSDefaultKey
[ERROR] Tests run: 12, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 21.691 s <<< FAILURE! - in org.apache.hadoop.fs.s3a.ITestS3AMiscOperations
[ERROR] testEmptyFileChecksums(org.apache.hadoop.fs.s3a.ITestS3AMiscOperations) Time elapsed: 1.898 s <<< FAILURE!
java.lang.AssertionError: checksums expected:<etag: "dfaef4b43256ea0b1b561c4122394ed5"> but was:<etag: "86eff4cc793bef257ef202f7f2ffcd64">
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.failNotEquals(Assert.java:835)
at org.junit.Assert.assertEquals(Assert.java:120)
at org.apache.hadoop.fs.s3a.ITestS3AMiscOperations.testEmptyFileChecksums(ITestS3AMiscOperations.java:152)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.lang.Thread.run(Thread.java:750)
[ERROR] testNonEmptyFileChecksumsUnencrypted(org.apache.hadoop.fs.s3a.ITestS3AMiscOperations) Time elapsed: 1.814 s <<< FAILURE!
java.lang.AssertionError: checksums expected:<etag: "95144225d0bd3b6039e89c70563eb37a"> but was:<etag: "b58a8ddec34ab0e88aac27fb92593c5c">
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.failNotEquals(Assert.java:835)
at org.junit.Assert.assertEquals(Assert.java:120)
at org.apache.hadoop.fs.s3a.ITestS3AMiscOperations.testNonEmptyFileChecksumsUnencrypted(ITestS3AMiscOperations.java:206)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.lang.Thread.run(Thread.java:750)
[WARNING] Tests run: 9, Failures: 0, Errors: 0, Skipped: 8, Time elapsed: 22.509 s - in org.apache.hadoop.fs.s3a.ITestS3GuardListConsistency
[INFO] Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.647 s - in org.apache.hadoop.fs.s3a.ITestS3AFileOperationCost
[WARNING] Tests run: 27, Failures: 0, Errors: 0, Skipped: 27, Time elapsed: 28.688 s - in org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardToolLocal
[INFO] Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.901 s - in org.apache.hadoop.fs.s3a.scale.ITestS3AInputStreamPerformance
[WARNING] Tests run: 27, Failures: 0, Errors: 0, Skipped: 27, Time elapsed: 29.26 s - in org.apache.hadoop.fs.s3a.auth.ITestAssumeRole
[INFO] Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.579 s - in org.apache.hadoop.fs.s3a.fileContext.ITestS3AFileContextCreateMkdir
[INFO] Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.046 s - in org.apache.hadoop.fs.contract.s3a.ITestS3AContractDelete
[WARNING] Tests run: 11, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 22.876 s - in org.apache.hadoop.fs.contract.s3a.ITestS3AContractCreate
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.582 s - in org.apache.hadoop.fs.s3a.scale.ITestS3AConcurrentOps
[INFO] Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.986 s - in org.apache.hadoop.fs.contract.s3a.ITestS3AContractRename
[WARNING] Tests run: 15, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 29.564 s - in org.apache.hadoop.fs.contract.s3a.ITestS3AContractMultipartUploader
[INFO] Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.446 s - in org.apache.hadoop.fs.contract.s3a.ITestS3AContractMkdir
[WARNING] Tests run: 9, Failures: 0, Errors: 0, Skipped: 4, Time elapsed: 44.144 s - in org.apache.hadoop.fs.s3a.ITestS3ARemoteFileChanged
[INFO] Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 51.486 s - in org.apache.hadoop.fs.s3a.performance.ITestDirectoryMarkerListing
[INFO] Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 57.699 s - in org.apache.hadoop.fs.s3a.ITestS3AContractGetFileStatusV1List
[INFO] Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 53.863 s - in org.apache.hadoop.fs.contract.s3a.ITestS3AContractGetFileStatus
[WARNING] Tests run: 17, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 68.518 s - in org.apache.hadoop.fs.s3a.fileContext.ITestS3AFileContextURI
[INFO] Tests run: 43, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 76.039 s - in org.apache.hadoop.fs.s3a.ITestS3AFileSystemContract
[INFO] Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 77.757 s - in org.apache.hadoop.fs.s3a.commit.ITestCommitOperations
[INFO] Tests run: 72, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 82.777 s - in org.apache.hadoop.fs.contract.s3a.ITestS3AContractSeek
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 96.155 s - in org.apache.hadoop.fs.s3a.commit.staging.integration.ITestPartitionCommitMRJob
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 96.705 s - in org.apache.hadoop.fs.s3a.commit.staging.integration.ITestDirectoryCommitMRJob
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 97.507 s - in org.apache.hadoop.fs.s3a.commit.staging.integration.ITestStagingCommitMRJob
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 103.474 s - in org.apache.hadoop.fs.s3a.commit.magic.ITestMagicCommitMRJob
[INFO] Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 117.119 s - in org.apache.hadoop.fs.contract.s3a.ITestS3AContractDistCp
[INFO] Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 140.138 s - in org.apache.hadoop.fs.s3a.commit.magic.ITestMagicCommitProtocol
[WARNING] Tests run: 17, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 187.09 s - in org.apache.hadoop.fs.s3a.commit.staging.integration.ITestPartitionedCommitProtocol
[INFO] Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 193.478 s - in org.apache.hadoop.fs.s3a.commit.staging.integration.ITestStagingCommitProtocol
[WARNING] Tests run: 68, Failures: 0, Errors: 0, Skipped: 4, Time elapsed: 193.373 s - in org.apache.hadoop.fs.s3a.fileContext.ITestS3AFileContextMainOperations
[INFO] Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 194.498 s - in org.apache.hadoop.fs.s3a.commit.staging.integration.ITestDirectoryCommitProtocol
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 472.911 s - in org.apache.hadoop.fs.s3a.scale.ITestS3ADeleteManyFiles
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 570.166 s - in org.apache.hadoop.fs.s3a.scale.ITestS3ADirectoryPerformance
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 659.08 s - in org.apache.hadoop.fs.s3a.scale.ITestS3ADeleteFilesOneByOne
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 945.972 s - in org.apache.hadoop.fs.s3a.scale.ITestS3ACreatePerformance
[INFO]
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR] ITestS3AMiscOperations.testEmptyFileChecksums:152->Assert.assertEquals:120->Assert.failNotEquals:835->Assert.fail:89 checksums expected:<etag: "dfaef4b43256ea0b1b561c4122394ed5"> but was:<etag: "86eff4cc793bef257ef202f7f2ffcd64">
[ERROR] ITestS3AMiscOperations.testNonEmptyFileChecksumsUnencrypted:206->Assert.assertEquals:120->Assert.failNotEquals:835->Assert.fail:89 checksums expected:<etag: "95144225d0bd3b6039e89c70563eb37a"> but was:<etag: "b58a8ddec34ab0e88aac27fb92593c5c">
[ERROR] Errors:
[ERROR] ITestS3ATemporaryCredentials.testSTS:90 » SdkClient Unable to find a region vi...
[INFO]
[ERROR] Tests run: 676, Failures: 2, Errors: 1, Skipped: 119
[INFO]
[INFO]
[INFO] --- maven-failsafe-plugin:3.0.0-M1:integration-test (sequential-integration-tests) @ hadoop-aws ---
[INFO]
[INFO] -------------------------------------------------------
[INFO] T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.apache.hadoop.fs.s3a.scale.ITestS3AHugeFilesArrayBlocks
[INFO] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.666 s - in org.apache.hadoop.fs.s3a.scale.ITestS3AHugeFilesArrayBlocks
[INFO] Running org.apache.hadoop.fs.s3a.scale.ITestS3AHugeFilesDiskBlocks
[INFO] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.908 s - in org.apache.hadoop.fs.s3a.scale.ITestS3AHugeFilesDiskBlocks
[INFO] Running org.apache.hadoop.fs.s3a.scale.ITestS3AHugeFilesSSECDiskBlocks
[INFO] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.083 s - in org.apache.hadoop.fs.s3a.scale.ITestS3AHugeFilesSSECDiskBlocks
[INFO] Running org.apache.hadoop.fs.s3a.scale.ITestS3AHugeFilesByteBufferBlocks
[INFO] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.366 s - in org.apache.hadoop.fs.s3a.scale.ITestS3AHugeFilesByteBufferBlocks
[INFO] Running org.apache.hadoop.fs.s3a.commit.magic.ITestS3AHugeMagicCommits
[INFO] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.101 s - in org.apache.hadoop.fs.s3a.commit.magic.ITestS3AHugeMagicCommits
[INFO] Running org.apache.hadoop.fs.s3a.commit.terasort.ITestTerasortDirectoryCommitter
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 108.862 s - in org.apache.hadoop.fs.s3a.commit.terasort.ITestTerasortDirectoryCommitter
[INFO] Running org.apache.hadoop.fs.s3a.commit.terasort.ITestTerasortMagicCommitter
[ERROR] Tests run: 6, Failures: 1, Errors: 2, Skipped: 0, Time elapsed: 51.54 s <<< FAILURE! - in org.apache.hadoop.fs.s3a.commit.terasort.ITestTerasortMagicCommitter
[ERROR] test_110_teragen(org.apache.hadoop.fs.s3a.commit.terasort.ITestTerasortMagicCommitter) Time elapsed: 8.329 s <<< FAILURE!
java.lang.AssertionError: Teragen(1000, s3a://techgssclasstest20221004/terasort-ITestTerasortMagicCommitter/sortin) failed expected:<0> but was:<1>
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.failNotEquals(Assert.java:835)
at org.junit.Assert.assertEquals(Assert.java:647)
at org.apache.hadoop.fs.s3a.commit.terasort.AbstractCommitTerasortIT.executeStage(AbstractCommitTerasortIT.java:143)
at org.apache.hadoop.fs.s3a.commit.terasort.AbstractCommitTerasortIT.test_110_teragen(AbstractCommitTerasortIT.java:167)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.lang.Thread.run(Thread.java:750)
[ERROR] test_120_terasort(org.apache.hadoop.fs.s3a.commit.terasort.ITestTerasortMagicCommitter) Time elapsed: 0.656 s <<< ERROR!
java.io.FileNotFoundException: No such file or directory: s3a://techgssclasstest20221004/terasort-ITestTerasortMagicCommitter/sortin/_SUCCESS
at org.apache.hadoop.fs.s3a.S3AFileSystem.s3GetFileStatus(S3AFileSystem.java:2344)
at org.apache.hadoop.fs.s3a.S3AFileSystem.innerGetFileStatus(S3AFileSystem.java:2226)
at org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:2160)
at org.apache.hadoop.fs.s3a.commit.AbstractCommitITest.loadSuccessFile(AbstractCommitITest.java:498)
at org.apache.hadoop.fs.s3a.commit.terasort.AbstractCommitTerasortIT.test_120_terasort(AbstractCommitTerasortIT.java:177)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.lang.Thread.run(Thread.java:750)
[ERROR] test_130_teravalidate(org.apache.hadoop.fs.s3a.commit.terasort.ITestTerasortMagicCommitter) Time elapsed: 0.768 s <<< ERROR!
java.io.FileNotFoundException: No such file or directory: s3a://techgssclasstest20221004/terasort-ITestTerasortMagicCommitter/sortout/_SUCCESS
at org.apache.hadoop.fs.s3a.S3AFileSystem.s3GetFileStatus(S3AFileSystem.java:2344)
at org.apache.hadoop.fs.s3a.S3AFileSystem.innerGetFileStatus(S3AFileSystem.java:2226)
at org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:2160)
at org.apache.hadoop.fs.s3a.commit.AbstractCommitITest.loadSuccessFile(AbstractCommitITest.java:498)
at org.apache.hadoop.fs.s3a.commit.terasort.AbstractCommitTerasortIT.test_130_teravalidate(AbstractCommitTerasortIT.java:192)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.lang.Thread.run(Thread.java:750)
[INFO] Running org.apache.hadoop.fs.s3a.fileContext.ITestS3AFileContextStatistics
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.339 s - in org.apache.hadoop.fs.s3a.fileContext.ITestS3AFileContextStatistics
[INFO] Running org.apache.hadoop.fs.s3a.s3guard.ITestDynamoDBMetadataStoreScale
[WARNING] Tests run: 9, Failures: 0, Errors: 0, Skipped: 9, Time elapsed: 5.127 s - in org.apache.hadoop.fs.s3a.s3guard.ITestDynamoDBMetadataStoreScale
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3AEncryptionSSECBlockOutputStream
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.562 s - in org.apache.hadoop.fs.s3a.ITestS3AEncryptionSSECBlockOutputStream
[INFO] Running org.apache.hadoop.fs.s3a.ITestS3AEncryptionSSEC
[ERROR] Tests run: 10, Failures: 3, Errors: 0, Skipped: 0, Time elapsed: 25.129 s <<< FAILURE! - in org.apache.hadoop.fs.s3a.ITestS3AEncryptionSSEC
[ERROR] testListStatusEncryptedDir(org.apache.hadoop.fs.s3a.ITestS3AEncryptionSSEC) Time elapsed: 1.654 s <<< FAILURE!
java.lang.AssertionError: Expecting java.nio.file.AccessDeniedException with text Service: Amazon S3; Status Code: 403; but got : void
at org.apache.hadoop.test.LambdaTestUtils.intercept(LambdaTestUtils.java:492)
at org.apache.hadoop.test.LambdaTestUtils.intercept(LambdaTestUtils.java:522)
at org.apache.hadoop.fs.s3a.ITestS3AEncryptionSSEC.testListStatusEncryptedDir(ITestS3AEncryptionSSEC.java:253)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.lang.Thread.run(Thread.java:750)
[ERROR] testListEncryptedDir(org.apache.hadoop.fs.s3a.ITestS3AEncryptionSSEC) Time elapsed: 1.615 s <<< FAILURE!
java.lang.AssertionError: Expecting java.nio.file.AccessDeniedException with text Service: Amazon S3; Status Code: 403; but got : void
at org.apache.hadoop.test.LambdaTestUtils.intercept(LambdaTestUtils.java:492)
at org.apache.hadoop.test.LambdaTestUtils.intercept(LambdaTestUtils.java:522)
at org.apache.hadoop.fs.s3a.ITestS3AEncryptionSSEC.testListEncryptedDir(ITestS3AEncryptionSSEC.java:208)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.lang.Thread.run(Thread.java:750)
[ERROR] testCreateSubdirWithDifferentKey(org.apache.hadoop.fs.s3a.ITestS3AEncryptionSSEC) Time elapsed: 1.51 s <<< FAILURE!
java.lang.AssertionError: Expected a java.nio.file.AccessDeniedException to be thrown, but got the result: : S3AFileStatus{path=s3a://techgssclasstest20221004/test/testCreateSubdirWithDifferentKey/nestedDir; isDirectory=true; modification_time=0; access_time=0; owner=gss2002; group=gss2002; permission=rwxrwxrwx; isSymlink=false; hasAcl=false; isEncrypted=true; isErasureCoded=false} isEmptyDirectory=FALSE
at org.apache.hadoop.test.LambdaTestUtils.intercept(LambdaTestUtils.java:492)
at org.apache.hadoop.test.LambdaTestUtils.intercept(LambdaTestUtils.java:377)
at org.apache.hadoop.test.LambdaTestUtils.intercept(LambdaTestUtils.java:446)
at org.apache.hadoop.fs.s3a.ITestS3AEncryptionSSEC.testCreateSubdirWithDifferentKey(ITestS3AEncryptionSSEC.java:124)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.lang.Thread.run(Thread.java:750)
[INFO] Running org.apache.hadoop.fs.contract.s3a.ITestS3AContractRootDir
[INFO] Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.291 s - in org.apache.hadoop.fs.contract.s3a.ITestS3AContractRootDir
[INFO]
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR] ITestS3AEncryptionSSEC.testCreateSubdirWithDifferentKey:124 Expected a java.nio.file.AccessDeniedException to be thrown, but got the result: : S3AFileStatus{path=s3a://techgssclasstest20221004/test/testCreateSubdirWithDifferentKey/nestedDir; isDirectory=true; modification_time=0; access_time=0; owner=gss2002; group=gss2002; permission=rwxrwxrwx; isSymlink=false; hasAcl=false; isEncrypted=true; isErasureCoded=false} isEmptyDirectory=FALSE
[ERROR] ITestS3AEncryptionSSEC.testListEncryptedDir:208 Expecting java.nio.file.AccessDeniedException with text Service: Amazon S3; Status Code: 403; but got : void
[ERROR] ITestS3AEncryptionSSEC.testListStatusEncryptedDir:253 Expecting java.nio.file.AccessDeniedException with text Service: Amazon S3; Status Code: 403; but got : void
[ERROR] ITestTerasortMagicCommitter>AbstractCommitTerasortIT.test_110_teragen:167->AbstractCommitTerasortIT.executeStage:143->Assert.assertEquals:647->Assert.failNotEquals:835->Assert.fail:89 Teragen(1000, s3a://techgssclasstest20221004/terasort-ITestTerasortMagicCommitter/sortin) failed expected:<0> but was:<1>
[ERROR] Errors:
[ERROR] ITestTerasortMagicCommitter>AbstractCommitTerasortIT.test_120_terasort:177->AbstractCommitITest.loadSuccessFile:498 » FileNotFound
[ERROR] ITestTerasortMagicCommitter>AbstractCommitTerasortIT.test_130_teravalidate:192->AbstractCommitITest.loadSuccessFile:498 » FileNotFound
[INFO]
[ERROR] Tests run: 80, Failures: 4, Errors: 2, Skipped: 9
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 24:30 min
[INFO] Finished at: 2022-10-19T16:37:20-04:00
[INFO] ------------------------------------------------------------------------
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
[GitHub] [hadoop] steveloughran closed pull request #5046: HADOOP-17705. S3A to add Config to set AWS region
Posted by "steveloughran (via GitHub)" <gi...@apache.org>.
steveloughran closed pull request #5046: HADOOP-17705. S3A to add Config to set AWS region
URL: https://github.com/apache/hadoop/pull/5046
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
[GitHub] [hadoop] hadoop-yetus commented on pull request #5046: HADOOP-17705. S3A to add Config to set AWS region
Posted by GitBox <gi...@apache.org>.
hadoop-yetus commented on PR #5046:
URL: https://github.com/apache/hadoop/pull/5046#issuecomment-1284708016
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|:----:|----------:|--------:|:--------:|:-------:|
| +0 :ok: | reexec | 6m 11s | | Docker mode activated. |
|||| _ Prechecks _ |
| +1 :green_heart: | dupname | 0m 0s | | No case conflicting files found. |
| +0 :ok: | codespell | 0m 0s | | codespell was not available. |
| +0 :ok: | detsecrets | 0m 0s | | detect-secrets was not available. |
| +1 :green_heart: | @author | 0m 0s | | The patch does not contain any @author tags. |
| +1 :green_heart: | test4tests | 0m 0s | | The patch appears to include 1 new or modified test files. |
|||| _ branch-3.2 Compile Tests _ |
| +1 :green_heart: | mvninstall | 32m 14s | | branch-3.2 passed |
| +1 :green_heart: | compile | 0m 39s | | branch-3.2 passed |
| +1 :green_heart: | checkstyle | 0m 45s | | branch-3.2 passed |
| +1 :green_heart: | mvnsite | 0m 53s | | branch-3.2 passed |
| +1 :green_heart: | javadoc | 0m 45s | | branch-3.2 passed |
| +1 :green_heart: | spotbugs | 1m 25s | | branch-3.2 passed |
| +1 :green_heart: | shadedclient | 14m 46s | | branch has no errors when building and testing our client artifacts. |
|||| _ Patch Compile Tests _ |
| +1 :green_heart: | mvninstall | 0m 45s | | the patch passed |
| +1 :green_heart: | compile | 0m 28s | | the patch passed |
| +1 :green_heart: | javac | 0m 28s | | the patch passed |
| -1 :x: | blanks | 0m 0s | [/blanks-eol.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5046/1/artifact/out/blanks-eol.txt) | The patch has 7 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply |
| -1 :x: | blanks | 0m 0s | [/blanks-tabs.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5046/1/artifact/out/blanks-tabs.txt) | The patch 18 line(s) with tabs. |
| -0 :warning: | checkstyle | 0m 20s | [/results-checkstyle-hadoop-tools_hadoop-aws.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5046/1/artifact/out/results-checkstyle-hadoop-tools_hadoop-aws.txt) | hadoop-tools/hadoop-aws: The patch generated 20 new + 0 unchanged - 0 fixed = 20 total (was 0) |
| +1 :green_heart: | mvnsite | 0m 32s | | the patch passed |
| -1 :x: | javadoc | 0m 25s | [/patch-javadoc-hadoop-tools_hadoop-aws.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5046/1/artifact/out/patch-javadoc-hadoop-tools_hadoop-aws.txt) | hadoop-aws in the patch failed. |
| +1 :green_heart: | spotbugs | 1m 6s | | the patch passed |
| +1 :green_heart: | shadedclient | 15m 41s | | patch has no errors when building and testing our client artifacts. |
|||| _ Other Tests _ |
| +1 :green_heart: | unit | 4m 57s | | hadoop-aws in the patch passed. |
| +1 :green_heart: | asflicense | 0m 42s | | The patch does not generate ASF License warnings. |
| | | 83m 17s | | |
| Subsystem | Report/Notes |
|----------:|:-------------|
| Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5046/1/artifact/out/Dockerfile |
| GITHUB PR | https://github.com/apache/hadoop/pull/5046 |
| Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets |
| uname | Linux 9acad0f5344f 4.15.0-191-generic #202-Ubuntu SMP Thu Aug 4 01:49:29 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | dev-support/bin/hadoop.sh |
| git revision | branch-3.2 / 0f2cacbf7edd99f60c631247954d4c05ae6f0d4f |
| Default Java | Private Build-1.8.0_342-8u342-b07-0ubuntu1~18.04-b07 |
| Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5046/1/testReport/ |
| Max. process+thread count | 410 (vs. ulimit of 5500) |
| modules | C: hadoop-tools/hadoop-aws U: hadoop-tools/hadoop-aws |
| Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5046/1/console |
| versions | git=2.17.1 maven=3.6.0 spotbugs=4.2.2 |
| Powered by | Apache Yetus 0.14.0 https://yetus.apache.org |
This message was automatically generated.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
[GitHub] [hadoop] steveloughran commented on pull request #5046: HADOOP-17705. S3A to add Config to set AWS region
Posted by "steveloughran (via GitHub)" <gi...@apache.org>.
steveloughran commented on PR #5046:
URL: https://github.com/apache/hadoop/pull/5046#issuecomment-1527355855
this is done now. closing. all seems to work too!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org