You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by GitBox <gi...@apache.org> on 2020/04/10 17:09:49 UTC
[GitHub] [hadoop-ozone] bharatviswa504 opened a new pull request #807:
HDDS-3375. S3A failing complete multipart upload with Ozone S3.
bharatviswa504 opened a new pull request #807: HDDS-3375. S3A failing complete multipart upload with Ozone S3.
URL: https://github.com/apache/hadoop-ozone/pull/807
## What changes were proposed in this pull request?
S3A failing complete multipart upload request due to namespace missing in the request.
S3 documentation also shows the namespace in the request, in response namespace is set, only missing in the request.
## What is the link to the Apache JIRA
https://issues.apache.org/jira/browse/HDDS-3375
## How was this patch tested?
Existing tests should cover this.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org
[GitHub] [hadoop-ozone] bharatviswa504 commented on issue #807: HDDS-3375.
S3A failing complete multipart upload with Ozone S3.
Posted by GitBox <gi...@apache.org>.
bharatviswa504 commented on issue #807: HDDS-3375. S3A failing complete multipart upload with Ozone S3.
URL: https://github.com/apache/hadoop-ozone/pull/807#issuecomment-614353652
/pending need to address @ChenSammi comment based on her fix.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org
[GitHub] [hadoop-ozone] ChenSammi commented on issue #807: HDDS-3375. S3A
failing complete multipart upload with Ozone S3.
Posted by GitBox <gi...@apache.org>.
ChenSammi commented on issue #807: HDDS-3375. S3A failing complete multipart upload with Ozone S3.
URL: https://github.com/apache/hadoop-ozone/pull/807#issuecomment-612737243
Besides, I found a lot of ReadChunk requests during the MultipartUpload process. Do you have any idea why?
2020-04-11 15:07:18,360 DEBUG org.apache.hadoop.hdds.scm.storage.BlockInputStream: Initializing BlockInputStream for get key to access 17
2020-04-11 15:07:18,361 DEBUG org.apache.hadoop.hdds.scm.XceiverClientGrpc: Executing command cmdType: GetBlock
traceID: "85c1486c88295b04:fa2ca66da8aa065:85c1486c88295b04:1"
containerID: 17
datanodeUuid: "515cab4b-39b5-4439-b1a8-a7b725f5784a"
getBlock {
blockID {
containerID: 17
localID: 103978581765455957
blockCommitSequenceId: 1310
}
}
on datanode b65b0b6c-b0bb-429f-a23d-467c72d4b85c{ip: 10.120.139.111, host: host111, networkLocation: /rack1, certSerialId: null}
2020-04-11 15:07:18,361 DEBUG org.apache.hadoop.hdds.scm.XceiverClientGrpc: Send command GetBlock to datanode /rack1/b65b0b6c-b0bb-429f-a23d-467c72d4b85c
2020-04-11 15:07:18,361 DEBUG org.apache.hadoop.hdds.scm.pipeline.Pipeline: Nodes in order is empty, delegate to getFirstNode
2020-04-11 15:07:18,361 DEBUG org.apache.hadoop.hdds.scm.XceiverClientGrpc: Executing command cmdType: ReadChunk
traceID: "17fe78a2a02076e6:7a7655aee1f45721:17fe78a2a02076e6:1"
containerID: 14
datanodeUuid: "515cab4b-39b5-4439-b1a8-a7b725f5784a"
readChunk {
blockID {
containerID: 14
localID: 103978581259976746
blockCommitSequenceId: 981
}
chunkData {
chunkName: "103978581259976746_chunk_2"
offset: 4194304
len: 1048576
checksumData {
type: NONE
bytesPerChecksum: 1048576
}
}
}
on datanode ed90869c-317e-4303-8922-9fa83a3983cb{ip: 10.120.113.172, host: host172, networkLocation: /rack2, certSerialId: null}
2020-04-11 15:07:18,361 DEBUG org.apache.hadoop.hdds.scm.XceiverClientGrpc: Send command ReadChunk to datanode /rack2/ed90869c-317e-4303-8922-9fa83a3983cb
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org
[GitHub] [hadoop-ozone] ChenSammi commented on issue #807: HDDS-3375. S3A
failing complete multipart upload with Ozone S3.
Posted by GitBox <gi...@apache.org>.
ChenSammi commented on issue #807: HDDS-3375. S3A failing complete multipart upload with Ozone S3.
URL: https://github.com/apache/hadoop-ozone/pull/807#issuecomment-612736696
@bharatviswa504 , I found the excepion is because request body sent by s3a doesn's carry the namespace. Send a reference fix on Slack.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org
[GitHub] [hadoop-ozone] ChenSammi edited a comment on issue #807: HDDS-3375.
S3A failing complete multipart upload with Ozone S3.
Posted by GitBox <gi...@apache.org>.
ChenSammi edited a comment on issue #807: HDDS-3375. S3A failing complete multipart upload with Ozone S3.
URL: https://github.com/apache/hadoop-ozone/pull/807#issuecomment-612737243
Besides, I found a lot of ReadChunk requests during the MultipartUpload process. @bharatviswa504 , do you have any idea about this?
2020-04-11 15:07:18,360 DEBUG org.apache.hadoop.hdds.scm.storage.BlockInputStream: Initializing BlockInputStream for get key to access 17
2020-04-11 15:07:18,361 DEBUG org.apache.hadoop.hdds.scm.XceiverClientGrpc: Executing command cmdType: GetBlock
traceID: "85c1486c88295b04:fa2ca66da8aa065:85c1486c88295b04:1"
containerID: 17
datanodeUuid: "515cab4b-39b5-4439-b1a8-a7b725f5784a"
getBlock {
blockID {
containerID: 17
localID: 103978581765455957
blockCommitSequenceId: 1310
}
}
on datanode b65b0b6c-b0bb-429f-a23d-467c72d4b85c{ip: 10.120.139.111, host: host111, networkLocation: /rack1, certSerialId: null}
2020-04-11 15:07:18,361 DEBUG org.apache.hadoop.hdds.scm.XceiverClientGrpc: Send command GetBlock to datanode /rack1/b65b0b6c-b0bb-429f-a23d-467c72d4b85c
2020-04-11 15:07:18,361 DEBUG org.apache.hadoop.hdds.scm.pipeline.Pipeline: Nodes in order is empty, delegate to getFirstNode
2020-04-11 15:07:18,361 DEBUG org.apache.hadoop.hdds.scm.XceiverClientGrpc: Executing command cmdType: ReadChunk
traceID: "17fe78a2a02076e6:7a7655aee1f45721:17fe78a2a02076e6:1"
containerID: 14
datanodeUuid: "515cab4b-39b5-4439-b1a8-a7b725f5784a"
readChunk {
blockID {
containerID: 14
localID: 103978581259976746
blockCommitSequenceId: 981
}
chunkData {
chunkName: "103978581259976746_chunk_2"
offset: 4194304
len: 1048576
checksumData {
type: NONE
bytesPerChecksum: 1048576
}
}
}
on datanode ed90869c-317e-4303-8922-9fa83a3983cb{ip: 10.120.113.172, host: host172, networkLocation: /rack2, certSerialId: null}
2020-04-11 15:07:18,361 DEBUG org.apache.hadoop.hdds.scm.XceiverClientGrpc: Send command ReadChunk to datanode /rack2/ed90869c-317e-4303-8922-9fa83a3983cb
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org
[GitHub] [hadoop-ozone] bharatviswa504 commented on issue #807: HDDS-3375.
S3A failing complete multipart upload with Ozone S3.
Posted by GitBox <gi...@apache.org>.
bharatviswa504 commented on issue #807: HDDS-3375. S3A failing complete multipart upload with Ozone S3.
URL: https://github.com/apache/hadoop-ozone/pull/807#issuecomment-614353774
Thank You @ChenSammi for offline discussion and providing information and fix. I will look into it and will update the patch.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org