You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by GitBox <gi...@apache.org> on 2021/08/26 10:13:21 UTC
[GitHub] [ozone] zhengchenyu opened a new pull request #2583: HDDS-5676. When use s3g and goofys, some write operation will failed.
zhengchenyu opened a new pull request #2583:
URL: https://github.com/apache/ozone/pull/2583
## What changes were proposed in this pull request?
First mount bucket1
goofys --endpoint http://localhost:9878 bucket1 /mount/bucket1
Reproduce case:
when I rename /mount/bucket1/abc to /mount/bucket1/xyz (/mount/bucket1/xyz is not exist), s3g will throw HTTP 500 Internal Server Error.
S3g should return FILE or Directory not found with 404.
## What is the link to the Apache JIRA
https://issues.apache.org/jira/browse/HDDS-5676
## How was this patch tested?
manual tests
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
[GitHub] [ozone] zhengchenyu closed pull request #2583: HDDS-5676. When use s3g and goofys, some write operation will failed.
Posted by GitBox <gi...@apache.org>.
zhengchenyu closed pull request #2583:
URL: https://github.com/apache/ozone/pull/2583
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
[GitHub] [ozone] kerneltime commented on pull request #2583: HDDS-5676. When use s3g and goofys, some write operation will failed.
Posted by GitBox <gi...@apache.org>.
kerneltime commented on pull request #2583:
URL: https://github.com/apache/ozone/pull/2583#issuecomment-907648074
- Can you paste the exact cli invocation? `mv /mount/bucket1/abc /mount/bucket1/xyz` should not result in a 404.
- We should not extend the S3 Error Messages unless we have to. Returning `404 not found` for both should be suitable.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
[GitHub] [ozone] zhengchenyu edited a comment on pull request #2583: HDDS-5676. When use s3g and goofys, some write operation will failed.
Posted by GitBox <gi...@apache.org>.
zhengchenyu edited a comment on pull request #2583:
URL: https://github.com/apache/ozone/pull/2583#issuecomment-908854219
@kerneltime
> `echo hello > /mount/tmp/abc` should create an object under the bucket mounted at `tmp` called `abc`. Why do you think `abc` should be a directory?
First, I didn't said that `abc` is a directory. Here `abc` is not created. Because s3g returned 500 means internal error. goofys can't resovle it, so failed.
> In the steps outlined, there was a bucket created called `tmp` using AWS CLI but the `goofyfs` command used a bucket named `bucket` and not tmp to be mounted under /mount/tmp..
Here, there are two test:
(1) mv /mount/bucket1/abc /mount/bucket1/xyz
(2) echo hello > /mount/tmp/abc
I use (2) to reproduce detail info.
Note: Many write operation dir will fail. Please ignore (1), that's about https://github.com/apache/ozone/pull/2584 which is closed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
[GitHub] [ozone] zhengchenyu commented on pull request #2583: HDDS-5676. When use s3g and goofys, some write operation will failed.
Posted by GitBox <gi...@apache.org>.
zhengchenyu commented on pull request #2583:
URL: https://github.com/apache/ozone/pull/2583#issuecomment-908854219
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
[GitHub] [ozone] zhengchenyu commented on pull request #2583: HDDS-5676. When use s3g and goofys, some write operation will failed.
Posted by GitBox <gi...@apache.org>.
zhengchenyu commented on pull request #2583:
URL: https://github.com/apache/ozone/pull/2583#issuecomment-908201781
> * Can you paste the exact cli invocation? `mv /mount/bucket1/abc /mount/bucket1/xyz` should not result in a 404.
> * We should not extend the S3 Error Messages unless we have to. Returning `404 not found` for both should be suitable.
I have reproduce log, please help me review it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
[GitHub] [ozone] zhengchenyu edited a comment on pull request #2583: HDDS-5676. When use s3g and goofys, some write operation will failed.
Posted by GitBox <gi...@apache.org>.
zhengchenyu edited a comment on pull request #2583:
URL: https://github.com/apache/ozone/pull/2583#issuecomment-908854219
@kerneltime
> `echo hello > /mount/tmp/abc` should create an object under the bucket mounted at `tmp` called `abc`. Why do you think `abc` should be a directory?
First, I didn't said that `abc` is a directory. Here `abc` is not created. Because s3g returned 500 means internal error. goofys can't resovle it, so failed.
> In the steps outlined, there was a bucket created called `tmp` using AWS CLI but the `goofyfs` command used a bucket named `bucket` and not tmp to be mounted under /mount/tmp..
Here, there are two test:
(1) mv /mount/bucket1/abc /mount/bucket1/xyz
(2) echo hello > /mount/tmp/abc
I use (2) to reproduce detail info.
Note: Many write operation dir will fail. Please ignore (1), that's about https://github.com/apache/ozone/pull/2584 which is closed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
[GitHub] [ozone] zhengchenyu closed pull request #2583: HDDS-5676. When use s3g and goofys, some write operation will failed.
Posted by GitBox <gi...@apache.org>.
zhengchenyu closed pull request #2583:
URL: https://github.com/apache/ozone/pull/2583
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
[GitHub] [ozone] zhengchenyu commented on pull request #2583: HDDS-5676. When use s3g and goofys, some write operation will failed.
Posted by GitBox <gi...@apache.org>.
zhengchenyu commented on pull request #2583:
URL: https://github.com/apache/ozone/pull/2583#issuecomment-908854219
> `echo hello > /mount/tmp/abc` should create an object under the bucket mounted at `tmp` called `abc`. Why do you think `abc` should be a directory?
First, I didn't said that `abc` is a directory. Here `abc` is not created. Because s3g returned 500 means internal error. goofys can't resovle it, so failed.
> In the steps outlined, there was a bucket created called `tmp` using AWS CLI but the `goofyfs` command used a bucket named `bucket` and not tmp to be mounted under /mount/tmp..
Here, there are two test:
(1) mv /mount/bucket1/abc /mount/bucket1/xyz
(2) echo hello > /mount/tmp/abc
I use (2) to reproduce detail info.
Note: Many write operation dir will fail. Please ignore (1), that's about https://github.com/apache/ozone/pull/2584 which is closed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
[GitHub] [ozone] zhengchenyu edited a comment on pull request #2583: HDDS-5676. When use s3g and goofys, some write operation will failed.
Posted by GitBox <gi...@apache.org>.
zhengchenyu edited a comment on pull request #2583:
URL: https://github.com/apache/ozone/pull/2583#issuecomment-908201781
> * Can you paste the exact cli invocation? `mv /mount/bucket1/abc /mount/bucket1/xyz` should not result in a 404.
> * We should not extend the S3 Error Messages unless we have to. Returning `404 not found` for both should be suitable.
I have reproduce the problem, please help me review it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
[GitHub] [ozone] zhengchenyu commented on pull request #2583: HDDS-5676. When use s3g and goofys, some write operation will failed.
Posted by GitBox <gi...@apache.org>.
zhengchenyu commented on pull request #2583:
URL: https://github.com/apache/ozone/pull/2583#issuecomment-908883789
I found only ozone.om.enable.filesystem.paths=true and ozone.om.metadata.layout=PREFIX, operation will failed. As https://github.com/apache/ozone/pull/1418 and https://github.com/apache/ozone/pull/2584 mentioned, we should make sure bucketlayout is OBJECT_STORE. So expect the progress of https://issues.apache.org/jira/browse/HDDS-5672. I will close it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
[GitHub] [ozone] kerneltime commented on pull request #2583: HDDS-5676. When use s3g and goofys, some write operation will failed.
Posted by GitBox <gi...@apache.org>.
kerneltime commented on pull request #2583:
URL: https://github.com/apache/ozone/pull/2583#issuecomment-908547045
`echo hello > /mount/tmp/abc` should create an object under the bucket mounted at `tmp` called `abc`. Why do you think `abc` should be a directory?
In the steps outlined, there was a bucket created called `tmp` using AWS CLI but the `goofyfs` command used a bucket named `bucket` and not tmp to be mounted under /mount/tmp..
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
[GitHub] [ozone] kerneltime commented on pull request #2583: HDDS-5676. When use s3g and goofys, some write operation will failed.
Posted by GitBox <gi...@apache.org>.
kerneltime commented on pull request #2583:
URL: https://github.com/apache/ozone/pull/2583#issuecomment-908547045
`echo hello > /mount/tmp/abc` should create an object under the bucket mounted at `tmp` called `abc`. Why do you think `abc` should be a directory?
In the steps outlined, there was a bucket created called `tmp` using AWS CLI but the `goofyfs` command used a bucket named `bucket` and not tmp to be mounted under /mount/tmp..
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org