You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by GitBox <gi...@apache.org> on 2020/05/11 06:00:43 UTC
[GitHub] [hadoop-ozone] mukul1987 opened a new pull request #911: HDDS-3564. Update Ozone to latest Ratis Snapshot(0.6.0-1720b1f-SNAPSHOT).
mukul1987 opened a new pull request #911:
URL: https://github.com/apache/hadoop-ozone/pull/911
## What changes were proposed in this pull request?
Update Ozone to latest Ratis Snapshot(0.6.0-1720b1f-SNAPSHOT).
## What is the link to the Apache JIRA
https://issues.apache.org/jira/browse/HDDS-3564
## How was this patch tested?
Build was successful.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org
[GitHub] [hadoop-ozone] mukul1987 commented on pull request #911: HDDS-3564. Update Ozone to latest Ratis Snapshot(0.6.0-1720b1f-SNAPSHOT).
Posted by GitBox <gi...@apache.org>.
mukul1987 commented on pull request #911:
URL: https://github.com/apache/hadoop-ozone/pull/911#issuecomment-628378768
@hanishakoneru I have updated the patch with the new snapshot.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org
[GitHub] [hadoop-ozone] elek commented on pull request #911: HDDS-3564. Update Ozone to latest Ratis Snapshot (0.6.0-3596a58-SNAPSHOT).
Posted by GitBox <gi...@apache.org>.
elek commented on pull request #911:
URL: https://github.com/apache/hadoop-ozone/pull/911#issuecomment-637541097
Thanks the proposal @adoroszlai. I have seen acceptance test timeouts in the previous builds (which is not on the master). I think it should be checked before the merge (if visible with the latest snapshot). It's the same effort to check here or the master, but on master makes the merge of PRs harder.
> Further proposals:
And thank you for the proposals:
> Archive failures of pr-check, too (currently only post-commit on master is archived), to get info on significantly more CI runs, ie. more data points.
We can do it. It requires more space and it will include a lot of noise (failures which are real failures). We need some smart filtering (eg. check only the failures which are passed later with a different build but no difference between the two commits).
> Create Ratis snapshot release more frequently (automate it?).
We can check the purge policy on snapshot.apache.org. If snapshots are kept until the next release we can do a daily snapshot build and use `mvn versions:lock-snapshots` + `versions:unlock-snapshots` commands (it replaces a SNAPSHOT version with an exact timestamped version)
> Test Ozone with each "significant" snapshot (eg. one that is not a test-only or build infrastructure change) on a dedicated branch. Also archive these runs.
+1. We can create a daily build with full Ozone + latest Ratis. Would help a lot IMHO.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org
[GitHub] [hadoop-ozone] hanishakoneru commented on pull request #911: HDDS-3564. Update Ozone to latest Ratis Snapshot(0.6.0-1720b1f-SNAPSHOT).
Posted by GitBox <gi...@apache.org>.
hanishakoneru commented on pull request #911:
URL: https://github.com/apache/hadoop-ozone/pull/911#issuecomment-628733298
Thanks @mukul1987
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org
[GitHub] [hadoop-ozone] elek commented on pull request #911: HDDS-3564. Update Ozone to latest Ratis Snapshot (0.6.0-3596a58-SNAPSHOT).
Posted by GitBox <gi...@apache.org>.
elek commented on pull request #911:
URL: https://github.com/apache/hadoop-ozone/pull/911#issuecomment-638796970
This patch seems to have problems which are not on the master. Would be great to investigate them:
One example:
{code}
java.io.IOException: java.lang.IllegalStateException: org.apache.ratis.util.Preconditions$$Lambda$155/1521443176@2c865c75
{code}
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org
[GitHub] [hadoop-ozone] mukul1987 commented on pull request #911: HDDS-3564. Update Ozone to latest Ratis Snapshot (0.6.0-3596a58-SNAPSHOT).
Posted by GitBox <gi...@apache.org>.
mukul1987 commented on pull request #911:
URL: https://github.com/apache/hadoop-ozone/pull/911#issuecomment-630212368
The frequent test failures here are fixed via HDDS-3601 and HDDS-3602
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org
[GitHub] [hadoop-ozone] mukul1987 commented on pull request #911: HDDS-3564. Update Ozone to latest Ratis Snapshot (0.6.0-3596a58-SNAPSHOT).
Posted by GitBox <gi...@apache.org>.
mukul1987 commented on pull request #911:
URL: https://github.com/apache/hadoop-ozone/pull/911#issuecomment-639393533
Thanks @elek, Yes, I have updated the PR, this once again tries to update the Ratis version to get to a more stable version.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org
[GitHub] [hadoop-ozone] mukul1987 merged pull request #911: HDDS-3564. Update Ozone to latest Ratis Snapshot (0.6.0-3596a58-SNAPSHOT).
Posted by GitBox <gi...@apache.org>.
mukul1987 merged pull request #911:
URL: https://github.com/apache/hadoop-ozone/pull/911
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org
[GitHub] [hadoop-ozone] elek commented on pull request #911: HDDS-3564. Update Ozone to latest Ratis Snapshot (0.6.0-3596a58-SNAPSHOT).
Posted by GitBox <gi...@apache.org>.
elek commented on pull request #911:
URL: https://github.com/apache/hadoop-ozone/pull/911#issuecomment-640583336
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org
[GitHub] [hadoop-ozone] elek commented on pull request #911: HDDS-3564. Update Ozone to latest Ratis Snapshot (0.6.0-3596a58-SNAPSHOT).
Posted by GitBox <gi...@apache.org>.
elek commented on pull request #911:
URL: https://github.com/apache/hadoop-ozone/pull/911#issuecomment-635194875
> What do you suggest with this version bump?
ping @lokeshj1703, @mukul1987
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org
[GitHub] [hadoop-ozone] elek commented on pull request #911: HDDS-3564. Update Ozone to latest Ratis Snapshot (0.6.0-3596a58-SNAPSHOT).
Posted by GitBox <gi...@apache.org>.
elek commented on pull request #911:
URL: https://github.com/apache/hadoop-ozone/pull/911#issuecomment-631343187
> The frequent test failures here are fixed via HDDS-3601 and HDDS-3602
Both are merged. I suppose we will have mostly green builds after a rebase.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org
[GitHub] [hadoop-ozone] mukul1987 commented on pull request #911: HDDS-3564. Update Ozone to latest Ratis Snapshot (0.6.0-3596a58-SNAPSHOT).
Posted by GitBox <gi...@apache.org>.
mukul1987 commented on pull request #911:
URL: https://github.com/apache/hadoop-ozone/pull/911#issuecomment-641043573
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org
[GitHub] [hadoop-ozone] elek commented on pull request #911: HDDS-3564. Update Ozone to latest Ratis Snapshot (0.6.0-3596a58-SNAPSHOT).
Posted by GitBox <gi...@apache.org>.
elek commented on pull request #911:
URL: https://github.com/apache/hadoop-ozone/pull/911#issuecomment-631439476
#08a3495 is failed with timeout, and it seems to be Ratis related:
```
2020-05-20 09:55:02,620 [java.util.concurrent.ThreadPoolExecutor$Worker@687b99c3[State = -1, empty queue]] WARN server.GrpcLogAppender (GrpcLogAppender.java:timeoutAppendRequest(213)) - 1cbabd32-0c3f-4f38-ae01-b2b3d9193852@group-0A8E2870BF3C->4f19e3ae-b4d5-46dd-b016-d762b73ce108-GrpcLogAppender: appendEntries Timeout, request=AppendEntriesRequest:cid=117,entriesCount=1,lastEntry=(t:1, i:100)
2020-05-20 09:55:02,622 [java.util.concurrent.ThreadPoolExecutor$Worker@687b99c3[State = -1, empty queue]] WARN server.GrpcLogAppender (GrpcLogAppender.java:timeoutAppendRequest(213)) - 1cbabd32-0c3f-4f38-ae01-b2b3d9193852@group-0A8E2870BF3C->4f19e3ae-b4d5-46dd-b016-d762b73ce108-GrpcLogAppender: appendEntries Timeout, request=AppendEntriesRequest:cid=118,entriesCount=1,lastEntry=(t:1, i:101)
```
This is something which we have seen earlier, but it supposed to be fixed with RATIS-840.
Do you have any idea what is the root cause?
What do you suggest with this version bump?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org
[GitHub] [hadoop-ozone] mukul1987 commented on pull request #911: HDDS-3564. Update Ozone to latest Ratis Snapshot (0.6.0-3596a58-SNAPSHOT).
Posted by GitBox <gi...@apache.org>.
mukul1987 commented on pull request #911:
URL: https://github.com/apache/hadoop-ozone/pull/911#issuecomment-636073584
@adoroszlai, sure I will create a new patch with the latest ratis snapshot
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org