You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Bharat Viswanadham (Jira)" <ji...@apache.org> on 2020/07/22 22:41:00 UTC

[jira] [Commented] (HDDS-3999) OM NPE and shutdown while S3MultipartUploadCommitPartResponse#checkAndUpdateDB

    [ https://issues.apache.org/jira/browse/HDDS-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163112#comment-17163112 ] 

Bharat Viswanadham commented on HDDS-3999:
------------------------------------------

Hi [~maobaolong]
Thanks for reporting this issue.
I took a look at it, this is caused by HDDS-3685. And the tests have not caught this because the scenario for this is
1. Initiate MPU
2. Part Upload in progress
3. Abort Upload
4. Part upload close to commit the part.

Attached a test patch to repro this.

> OM NPE and shutdown while S3MultipartUploadCommitPartResponse#checkAndUpdateDB
> ------------------------------------------------------------------------------
>
>                 Key: HDDS-3999
>                 URL: https://issues.apache.org/jira/browse/HDDS-3999
>             Project: Hadoop Distributed Data Store
>          Issue Type: Bug
>          Components: Ozone Manager
>    Affects Versions: 0.6.0
>            Reporter: maobaolong
>            Assignee: maobaolong
>            Priority: Major
>         Attachments: OM-NPE-Full.log, screenshot-1.png
>
>
> The related bad code.
>  !screenshot-1.png! 
> The following is the part log of OM. If you want to see the full log, you can download the attachment.
> 2020-07-20 16:28:56,395 ERROR ratis.OzoneManagerDoubleBuffer (ExitUtils.java:terminate(133)) - Terminating with exit status 2: OMDoubleBuffer flush threadOMDoubleBufferFlushThreadencountered Throwable error
> java.lang.NullPointerException
> 	at org.apache.hadoop.ozone.om.response.s3.multipart.S3MultipartUploadCommitPartResponse.checkAndUpdateDB(S3MultipartUploadCommitPartResponse.java:99)
> 	at org.apache.hadoop.ozone.om.ratis.OzoneManagerDoubleBuffer.lambda$null$0(OzoneManagerDoubleBuffer.java:256)
> 	at org.apache.hadoop.ozone.om.ratis.OzoneManagerDoubleBuffer.addToBatchWithTrace(OzoneManagerDoubleBuffer.java:201)
> 	at org.apache.hadoop.ozone.om.ratis.OzoneManagerDoubleBuffer.lambda$flushTransactions$1(OzoneManagerDoubleBuffer.java:254)
> 	at java.util.Iterator.forEachRemaining(Iterator.java:116)
> 	at org.apache.hadoop.ozone.om.ratis.OzoneManagerDoubleBuffer.flushTransactions(OzoneManagerDoubleBuffer.java:250)
> 	at java.lang.Thread.run(Thread.java:748)
> 2020-07-20 16:28:56,426 INFO  om.OzoneManagerStarter (StringUtils.java:lambda$startupShutdownMessage$0(124)) - SHUTDOWN_MSG: 
> /************************************************************
> SHUTDOWN_MSG: Shutting down OzoneManager at BAOLOONGMAO-MB0/10.78.32.49
> ************************************************************/



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org