[jira] [Updated] (HUDI-2718) ExternalSpillableMap throws ArithmeticException when estimating the size of the payload

["Danny Chen (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HUDI-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Danny Chen updated HUDI-2718:
-----------------------------
    Fix Version/s: 0.11.0
                       (was: 0.10.0)

> ExternalSpillableMap throws ArithmeticException when estimating the size of the payload
> ---------------------------------------------------------------------------------------
>
>                 Key: HUDI-2718
>                 URL: https://issues.apache.org/jira/browse/HUDI-2718
>             Project: Apache Hudi
>          Issue Type: Bug
>            Reporter: Manoj Govindassamy
>            Assignee: Manoj Govindassamy
>            Priority: Blocker
>              Labels: pull-request-available
>             Fix For: 0.11.0
>
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>
> When estimating the size of the payload, ExternalSpillableMap uses the current in-memory map size, which could be zero and leading to Divide by Zero error which in turn throws the ArithmeticException and crashing the callers.
> {noformat}
> long totalMapSize = ObjectSizeCalculator.getObjectSize(inMemoryMap);
> this.currentInMemoryMapSize = totalMapSize;
> this.estimatedPayloadSize = totalMapSize / inMemoryMap.size();
> shouldEstimatePayloadSize = false;
> LOG.info("New Estimated Payload size => " + this.estimatedPayloadSize);{noformat}



--
This message was sent by Atlassian Jira
(v8.20.1#820001)