You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hive.apache.org by "Denys Kuzmenko (Jira)" <ji...@apache.org> on 2025/08/06 20:20:00 UTC

[jira] [Resolved] (HIVE-29037) Negative elapsed time logging in HiveSplitGenerator

     [ https://issues.apache.org/jira/browse/HIVE-29037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Denys Kuzmenko resolved HIVE-29037.
-----------------------------------
    Fix Version/s: 4.2.0
       Resolution: Fixed

> Negative elapsed time logging in HiveSplitGenerator
> ---------------------------------------------------
>
>                 Key: HIVE-29037
>                 URL: https://issues.apache.org/jira/browse/HIVE-29037
>             Project: Hive
>          Issue Type: Bug
>          Components: Hive
>            Reporter: chiranjeevi
>            Assignee: Raghav Aggarwal
>            Priority: Minor
>              Labels: pull-request-available
>             Fix For: 4.2.0
>
>
> The HiveSplitGenerator class incorrectly calculates elapsed time for split serialization operations, resulting in negative time values in the logs. This makes debugging and performance analysis difficult.
> The calculation fileWriteStarted - Time.monotonicNow() is reversed. Since Time.monotonicNow() returns the current time, which is always greater than fileWriteStarted (the time when the operation started), this calculation always produces a negative number.
> Example log 
> 2025-06-21 16:43:28,637 [DEBUG] [HiveSplitGenerator.SplitSerializer Thread - #2|#2] |tez.HiveSplitGenerator|: Split #41 event to output path: hdfs://clustername/tmp/hive/staging/.tez/application_1749793988888_0095/events/hive_20250621164323_c39588f6-0ae9-48ad-8db5-5e43cf4a1b1d/0_catalog_sales_InputDataInformationEvent_41 written in *-320 ms*



--
This message was sent by Atlassian Jira
(v8.20.10#820010)