[jira] [Created] (HIVE-19008) Improve Spark session id logging

["Sahil Takiar (JIRA)" <ji...@apache.org>]

Sahil Takiar created HIVE-19008:
-----------------------------------

             Summary: Improve Spark session id logging
                 Key: HIVE-19008
                 URL: https://issues.apache.org/jira/browse/HIVE-19008
             Project: Hive
          Issue Type: Sub-task
          Components: Spark
            Reporter: Sahil Takiar


HoS users have two session ids, one id for the Hive session and another id for the Spark session, both are UUIDs.

I think some improvements could be made here:

The Spark session id could just be a counter that is incremented for each new Spark session within a Hive session. Each Spark session is still globally identifiable by its associated Hive session id + its own counter. This may make more sense since the Hive session - Spark session has a 1-to-many relationship, as in a single Hive session can contain multiple Spark sessions, and each Spark session must belong to a Hive session.

Furthermore, we should include both the Hive session id and Spark session id in the console logs + the Spark Web UI.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)