[jira] [Commented] (HIVE-18378) Explain plan should show if a Map/Reduce Work is being cached

["Sahil Takiar (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-18378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16312093#comment-16312093 ] 

Sahil Takiar commented on HIVE-18378:
-------------------------------------

The {{CombineEquivalentWorkResolver}} should also print something in the log everytime it decides to combine two work objets. Right now it doesn't print anything at the INFO level.

> Explain plan should show if a Map/Reduce Work is being cached
> -------------------------------------------------------------
>
>                 Key: HIVE-18378
>                 URL: https://issues.apache.org/jira/browse/HIVE-18378
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>            Reporter: Sahil Takiar
>
> It would be nice if the explain plan showed what {{MapWork}} / {{ReduceWork}} objects are being cached by Spark.
> The {{CombineEquivalentWorkResolver}} is the only code that triggers Spark cache-ing, so we should be able to modify it so that it displays if a work object will be cached or not.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)