You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "László Bodor (Jira)" <ji...@apache.org> on 2022/04/29 06:05:00 UTC
[jira] [Commented] (HIVE-26182) Some improvements to make DPP more debuggable
[ https://issues.apache.org/jira/browse/HIVE-26182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529797#comment-17529797 ]
László Bodor commented on HIVE-26182:
-------------------------------------
the initial patch contains changes for logging:
{code}
2022-04-28T22:54:38,676 INFO [App Shared Pool - #9] tez.DynamicPartitionPruner: Waiting for events (2 sources) ...
2022-04-28T22:54:46,101 INFO [App Shared Pool - #9] tez.DynamicPartitionPruner: Input event (Map 3 -> Map 1 web_returns), event payload size: 657463
2022-04-28T22:54:46,125 INFO [State Change Notifier DAG: dag_1651211576832_0001_2] tez.DynamicPartitionPruner: Vertex succeeded: Map 3
2022-04-28T22:54:46,125 INFO [State Change Notifier DAG: dag_1651211576832_0001_2] tez.DynamicPartitionPruner: Waiting for 1 sources.
2022-04-28T22:54:46,190 INFO [App Shared Pool - #9] tez.DynamicPartitionPruner: Received 73049 partitions (source: Map 3)
2022-04-28T22:54:46,610 INFO [App Shared Pool - #9] tez.DynamicPartitionPruner: Input event (Map 4 -> Map 1 web_returns), event payload size: 211
2022-04-28T22:54:46,611 INFO [App Shared Pool - #9] tez.DynamicPartitionPruner: Received 21 partitions (source: Map 4)
2022-04-28T22:54:46,613 INFO [State Change Notifier DAG: dag_1651211576832_0001_2] tez.DynamicPartitionPruner: Vertex succeeded: Map 4
2022-04-28T22:54:46,613 INFO [App Shared Pool - #9] tez.DynamicPartitionPruner: Received events: 2
2022-04-28T22:54:46,615 INFO [App Shared Pool - #9] tez.DynamicPartitionPruner: Expecting 1 events for vertex Map 3, for column wr_returned_date_sk
2022-04-28T22:54:46,644 INFO [App Shared Pool - #9] tez.DynamicPartitionPruner: Expecting 1 events for vertex Map 4, for column wr_returned_date_sk
2022-04-28T22:54:46,782 INFO [App Shared Pool - #9] tez.DynamicPartitionPruner: Ok to proceed.
{code}
> Some improvements to make DPP more debuggable
> ---------------------------------------------
>
> Key: HIVE-26182
> URL: https://issues.apache.org/jira/browse/HIVE-26182
> Project: Hive
> Issue Type: Improvement
> Reporter: László Bodor
> Assignee: László Bodor
> Priority: Major
>
> details to be written here later
--
This message was sent by Atlassian Jira
(v8.20.7#820007)