You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Jesus Camacho Rodriguez (JIRA)" <ji...@apache.org> on 2016/05/31 19:00:14 UTC
[jira] [Updated] (HIVE-13871) Tez exec summary does not get the
HIVE counters right
[ https://issues.apache.org/jira/browse/HIVE-13871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jesus Camacho Rodriguez updated HIVE-13871:
-------------------------------------------
Target Version/s: 2.2.0 (was: 2.1.0)
> Tez exec summary does not get the HIVE counters right
> -----------------------------------------------------
>
> Key: HIVE-13871
> URL: https://issues.apache.org/jira/browse/HIVE-13871
> Project: Hive
> Issue Type: Bug
> Components: llap, Tez
> Affects Versions: 2.1.0
> Reporter: Gopal V
>
> {code}
> 2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) - HIVE:
> 2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) - CREATED_FILES: 1
> 2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) - DESERIALIZE_ERRORS: 0
> 2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) - RECORDS_IN_Map_1: 0
> 2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) - RECORDS_IN_Map_4: 0
> 2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) - RECORDS_IN_Map_5: 0
> 2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) - RECORDS_IN_Map_6: 0
> 2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) - RECORDS_IN_Map_7: 0
> 2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) - RECORDS_OUT_0: 10
> 2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) - RECORDS_OUT_INTERMEDIATE_Map_1: 418284
> 2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) - RECORDS_OUT_INTERMEDIATE_Map_4: 27440
> 2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) - RECORDS_OUT_INTERMEDIATE_Map_5: 365
> 2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) - RECORDS_OUT_INTERMEDIATE_Map_6: 101
> 2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) - RECORDS_OUT_INTERMEDIATE_Map_7: 48000
> 2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) - RECORDS_OUT_INTERMEDIATE_Reducer_2: 10
> 2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) - Shuffle Errors:
> {code}
> However, the actual operator counters do indicate the total # of vectors.
> {code}
> 2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) - TaskCounter_Map_1_INPUT_Map_4:
> 2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) - FIRST_EVENT_RECEIVED: 1
> 2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) - INPUT_RECORDS_PROCESSED: 27440
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)