You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Aswathy Chellammal Sreekumar (JIRA)" <ji...@apache.org> on 2018/02/08 19:43:00 UTC
[jira] [Resolved] (HIVE-18656) Trigger with counter TOTAL_TASKS
fails to result in an event even when condition is met
[ https://issues.apache.org/jira/browse/HIVE-18656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aswathy Chellammal Sreekumar resolved HIVE-18656.
-------------------------------------------------
Resolution: Invalid
Design for the counter to separate the counters at vertex level and dag level
> Trigger with counter TOTAL_TASKS fails to result in an event even when condition is met
> ---------------------------------------------------------------------------------------
>
> Key: HIVE-18656
> URL: https://issues.apache.org/jira/browse/HIVE-18656
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Affects Versions: 3.0.0
> Environment: Trigger involving counter TOTAL_TASKS seems to fail to trigger event in definition even when the trigger condition is met
> Trigger definition:
> {noformat}
> +----------------------------------------------------+
> | line |
> +----------------------------------------------------+
> | plan_1[status=ACTIVE,parallelism=null,defaultPool=default] |
> | + default[allocFraction=1.0,schedulingPolicy=null,parallelism=4] |
> | | mapped for default |
> | + <unmanaged queries> |
> | | trigger limit_task_per_vertex_trigger: if (TOTAL_TASKS > 5) { KILL } |
> +----------------------------------------------------+
> {noformat}
> Query is finishing fine even when one vertex is having 29 tasks
> {noformat}
> INFO : Query ID = hive_20180208193705_73642730-2c6b-4d4d-a608-a849b147bc37
> INFO : Total jobs = 1
> INFO : Launching Job 1 out of 1
> INFO : Starting task [Stage-1:MAPRED] in serial mode
> INFO : Subscribed to counters: [TOTAL_TASKS] for queryId: hive_20180208193705_73642730-2c6b-4d4d-a608-a849b147bc37
> INFO : Tez session hasn't been created yet. Opening session
> INFO : Dag name: with ssales as
> (select c_last_name...ssales) (Stage-1)
> INFO : Setting tez.task.scale.memory.reserve-fraction to 0.30000001192092896
> INFO : Setting tez.task.scale.memory.reserve-fraction to 0.30000001192092896
> INFO : Setting tez.task.scale.memory.reserve-fraction to 0.30000001192092896
> INFO : Setting tez.task.scale.memory.reserve-fraction to 0.30000001192092896
> INFO : Status: Running (Executing on YARN cluster with App id application_1517866662410_0199)
> ----------------------------------------------------------------------------------------------
> VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED
> ----------------------------------------------------------------------------------------------
> Map 6 .......... container SUCCEEDED 1 1 0 0 0 0
> Map 8 .......... container SUCCEEDED 1 1 0 0 0 0
> Map 7 .......... container SUCCEEDED 1 1 0 0 0 0
> Map 9 .......... container SUCCEEDED 1 1 0 0 0 0
> Map 10 ......... container SUCCEEDED 3 3 0 0 0 0
> Map 11 ......... container SUCCEEDED 1 1 0 0 0 0
> Map 12 ......... container SUCCEEDED 1 1 0 0 0 0
> Map 13 ......... container SUCCEEDED 3 3 0 0 0 0
> Map 1 .......... container SUCCEEDED 9 9 0 0 0 0
> Reducer 2 ...... container SUCCEEDED 2 2 0 0 0 0
> Reducer 4 ...... container SUCCEEDED 29 29 0 0 0 0
> Reducer 5 ...... container SUCCEEDED 1 1 0 0 0 0
> Reducer 3 container SUCCEEDED 0 0 0 0 0 0
> ----------------------------------------------------------------------------------------------
> VERTICES: 12/13 [==========================>>] 100% ELAPSED TIME: 21.15 s
> ----------------------------------------------------------------------------------------------
> INFO : Status: DAG finished successfully in 21.07 seconds
> {noformat}
> Reporter: Aswathy Chellammal Sreekumar
> Assignee: Prasanth Jayachandran
> Priority: Major
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)