You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Hive QA (JIRA)" <ji...@apache.org> on 2017/02/01 12:47:51 UTC

[jira] [Commented] (HIVE-15779) LLAP: WaitQueue comparators should return 0 when tasks are of same priority

    [ https://issues.apache.org/jira/browse/HIVE-15779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15848333#comment-15848333 ] 

Hive QA commented on HIVE-15779:
--------------------------------



Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12850397/HIVE-15779.1.patch

{color:green}SUCCESS:{color} +1 due to 2 test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 10 failed/errored test(s), 11004 tests executed
*Failed tests:*
{noformat}
TestDerbyConnector - did not produce a TEST-*.xml file (likely timed out) (batchId=235)
TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=127)
	[smb_mapjoin_15.q,script_pipe.q,auto_join24.q,filter_join_breaktask.q,bucket4.q,ppd_multi_insert.q,skewjoinopt20.q,join_thrift.q,multi_insert_gby3.q,groupby8.q,join_map_ppr.q,auto_sortmerge_join_8.q,escape_clusterby1.q,groupby_multi_insert_common_distinct.q,join6.q]
org.apache.hadoop.hive.cli.TestEncryptedHDFSCliDriver.testCliDriver[encryption_join_with_different_encryption_keys] (batchId=159)
org.apache.hadoop.hive.cli.TestPerfCliDriver.testCliDriver[query14] (batchId=223)
org.apache.hadoop.hive.llap.daemon.impl.TestTaskExecutorService.testWaitQueuePreemption (batchId=282)
org.apache.hadoop.hive.llap.daemon.impl.comparator.TestFirstInFirstOutComparator.testWaitQueueComparator (batchId=282)
org.apache.hadoop.hive.llap.daemon.impl.comparator.TestFirstInFirstOutComparator.testWaitQueueComparatorParallelism (batchId=282)
org.apache.hadoop.hive.llap.daemon.impl.comparator.TestShortestJobFirstComparator.testWaitQueueComparator (batchId=282)
org.apache.hadoop.hive.llap.daemon.impl.comparator.TestShortestJobFirstComparator.testWaitQueueComparatorAging (batchId=282)
org.apache.hadoop.hive.llap.daemon.impl.comparator.TestShortestJobFirstComparator.testWaitQueueComparatorParallelism (batchId=282)
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/3303/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/3303/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-3303/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 10 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12850397 - PreCommit-HIVE-Build

> LLAP: WaitQueue comparators should return 0 when tasks are of same priority
> ---------------------------------------------------------------------------
>
>                 Key: HIVE-15779
>                 URL: https://issues.apache.org/jira/browse/HIVE-15779
>             Project: Hive
>          Issue Type: Bug
>          Components: llap
>            Reporter: Rajesh Balamohan
>         Attachments: HIVE-15779.1.patch
>
>
> Observed cases, where in tasks within same vertex were competing with each and getting killed
> {noformat}
> [IPC Server handler 3 on 44598 (1484282558103_4855_1_00_003877_7)] impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003179_7 evicted from wait queue in favor of attempt_1484282558103_4855_1_00_003877_7 because of lower priority
> [IPC Server handler 1 on 44598 (1484282558103_4855_1_00_002959_7)] impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003832_7 evicted from wait queue in favor of attempt_1484282558103_4855_1_00_002959_7 because of lower priority
> [IPC Server handler 0 on 44598 (1484282558103_4855_1_00_003723_7)] impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003254_7 evicted from wait queue in favor of attempt_1484282558103_4855_1_00_003723_7 because of lower priority
> [IPC Server handler 4 on 44598 (1484282558103_4855_1_00_003560_7)] impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003076_7 evicted from wait queue in favor of attempt_1484282558103_4855_1_00_003560_7 because of lower priority
> [IPC Server handler 2 on 44598 (1484282558103_4855_1_00_003775_7)] impl.TaskExecutorService: attempt_1484282558103_4855_1_00_004011_7 evicted from wait queue in favor of attempt_1484282558103_4855_1_00_003775_7 because of lower priority
> [IPC Server handler 3 on 44598 (1484282558103_4855_1_00_003842_7)] impl.TaskExecutorService: attempt_1484282558103_4855_1_00_004045_7 evicted from wait queue in favor of attempt_1484282558103_4855_1_00_003842_7 because of lower priority
> [IPC Server handler 1 on 44598 (1484282558103_4855_1_00_003953_7)] impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003915_7 evicted from wait queue in favor of attempt_1484282558103_4855_1_00_003953_7 because of lower priority
> [IPC Server handler 0 on 44598 (1484282558103_4855_1_00_003819_7)] impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003919_7 evicted from wait queue in favor of attempt_1484282558103_4855_1_00_003819_7 because of lower priority
> [IPC Server handler 4 on 44598 (1484282558103_4855_1_00_002074_8)] impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003790_7 evicted from wait queue in favor of attempt_1484282558103_4855_1_00_002074_8 because of lower priority
> [IPC Server handler 2 on 44598 (1484282558103_4855_1_00_003670_7)] impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003736_7 evicted from wait queue in favor of attempt_1484282558103_4855_1_00_003670_7 because of lower priority
> [IPC Server handler 1 on 44598 (1484282558103_4855_1_00_003153_8)] impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003877_7 evicted from wait queue in favor of attempt_1484282558103_4855_1_00_003153_8 because of lower priority
> [IPC Server handler 0 on 44598 (1484282558103_4855_1_00_003328_7)] impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003775_7 evicted from wait queue in favor of attempt_1484282558103_4855_1_00_003328_7 because of lower priority
> [IPC Server handler 4 on 44598 (1484282558103_4855_1_00_003817_7)] impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003842_7 evicted from wait queue in favor of attempt_1484282558103_4855_1_00_003817_7 because of lower priority
> [IPC Server handler 2 on 44598 (1484282558103_4855_1_00_004065_7)] impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003723_7 evicted from wait queue in favor of attempt_1484282558103_4855_1_00_004065_7 because of lower priority
> [IPC Server handler 3 on 44598 (1484282558103_4855_1_00_003902_7)] impl.TaskExecutorService: attempt_1484282558103_4855_1_00_003560_7 evicted from wait queue in favor of attempt_1484282558103_4855_1_00_003902_7 because of lower priority
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)