You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2021/02/05 08:56:02 UTC

[jira] [Commented] (IMPALA-10459) Remove workaround codes for MAPREDUCE-6441

    [ https://issues.apache.org/jira/browse/IMPALA-10459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17279477#comment-17279477 ] 

ASF subversion and git services commented on IMPALA-10459:
----------------------------------------------------------

Commit e71ea69bb8e80efc5559309195c3b62b06015530 in impala's branch refs/heads/master from stiga-huang
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=e71ea69 ]

IMPALA-10459: Remove workarounds for MAPREDUCE-6441

MAPREDUCE-6441 is resolved and is in our toolchain. This patch removes
workarounds for it.

Tests:
 - Ran exhaustive test.

Change-Id: I5c4d482a6d15cdc08e9cf8878e130399665a8ee0
Reviewed-on: http://gerrit.cloudera.org:8080/17011
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>


> Remove workaround codes for MAPREDUCE-6441
> ------------------------------------------
>
>                 Key: IMPALA-10459
>                 URL: https://issues.apache.org/jira/browse/IMPALA-10459
>             Project: IMPALA
>          Issue Type: Task
>            Reporter: Quanlong Huang
>            Assignee: Quanlong Huang
>            Priority: Major
>
> MAPREDUCE-6441 is resolved and is in our minicluster's version now. We can remove the workaround codes due to it:
> {code:java}
> $ git grep -n -C 2 'MAPREDUCE-6441'
> bin/load-data.py-158-  # running MR jobs locally), we move the temporary directory into a unique
> bin/load-data.py-159-  # directory via configuration. This block can be removed when
> bin/load-data.py:160:  # https://issues.apache.org/jira/browse/MAPREDUCE-6441 is resolved.
> bin/load-data.py-161-  hive_args = HIVE_ARGS
> bin/load-data.py-162-  unique_dir = None
> --
> fe/src/test/java/org/apache/impala/catalog/events/EventsProcessorStressTest.java-190-  }
> fe/src/test/java/org/apache/impala/catalog/events/EventsProcessorStressTest.java-191-
> fe/src/test/java/org/apache/impala/catalog/events/EventsProcessorStressTest.java:192:  @Ignore("Ignored until MAPREDUCE-6441 is available in the toolchain")
> fe/src/test/java/org/apache/impala/catalog/events/EventsProcessorStressTest.java-193-  @Test
> fe/src/test/java/org/apache/impala/catalog/events/EventsProcessorStressTest.java-194-  public void testUsingRandomHiveQueries() throws Exception {
> --
> fe/src/test/java/org/apache/impala/util/RandomHiveQueryRunner.java-78-
> fe/src/test/java/org/apache/impala/util/RandomHiveQueryRunner.java-79-  // we need to add small delay between the start of each query to work-around
> fe/src/test/java/org/apache/impala/util/RandomHiveQueryRunner.java:80:  // MAPREDUCE-6441
> fe/src/test/java/org/apache/impala/util/RandomHiveQueryRunner.java-81-  private final Object delayLock_ = new Object();
> fe/src/test/java/org/apache/impala/util/RandomHiveQueryRunner.java-82-  /**
> --
> fe/src/test/java/org/apache/impala/util/RandomHiveQueryRunner.java-1105-            LOG.info("Client {} running hive query set {}: {}", clientId, queryNumber,
> fe/src/test/java/org/apache/impala/util/RandomHiveQueryRunner.java-1106-                query);
> fe/src/test/java/org/apache/impala/util/RandomHiveQueryRunner.java:1107:            // add a delay between the start of each query to work around MAPREDUCE-6441
> fe/src/test/java/org/apache/impala/util/RandomHiveQueryRunner.java-1108-            synchronized (delayLock_) {
> fe/src/test/java/org/apache/impala/util/RandomHiveQueryRunner.java-1109-              Thread.sleep(10);
> --
> tests/common/impala_test_suite.py-959-    # running MR jobs locally), we move the temporary directory into a unique
> tests/common/impala_test_suite.py-960-    # directory via configuration. This workaround can be removed when
> tests/common/impala_test_suite.py:961:    # https://issues.apache.org/jira/browse/MAPREDUCE-6441 is resolved.
> tests/common/impala_test_suite.py-962-    # A similar workaround is used in bin/load-data.py.
> tests/common/impala_test_suite.py-963-    tmpdir = None
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org