You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Michael Ho (JIRA)" <ji...@apache.org> on 2019/04/22 19:30:00 UTC
[jira] [Commented] (IMPALA-8124) Build failure:
webserver/test_web_pages.py
[ https://issues.apache.org/jira/browse/IMPALA-8124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16823371#comment-16823371 ]
Michael Ho commented on IMPALA-8124:
------------------------------------
Hit this again recently. I think the key here seems to be the following statement in the message above:
{noformat}
lltypesare not available because the table is currently modified by another operation.
{noformat}
Another instance shows the following:
{noformat}
<pre>Metrics for table functional.alltypesare not available because the table is currently modified by another operation.</pre>
{noformat}
In essence, the test is trying to load the table metrics via the debug webpage of the Catalogd but it can fail every now and then due to race with other concurrent meta-data operations such as refreshes or invalidate metadata
{noformat}
-- 2019-04-22 05:13:54,125 INFO MainThread: Started query 2d4f1c8298f3dcce:3c822bc000000000
-- 2019-04-22 05:13:54,260 INFO MainThread: Starting new HTTP connection (1): localhost
-- 2019-04-22 05:13:54,286 INFO MainThread: Starting new HTTP connection (1): localhost
-- executing against localhost:21000
refresh functional.alltypes;
-- 2019-04-22 05:13:54,448 INFO MainThread: Started query 3c42f862fc08e584:25c0cc3c00000000
-- 2019-04-22 05:13:54,456 INFO MainThread: Starting new HTTP connection (1): localhost
-- executing against localhost:21000
refresh functional.alltypes;
-- 2019-04-22 05:13:54,597 INFO MainThread: Started query 574e64579d27d8ab:67d684e700000000
-- 2019-04-22 05:13:54,604 INFO MainThread: Starting new HTTP connection (1): localhost
{noformat}
Anyhow, this seems to be a flaky test issue. Can some of the folks more familiar with metadata please take a look and see how the test can be fixed ? cc'ing [~bharathv], [~vihangk1]
> Build failure: webserver/test_web_pages.py
> ------------------------------------------
>
> Key: IMPALA-8124
> URL: https://issues.apache.org/jira/browse/IMPALA-8124
> Project: IMPALA
> Issue Type: Bug
> Components: Infrastructure
> Affects Versions: Impala 3.1.0, Impala 3.2.0
> Reporter: Paul Rogers
> Assignee: Lenisha Gandhi
> Priority: Major
> Labels: build-failure, flaky
> Fix For: Impala 3.3.0
>
>
> Build log output:
> {noformat}
> 04:20:18 =================================== FAILURES ===================================
> 04:20:18 ___________________________ TestWebPage.test_catalog ___________________________
> 04:20:18 [gw4] linux2 -- Python 2.7.5 /data/jenkins/workspace/impala-cdh6.x-core/repos/Impala/bin/../infra/python/env/bin/python
> 04:20:18 webserver/test_web_pages.py:265: in test_catalog
> 04:20:18 self.__test_table_metrics("functional", "alltypes", "total-file-size-bytes")
> 04:20:18 webserver/test_web_pages.py:283: in __test_table_metrics
> 04:20:18 "?name=%s.%s" % (db_name, tbl_name), metric, ports_to_test=self.CATALOG_TEST_PORT)
> 04:20:18 webserver/test_web_pages.py:144: in get_and_check_status
> 04:20:18 assert response.status_code == requests.codes.ok\
> 04:20:18 E AssertionError: Offending url: http://localhost:25020/table_metrics?name=functional.alltypes
> 04:20:18 E assert (200 == 200 and 'total-file-size-bytes' in '<!--\nLicensed to the Apache Software Foundation (ASF) under one\nor more contributor license agreements. See the NOTI...lltypesare not available because the table is currently modified by another operation.</pre>\n\n</div>\n</body>\n</html>\n\n')
> 04:20:18 E + where 200 = <Response [200]>.status_code
> 04:20:18 E + and 200 = <lookup 'status_codes'>.ok
> 04:20:18 E + where <lookup 'status_codes'> = requests.codes
> 04:20:18 E + and '<!--\nLicensed to the Apache Software Foundation (ASF) under one\nor more contributor license agreements. See the NOTI...lltypesare not available because the table is currently modified by another operation.</pre>\n\n</div>\n</body>\n</html>\n\n' = <Response [200]>.text
> {noformat}
> Hard to read, but apparently the test wants to perform two checks at once:
> {noformat}
> assert response.status_code == requests.codes.ok\
> and string_to_search in response.text, "Offending url: " + input_url
> {noformat}
> The return code part appears to match. So the question is whether the string "total-file-size-bytes" appears in the output.
> Tried building from latest master and hitting my local server with the same URL as above. The page reported:
> {noformat}
> num-partitions: 24
> total-file-size-bytes: 489934
> {noformat}
> So, the string match part should work.
> General observation: it is not helpful at all to include an and in an {{assert}} statement: doing so makes debugging very difficult. Please use one condition per {{assert}}.
> Net result is that there is no obvious failure here; someone will need to did into it more deeply.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org