You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Riza Suminto (Jira)" <ji...@apache.org> on 2024/02/23 17:12:00 UTC
[jira] [Commented] (IMPALA-12840) test_reuse_partitions_transactional is flaky
[ https://issues.apache.org/jira/browse/IMPALA-12840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17820136#comment-17820136 ]
Riza Suminto commented on IMPALA-12840:
---------------------------------------
The test code access catalogd page with URL like this.
{code:java}
/catalog_object?json&object_type=TABLE&object_name=test_reuse_partitions_nontransactional_c9c4d5c9.tbl {code}
If an exception happen, the response can contain \n char like this:
{code:java}
{
"__common__": {
"process-name": "catalogd",
"navbar": [{
"link": "/",
"title": "/"
}, {
"link": "/catalog",
"title": "/catalog"
}, {
"link": "/events",
"title": "/events"
}, {
"link": "/hadoop-varz",
"title": "/hadoop-varz"
}, {
"link": "/jmx",
"title": "/jmx"
}, {
"link": "/log_level",
"title": "/log_level"
}, {
"link": "/logs",
"title": "/logs"
}, {
"link": "/memz",
"title": "/memz"
}, {
"link": "/metrics",
"title": "/metrics"
}, {
"link": "/operations",
"title": "/operations"
}, {
"link": "/profile_docs",
"title": "/profile_docs"
}, {
"link": "/rpcz",
"title": "/rpcz"
}, {
"link": "/threadz",
"title": "/threadz"
}, {
"link": "/varz",
"title": "/varz"
}]
},
"error": "DatabaseNotFoundException: Database 'test_reuse_partitions_nontransactional_c9c4d5c9' not found\n"
} {code}
Looks like some error handling should be done here:
[https://github.com/apache/impala/blob/49ffa3cc9a872bdf4e3cd5e620296ef76ab010d2/fe/src/main/java/org/apache/impala/service/JniCatalog.java#L413-L416]
> test_reuse_partitions_transactional is flaky
> --------------------------------------------
>
> Key: IMPALA-12840
> URL: https://issues.apache.org/jira/browse/IMPALA-12840
> Project: IMPALA
> Issue Type: Bug
> Reporter: Riza Suminto
> Priority: Major
> Labels: broken-build
>
> TestReusePartitions::test_reuse_partitions_transactional has been increasingly flaky both at upstream and downstream build. The most recent occurrence is at
> [https://jenkins.impala.io/job/ubuntu-20.04-dockerised-tests/1310/testReport/junit/metadata.test_reuse_partitions/TestReusePartitions/test_reuse_partitions_nontransactional/]
> {code:java}
> Error Message
> metadata/test_reuse_partitions.py:55: in test_reuse_partitions_nontransactional self.__test_reuse_partitions_helper(unique_database, transactional=False) metadata/test_reuse_partitions.py:83: in __test_reuse_partitions_helper new_part_ids = self.__get_partition_id_set(unique_database, tbl_name) metadata/test_reuse_partitions.py:47: in __get_partition_id_set catalog_obj = json.loads(json.loads(response.text)["json_string"]) ../toolchain/toolchain-packages-gcc10.4.0/python-2.7.16/lib/python2.7/json/__init__.py:339: in loads return _default_decoder.decode(s) ../toolchain/toolchain-packages-gcc10.4.0/python-2.7.16/lib/python2.7/json/decoder.py:364: in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) ../toolchain/toolchain-packages-gcc10.4.0/python-2.7.16/lib/python2.7/json/decoder.py:380: in raw_decode obj, end = self.scan_once(s, idx) E ValueError: Invalid control character at: line 1 column 1850 (char 1849)
> Stacktrace
> metadata/test_reuse_partitions.py:55: in test_reuse_partitions_nontransactional
> self.__test_reuse_partitions_helper(unique_database, transactional=False)
> metadata/test_reuse_partitions.py:83: in __test_reuse_partitions_helper
> new_part_ids = self.__get_partition_id_set(unique_database, tbl_name)
> metadata/test_reuse_partitions.py:47: in __get_partition_id_set
> catalog_obj = json.loads(json.loads(response.text)["json_string"])
> ../toolchain/toolchain-packages-gcc10.4.0/python-2.7.16/lib/python2.7/json/__init__.py:339: in loads
> return _default_decoder.decode(s)
> ../toolchain/toolchain-packages-gcc10.4.0/python-2.7.16/lib/python2.7/json/decoder.py:364: in decode
> obj, end = self.raw_decode(s, idx=_w(s, 0).end())
> ../toolchain/toolchain-packages-gcc10.4.0/python-2.7.16/lib/python2.7/json/decoder.py:380: in raw_decode
> obj, end = self.scan_once(s, idx)
> E ValueError: Invalid control character at: line 1 column 1850 (char 1849)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org