You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Tim Armstrong (JIRA)" <ji...@apache.org> on 2018/10/02 00:57:00 UTC
[jira] [Updated] (IMPALA-7220) Queries processing very large
strings hit "memory limit exceeded" instead of spilling
[ https://issues.apache.org/jira/browse/IMPALA-7220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tim Armstrong updated IMPALA-7220:
----------------------------------
Issue Type: Improvement (was: Bug)
> Queries processing very large strings hit "memory limit exceeded" instead of spilling
> -------------------------------------------------------------------------------------
>
> Key: IMPALA-7220
> URL: https://issues.apache.org/jira/browse/IMPALA-7220
> Project: IMPALA
> Issue Type: Improvement
> Environment: m4.4xl, ubuntu 16.04
> Reporter: Jim Apple
> Priority: Major
> Labels: resource-management
>
> I saw {{primitive_shuffle_1mb_rows}} failing at scale factor 4 with 3 impalads running:
> {noformat}
> [scheduler] [tpch4_parquet Thread 0]: Running Query: primitive_shuffle_1mb_rows
> [query_exec_functions] [tpch4_parquet Thread 0]: Connected to localhost:21001
> [query_exec_functions] [tpch4_parquet Thread 0]: Connected to localhost:21001
> [query_exec_functions] [tpch4_parquet Thread 0]: ImpalaBeeswaxException:
> Query aborted:Memory limit exceeded: Error occurred on backend ip-172-31-25-187:22001 by fragment cd4f016604f24316:c310bea60000000f
> Memory left in process limit: -410.47 MB
> {noformat}
> Command run was
> {noformat}
> ./bin/single_node_perf_run.py --iterations 2 --scale 4 --table_formats parquet/none --workload targeted-perf --num_impalads 3 --query_names '.*' --load --start_minicluster $HASH1 $HASH2
> {noformat}
> https://jenkins.impala.io/view/Experimental/job/perf-AB-test/182/consoleText
> cc: [~janulatha]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org