You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Tim Armstrong (JIRA)" <ji...@apache.org> on 2019/08/08 20:28:00 UTC
[jira] [Commented] (IMPALA-8849) IllegalStateException in
HashJoinNode because of missing memory estimate
[ https://issues.apache.org/jira/browse/IMPALA-8849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16903290#comment-16903290 ]
Tim Armstrong commented on IMPALA-8849:
---------------------------------------
Looks like HdfsScanNode can produce a negative row size estimate, which would explain the negative memory estimate.
{noformat}
I0808 20:25:37.342036 110162 DistributedPlanner.java:498] 114bef3456667eb2:458377fe00000000] 36:SCAN HDFS [tpcds.customer
, RANDOM]
HDFS partitions=1/1 files=1 size=12.50MB
stored statistics:
table: rows=100.00K size=12.50MB
columns: all
extrapolated-rows=disabled max-scan-range-rows=100.00K
mem-estimate=invalid mem-reservation=invalid thread-reservation=invalid
tuple-ids=78 row-size=-3B cardinality=100.00K
in pipelines: <not computed>
{noformat}
> IllegalStateException in HashJoinNode because of missing memory estimate
> ------------------------------------------------------------------------
>
> Key: IMPALA-8849
> URL: https://issues.apache.org/jira/browse/IMPALA-8849
> Project: IMPALA
> Issue Type: Bug
> Components: Frontend
> Affects Versions: Impala 3.3.0
> Reporter: Tim Armstrong
> Assignee: Tim Armstrong
> Priority: Blocker
> Attachments: query4.sql
>
>
> [~grahn] reports the below error when running the attached TPC-DS query on uncompressed text with stats.
> {noformat}
> I0808 03:27:16.621085 150090 jni-util.cc:288] 8945e9f76f33dca0:8bf31c4700000000] java.lang.IllegalStateException: Mem estimate must be set
> at com.google.common.base.Preconditions.checkState(Preconditions.java:149)
> at org.apache.impala.planner.ResourceProfileBuilder.build(ResourceProfileBuilder.java:73)
> at org.apache.impala.planner.HashJoinNode.computeNodeResourceProfile(HashJoinNode.java:252)
> at org.apache.impala.planner.PlanFragment.computeResourceProfile(PlanFragment.java:238)
> at org.apache.impala.planner.Planner.computeResourceReqs(Planner.java:416)
> at org.apache.impala.service.Frontend.createExecRequest(Frontend.java:1162)
> at org.apache.impala.service.Frontend.getPlannedExecRequest(Frontend.java:1477)
> at org.apache.impala.service.Frontend.doCreateExecRequest(Frontend.java:1341)
> at org.apache.impala.service.Frontend.getTExecRequest(Frontend.java:1236)
> at org.apache.impala.service.Frontend.createExecRequest(Frontend.java:1206)
> at org.apache.impala.service.JniFrontend.createExecRequest(JniFrontend.java:154)
> I0808 03:27:16.621861 150090 status.cc:124] 8945e9f76f33dca0:8bf31c4700000000] IllegalStateException: Mem estimate must be set
> @ 0xb9af99
> @ 0x11f785e
> @ 0x10ab9a3
> @ 0x10d0f54
> @ 0x10e2a2c
> @ 0x1125f8d
> @ 0x1458c54
> @ 0x145810c
> @ 0xb68769
> @ 0xf91ca0
> @ 0xf8791e
> @ 0xf887b1
> @ 0x127cd2f
> @ 0x127d8d9
> @ 0x1ac0709
> @ 0x7f11ea4d7dd4
> @ 0x7f11e6f1e02c
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org