You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "bharath v (JIRA)" <ji...@apache.org> on 2019/03/08 21:44:00 UTC
[jira] [Commented] (IMPALA-6234) COMPUTE INCREMENTAL STATS with
partition specs fails if no partition found
[ https://issues.apache.org/jira/browse/IMPALA-6234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16788330#comment-16788330 ]
bharath v commented on IMPALA-6234:
-----------------------------------
I'm not able to repro this either. This is on the master.
{noformat}
[0d66cd6004b4:21000] default> show partitions functional.alltypes;
Query: show partitions functional.alltypes
+-------+-------+-------+--------+----------+--------------+-------------------+--------+-------------------+-------------------------------------------------------------------+
| year | month | #Rows | #Files | Size | Bytes Cached | Cache Replication | Format | Incremental stats | Location |
+-------+-------+-------+--------+----------+--------------+-------------------+--------+-------------------+-------------------------------------------------------------------+
| 2009 | 1 | 310 | 1 | 19.95KB | NOT CACHED | NOT CACHED | TEXT | false | hdfs://localhost:20500/test-warehouse/alltypes/year=2009/month=1 |
| 2009 | 2 | 280 | 1 | 18.12KB | NOT CACHED | NOT CACHED | TEXT | false | hdfs://localhost:20500/test-warehouse/alltypes/year=2009/month=2 |
| 2009 | 3 | 310 | 1 | 20.06KB | NOT CACHED | NOT CACHED | TEXT | false | hdfs://localhost:20500/test-warehouse/alltypes/year=2009/month=3 |
| 2009 | 4 | 300 | 1 | 19.61KB | NOT CACHED | NOT CACHED | TEXT | false | hdfs://localhost:20500/test-warehouse/alltypes/year=2009/month=4 |
| 2009 | 5 | 310 | 1 | 20.36KB | NOT CACHED | NOT CACHED | TEXT | false | hdfs://localhost:20500/test-warehouse/alltypes/year=2009/month=5 |
| 2009 | 6 | 300 | 1 | 19.71KB | NOT CACHED | NOT CACHED | TEXT | false | hdfs://localhost:20500/test-warehouse/alltypes/year=2009/month=6 |
| 2009 | 7 | 310 | 1 | 20.36KB | NOT CACHED | NOT CACHED | TEXT | false | hdfs://localhost:20500/test-warehouse/alltypes/year=2009/month=7 |
| 2009 | 8 | 310 | 1 | 20.36KB | NOT CACHED | NOT CACHED | TEXT | false | hdfs://localhost:20500/test-warehouse/alltypes/year=2009/month=8 |
| 2009 | 9 | 300 | 1 | 19.71KB | NOT CACHED | NOT CACHED | TEXT | false | hdfs://localhost:20500/test-warehouse/alltypes/year=2009/month=9 |
| 2009 | 10 | 310 | 1 | 20.36KB | NOT CACHED | NOT CACHED | TEXT | false | hdfs://localhost:20500/test-warehouse/alltypes/year=2009/month=10 |
| 2009 | 11 | 300 | 1 | 19.71KB | NOT CACHED | NOT CACHED | TEXT | false | hdfs://localhost:20500/test-warehouse/alltypes/year=2009/month=11 |
| 2009 | 12 | 310 | 1 | 20.36KB | NOT CACHED | NOT CACHED | TEXT | false | hdfs://localhost:20500/test-warehouse/alltypes/year=2009/month=12 |
| 2010 | 1 | 310 | 1 | 20.36KB | NOT CACHED | NOT CACHED | TEXT | false | hdfs://localhost:20500/test-warehouse/alltypes/year=2010/month=1 |
| 2010 | 2 | 280 | 1 | 18.39KB | NOT CACHED | NOT CACHED | TEXT | false | hdfs://localhost:20500/test-warehouse/alltypes/year=2010/month=2 |
| 2010 | 3 | 310 | 1 | 20.36KB | NOT CACHED | NOT CACHED | TEXT | false | hdfs://localhost:20500/test-warehouse/alltypes/year=2010/month=3 |
| 2010 | 4 | 300 | 1 | 19.71KB | NOT CACHED | NOT CACHED | TEXT | false | hdfs://localhost:20500/test-warehouse/alltypes/year=2010/month=4 |
| 2010 | 5 | 310 | 1 | 20.36KB | NOT CACHED | NOT CACHED | TEXT | false | hdfs://localhost:20500/test-warehouse/alltypes/year=2010/month=5 |
| 2010 | 6 | 300 | 1 | 19.71KB | NOT CACHED | NOT CACHED | TEXT | false | hdfs://localhost:20500/test-warehouse/alltypes/year=2010/month=6 |
| 2010 | 7 | 310 | 1 | 20.36KB | NOT CACHED | NOT CACHED | TEXT | false | hdfs://localhost:20500/test-warehouse/alltypes/year=2010/month=7 |
| 2010 | 8 | 310 | 1 | 20.36KB | NOT CACHED | NOT CACHED | TEXT | false | hdfs://localhost:20500/test-warehouse/alltypes/year=2010/month=8 |
| 2010 | 9 | 300 | 1 | 19.71KB | NOT CACHED | NOT CACHED | TEXT | false | hdfs://localhost:20500/test-warehouse/alltypes/year=2010/month=9 |
| 2010 | 10 | 310 | 1 | 20.36KB | NOT CACHED | NOT CACHED | TEXT | false | hdfs://localhost:20500/test-warehouse/alltypes/year=2010/month=10 |
| 2010 | 11 | 300 | 1 | 19.71KB | NOT CACHED | NOT CACHED | TEXT | false | hdfs://localhost:20500/test-warehouse/alltypes/year=2010/month=11 |
| 2010 | 12 | 310 | 1 | 20.36KB | NOT CACHED | NOT CACHED | TEXT | false | hdfs://localhost:20500/test-warehouse/alltypes/year=2010/month=12 |
| Total | | 7300 | 24 | 478.45KB | 0B | | | | |
+-------+-------+-------+--------+----------+--------------+-------------------+--------+-------------------+-------------------------------------------------------------------+
Fetched 25 row(s) in 5.27s
[0d66cd6004b4:21000] default> compute incremental stats functional.alltypes partition(year=2000, month=2);
Query: compute incremental stats functional.alltypes partition(year=2000, month=2)
ERROR: AnalysisException: No matching partition(s) found.
[0d66cd6004b4:21000] default>
{noformat}
> COMPUTE INCREMENTAL STATS with partition specs fails if no partition found
> --------------------------------------------------------------------------
>
> Key: IMPALA-6234
> URL: https://issues.apache.org/jira/browse/IMPALA-6234
> Project: IMPALA
> Issue Type: Bug
> Components: Frontend
> Affects Versions: Impala 2.8.0, Impala 2.9.0, Impala 2.10.0
> Environment: Impala-Shell: v2.8.0-cdh5.11.1 (3382c1c)
> Linux 2.6.32-504.8.1.el6.x86_64 Centos 6
> Impala JDBC: 2.5.29
> Reporter: Antoni Ivanov
> Assignee: Yongzhi Chen
> Priority: Major
> Labels: newbie
>
> I noticed that if no partition matches the "query" the compute stats fails (and hangs it doesn't get clean up):
> E.g COMPUTE INCREMENTAL STATS `foo` PARTITION (partition_column != partition_column) - no partition would be matched
> returns the following error:
> AnalysisException: Syntax error in line 1:
> ...M history.astro_ui WHERE () GROUP BY pa__arrival_day, ...
> ^
> Encountered: )
> Expected: CASE, CAST, DEFAULT, EXISTS, FALSE, IF, INTERVAL, NOT, NULL, REPLACE, SELECT, TRUNCATE, TRUE, VALUES, WITH, IDENTIFIER
> CAUSED BY: Exception: Syntax error
> Also when using JDBC Impala Driver the query hangs until the connection is closed (and not just the statement) We are using Impala JBDC version 2.5.29. The query is in state "waiting to be closed" (as seen in Impala Deamon Web UI)
> Note that this behaviour happens only for COMPUTE INCREMENTAL STATS and not for DROP INCREMENTAL STATS. DROP finishes successfully with no issues.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org