You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user-zh@flink.apache.org by macia kk <pr...@gmail.com> on 2021/02/05 01:47:49 UTC

Flink SQL Hive 使用 partition.include 结果跟文档不一致

Flink 1.12.1

streaming-source.partition.includeOption to set the partitions to read, the
supported option are `all` and `latest`, the `all` means read all
partitions; the `latest` means read latest partition in order of
'streaming-source.partition.order', the `latest` only works` when the
streaming hive source table used as temporal table. By default the option
is `all`.


报错
Flink SQL> SELECT * FROM exrate_table /*+
OPTIONS('streaming-source.enable'='true','streaming-source.partition.include'
= 'latest') */; [ERROR] Could not execute SQL statement. Reason:
java.lang.IllegalArgumentException: The only supported
'streaming-source.partition.include' is 'all' in hive table scan, but is
'latest'

Re: Flink SQL Hive 使用 partition.include 结果跟文档不一致

Posted by Leonard Xu <xb...@gmail.com>.
Hi

> 在 2021年2月5日,09:47,macia kk <pr...@gmail.com> 写道:
> 
> the `latest` only works` when the
> streaming hive source table used as temporal table. 

只能用在temporal(时态)表中,时态表只能在 temporal join(也就是我们常说的维表join) 中使用

祝好