You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Subhajit Sinha (Jira)" <ji...@apache.org> on 2019/11/22 07:49:00 UTC
[jira] [Created] (HIVE-22528) Bloom Filter not showing up in
Explain plan
Subhajit Sinha created HIVE-22528:
-------------------------------------
Summary: Bloom Filter not showing up in Explain plan
Key: HIVE-22528
URL: https://issues.apache.org/jira/browse/HIVE-22528
Project: Hive
Issue Type: Bug
Components: Hive
Affects Versions: 3.1.0
Environment: Test Environment.
Reporter: Subhajit Sinha
Hi Team,
We are using Hive version (Apache Hive (version 3.1.0.3.1.0.0-78) and trying to implement Bloom filter in it. So basically I have created a managed table with table properties defined as:
'orc.bloom.filter.columns'='*******', 'orc.bloom.filter.fpp'='0.05', 'orc.stripe.size'='268435456',
and stored it as orc file. While checking the explain plan(running: explain select count(1) from the_table where <condition>) in the current Hive version, I couldn't see anything as "Bloom_Filter" in the Plan provided by the CBO. The table I'm querying data in has records.
I have a few doubts:
# Is Hive 3.1 version not using Bloom filter? If so, I have queried a normal table with same query and condition have seen that it takes more time compared to a table having Bloom filter defined on the column that has condition.
# Is there any parameter that needs to be set to get the value/ Bloom filter in the table?
# I have come across three parameters, please let me know what does these signify :
h5. hive.tez.max.bloom.filter.entries,hive.tez.min.bloom.filter.entries,hive.tez.bloom.filter.factor
Please let me know if anyone has used Bloom filter. Let me know then the process
--
This message was sent by Atlassian Jira
(v8.3.4#803005)