You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by "Kunal Kapoor (Jira)" <ji...@apache.org> on 2021/02/17 16:19:01 UTC
[jira] [Resolved] (CARBONDATA-4123) Bloom index query with Index
server giving incorrect results
[ https://issues.apache.org/jira/browse/CARBONDATA-4123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kunal Kapoor resolved CARBONDATA-4123.
--------------------------------------
Fix Version/s: 2.1.1
Resolution: Fixed
> Bloom index query with Index server giving incorrect results
> ------------------------------------------------------------
>
> Key: CARBONDATA-4123
> URL: https://issues.apache.org/jira/browse/CARBONDATA-4123
> Project: CarbonData
> Issue Type: Bug
> Reporter: SHREELEKHYA GAMPA
> Priority: Minor
> Fix For: 2.1.1
>
>
> Queries: create table and load data so that it can create >1 blocklet.
>
> spark-sql> select count(*) from test_rcd where city = 'city40';
> 2021-02-04 22:13:29,759 | WARN | pool-24-thread-1 | It is not recommended to set off-heap working memory size less than 512MB, so setting default value to 512 | org.apache.carbondata.core.memory.UnsafeMemoryManager.<clinit>(UnsafeMemoryManager.java:83)
> 10
> Time taken: 2.417 seconds, Fetched 1 row(s)
> spark-sql> CREATE INDEX dm_rcd ON TABLE test_rcd (city) AS 'bloomfilter' properties ('BLOOM_SIZE'='640000', 'BLOOM_FPP'='0.00001');
> 2021-02-04 22:13:58,683 | AUDIT | main | \{"time":"February 4, 2021 10:13:58 PM CST","username":"carbon","opName":"CREATE INDEX","opId":"15148202700230273","opStatus":"START"} | carbon.audit.logOperationStart(Auditor.java:74)
> 2021-02-04 22:13:58,759 | WARN | main | Bloom compress is not configured for index dm_rcd, use default value true | org.apache.carbondata.index.bloom.BloomCoarseGrainIndexFactory.validateAndGetBloomCompress(BloomCoarseGrainIndexFactory.java:202)
> 2021-02-04 22:13:59,292 | WARN | Executor task launch worker for task 2 | Bloom compress is not configured for index dm_rcd, use default value true | org.apache.carbondata.index.bloom.BloomCoarseGrainIndexFactory.validateAndGetBloomCompress(BloomCoarseGrainIndexFactory.java:202)
> 2021-02-04 22:13:59,629 | WARN | main | Bloom compress is not configured for index dm_rcd, use default value true | org.apache.carbondata.index.bloom.BloomCoarseGrainIndexFactory.validateAndGetBloomCompress(BloomCoarseGrainIndexFactory.java:202)
> 2021-02-04 22:14:00,331 | AUDIT | main | \{"time":"February 4, 2021 10:14:00 PM CST","username":"carbon","opName":"CREATE INDEX","opId":"15148202700230273","opStatus":"SUCCESS","opTime":"1648 ms","table":"default.test_rcd","extraInfo":{"provider":"bloomfilter","indexName":"dm_rcd","bloom_size":"640000","bloom_fpp":"0.00001"}} | carbon.audit.logOperationEnd(Auditor.java:97)
> Time taken: 1.818 seconds
> spark-sql> select count(*) from test_rcd where city = 'city40';
> 30
> Time taken: 0.556 seconds, Fetched 1 row(s)
> spark-sql>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)