You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by jackylk <gi...@git.apache.org> on 2018/07/27 02:57:03 UTC
[GitHub] carbondata pull request #2565: [HotFix][CARBONDATA-2788][BloomDataMap] Fix b...
Github user jackylk commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2565#discussion_r205655699
--- Diff: datamap/bloom/src/main/java/org/apache/carbondata/datamap/bloom/BloomCoarseGrainDataMap.java ---
@@ -103,7 +106,19 @@ public void init(DataMapModel dataMapModel) throws IOException {
/**
* init field converters for index columns
*/
- public void initIndexColumnConverters(CarbonTable carbonTable, List<CarbonColumn> indexedColumn) {
+ public void initIndexColumnConverters(CarbonTable carbonTable, String dataMapName,
+ List<CarbonColumn> indexedColumn) {
+ String cacheLevel = MapUtils.getString(
+ carbonTable.getTableInfo().getFactTable().getTableProperties(),
+ CarbonCommonConstants.CACHE_LEVEL, CarbonCommonConstants.CACHE_LEVEL_DEFAULT_VALUE);
+ this.isBlockletCacheLevel = cacheLevel.equalsIgnoreCase("blocklet");
+ if (!this.isBlockletCacheLevel) {
+ LOGGER.warn(
+ String.format("BloomFilter datamap %s runs with cache_level=block for table %s.%s,"
+ + " which may decrease its pruning performance",
--- End diff --
change to `which may decrease its pruning benefit, which lead to read more data`
---