You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@parquet.apache.org by "wangyum (via GitHub)" <gi...@apache.org> on 2025/07/10 16:35:14 UTC
Re: [PR] PARQUET-2373: Improve I/O performance with bloom_filter_length [parquet-java]
wangyum commented on PR #1184:
URL: https://github.com/apache/parquet-java/pull/1184#issuecomment-3058166461
@zhangjiashen @wgtmac There is a data issue after this improvement. The result is empty after this patch. My query is:
```sql
CREATE TEMPORARY VIEW parquetTable
USING org.apache.spark.sql.parquet
OPTIONS (
path "viewfs://cluster/path/to/file/00000-62-eff62af9-bea8-4eb6-b9c9-c3ee29fd795e-0-00001.parquet"
);
SELECT *
FROM parquetTable
WHERE JNL_DEDUP_ID = 'PG.PG_CHARGE_ID.25030465176.EBAY_MM_PPFMM_PP_CAPTURE'
AND ACCT_ID = 4920012120302 AND SEQ_NUM = 734343586;
```
We build bloom filter on the column of `JNL_DEDUP_ID`, and it's data type is string type.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For additional commands, e-mail: issues-help@parquet.apache.org