You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@parquet.apache.org by "wangyum (via GitHub)" <gi...@apache.org> on 2025/07/10 16:35:14 UTC

Re: [PR] PARQUET-2373: Improve I/O performance with bloom_filter_length [parquet-java]

wangyum commented on PR #1184:
URL: https://github.com/apache/parquet-java/pull/1184#issuecomment-3058166461

   @zhangjiashen @wgtmac There is a data issue after this improvement. The result is empty after this patch. My query is:
   ```sql
   CREATE TEMPORARY VIEW parquetTable
   USING org.apache.spark.sql.parquet
   OPTIONS (
     path "viewfs://cluster/path/to/file/00000-62-eff62af9-bea8-4eb6-b9c9-c3ee29fd795e-0-00001.parquet"
   );
   
   SELECT *
   FROM parquetTable
   WHERE JNL_DEDUP_ID = 'PG.PG_CHARGE_ID.25030465176.EBAY_MM_PPFMM_PP_CAPTURE'
   AND ACCT_ID = 4920012120302 AND SEQ_NUM = 734343586;
   ```
   
   We build bloom filter on the column of `JNL_DEDUP_ID`, and it's data type is string type.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For additional commands, e-mail: issues-help@parquet.apache.org