You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "sachinmn2010 (via GitHub)" <gi...@apache.org> on 2023/02/21 12:31:04 UTC

[GitHub] [hudi] sachinmn2010 commented on pull request #7088: [HUDI-5104] Add feature flag to disable `HoodieFileIndex` and fall back to `HoodieROTablePathFilter`

sachinmn2010 commented on PR #7088:
URL: https://github.com/apache/hudi/pull/7088#issuecomment-1438401766

   @yihua  I was also facing the issue HUDI-5092 while reading hudi table from databricks using hudi bundle 0.11.1. I tried using the same databricks version you mentioned above with hudi 12.2, but its still failing, could you please help me with it? 
   
    Databricks Runtime : `11.3 LTS (includes Apache Spark 3.3.0, Scala 2.12)`
   Hudi Spark bundle : `org.apache.hudi:hudi-spark3.3-bundle_2.12:0.12.2`
   
   Error :
   ```
   Py4JJavaError: An error occurred while calling o776.showString.
   : java.lang.NoSuchMethodError: org.apache.spark.sql.internal.SQLConf.parquetFilterPushDownStringStartWith()Z
   	at org.apache.spark.sql.execution.datasources.parquet.Spark32PlusHoodieParquetFileFormat.buildReaderWithPartitionValues(Spark32PlusHoodieParquetFileFormat.scala:129)
   	at org.apache.spark.sql.execution.datasources.parquet.HoodieParquetFileFormat.buildReaderWithPartitionValues(HoodieParquetFileFormat.scala:50)
   	at org.apache.spark.sql.execution.FileSourceScanExec.inputRDD$lzycompute(DataSourceScanExec.scala:1914)
   	at org.apache.spark.sql.execution.FileSourceScanExec.inputRDD(DataSourceScanExec.scala:1895)
   	at org.apache.spark.sql.execution.FileSourceScanExec.doExecuteColumnar(DataSourceScanExec.scala:1970)
   	at org.apache.spark.sql.execution.SparkPlan.$anonfun$executeColumnar$1(SparkPlan.scala:254)
   	at org.apache.spark.sql.execution.SparkPlan.$anonfun$executeQuery$1(SparkPlan.scala:271)
   	at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:165)
   	at org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:267)
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org