You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Lokesh Jain (Jira)" <ji...@apache.org> on 2024/11/25 06:07:00 UTC
[jira] [Closed] (HUDI-8531) Disallow unsupported secondary index types
[ https://issues.apache.org/jira/browse/HUDI-8531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lokesh Jain closed HUDI-8531.
-----------------------------
Resolution: Duplicate
> Disallow unsupported secondary index types
> ------------------------------------------
>
> Key: HUDI-8531
> URL: https://issues.apache.org/jira/browse/HUDI-8531
> Project: Apache Hudi
> Issue Type: Task
> Reporter: Sagar Sumit
> Assignee: Jonathan Vexler
> Priority: Blocker
> Fix For: 1.0.0
>
>
> {code:java}
> spark-sql (default)> create index idx_lucene on hudi_table using vinoth(state) ; {code}
> succeeds. and does nothing.
> {code:java}
> % ls /tmp/hudi_test_table/.hoodie/metadata
> column_stats partition_stats secondary_index_idx_driver
> files record_index secondary_index_idx_rider {code}
> We should only allow indexes that are actually working/supported. throw errors for everything else.
> {code:java}
> spark-sql (default)> create index idx_vinoth on hudi_table using vinoth(state) ; 24/11/15 10:07:39 ERROR SparkSQLDriver: Failed in [create index idx_vinoth on hudi_table using vinoth(state) ] org.apache.hudi.exception.HoodieIndexException: Unknown hoodie index type:vinoth at org.apache.hudi.index.secondary.SecondaryIndexType.lambda$of$3(SecondaryIndexType.java:55) at java.util.Optional.orElseThrow(Optional.java:290) at org.apache.hudi.index.secondary.SecondaryIndexType.of(SecondaryIndexType.java:54) at org.apache.hudi.index.secondary.HoodieSecondaryIndex$Builder.setIndexType(HoodieSecondaryIndex.java:112) at org.apache.hudi.index.secondary.SecondaryIndexManager.create(SecondaryIndexManager.java:110) at org.apache.spark.sql.hudi.command.CreateIndexCommand.run(IndexCommands.scala:60) at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult$lzycompute(command {code}
>
> We should clean up `org.apache.hudi.index.secondary.SecondaryIndexType` and its usages..
--
This message was sent by Atlassian Jira
(v8.20.10#820010)