Re: [I] [SUPPORT] RFC 63 Functional Index Hudi 0.1.0-beta [hudi]

["bhat-vinay (via GitHub)" <gi...@apache.org>]

bhat-vinay commented on issue #10110:
URL: https://github.com/apache/hudi/issues/10110#issuecomment-2020640947

   The issue is that `spark.read.format("hudi").load(PATH).createOrReplaceTempView(TABLE_NAME)` creates a temporary view (similar to the one that is created using `CREATE TEMPorary VIEW ...`) and it is neither a table and not a hudi managed table. Hence the following `CREATE INDEX ...` statement to create a functional fails as the object on which the index is being created is not a hudi managed table.
   
   Instead of creating a temporary view, one can use `saveAsTable(...)` method on the DataFrameWriter object to create a hudi managed table and then create functional index on those tables. Please see if this works for you:
   ```
   df.write.format("hudi").options(**hudi_options).option("path", "/external/table/path").mode("append").saveAsTable("table_name")
   spark.sql(s"CREATE INDEX hudi_table_func_index_datestr ON table_name USING column_stats(ts) options(func='from_unixtime', format='yyyy-MM-dd')")
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org