[I] Vector querying via Hive fails 1 [hudi]

["voonhous (via GitHub)" <gi...@apache.org>]

voonhous opened a new issue, #18579:
URL: https://github.com/apache/hudi/issues/18579

   ### Bug Description
   
   **What happened:**
   
   **What you expected:**
   
   **Steps to reproduce:**
   1.
   2.
   3.
   
   
   ### Environment
   
   **Hudi version:**
   **Query engine:** (Spark/Flink/Trino etc)
   **Relevant configs:**
   
   
   ### Logs and Stack Trace
   
   ```log
   hive.stats.autogather=false -e SELECT concat('VEC_LEN=', length(embedding)) FROM default.vector_test_df WHERE id = 1
   87159 [main] INFO  org.apache.hudi.integ2.testcontainers.command.CommandExecutor [] - <== [hytyl2eihxrc-hiveserver-1:bbeaa699] Exit code: 1 (4425ms)
   87159 [main] ERROR org.apache.hudi.integ2.testcontainers.command.CommandExecutor [] - STDOUT:
   # WARNING: Unable to get Instrumentation. Dynamic Attach failed. You may add this JAR as -javaagent manually, or supply -Djdk.attach.allowAttachSelf
   
   87159 [main] ERROR org.apache.hudi.integ2.testcontainers.command.CommandExecutor [] - STDERR:
   SLF4J: Class path contains multiple SLF4J bindings.
   SLF4J: Found binding in [jar:file:/opt/hive/lib/log4j-slf4j-impl-2.17.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
   SLF4J: Found binding in [jar:file:/opt/hadoop-2.8.4/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
   SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
   SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
   WARNING: An illegal reflective access operation has occurred
   WARNING: Illegal reflective access by org.apache.hadoop.security.authentication.util.KerberosUtil (file:/opt/hadoop-2.8.4/share/hadoop/common/lib/hadoop-auth-2.8.4.jar) to method sun.security.krb5.Config.getInstance()
   WARNING: Please consider reporting this to the maintainers of org.apache.hadoop.security.authentication.util.KerberosUtil
   WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
   WARNING: All illegal access operations will be denied in a future release
   
   Logging initialized using configuration in file:/opt/hive/conf/hive-log4j2.properties Async: true
   OK
   SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
   SLF4J: Defaulting to no-operation (NOP) logger implementation
   SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
   Failed with exception java.io.IOException:org.apache.hudi.internal.schema.HoodieSchemaException: cannot support rewrite value for schema type: {"type":"fixed","name":"vector_float_3","size":12,"logicalType":"vector","dimension":3,"elementType":"FLOAT","storageBacking":"FIXED_BYTES"} since the old schema type is: {"type":"fixed","name":"embedding","size":12}
   Time taken: 1.827 seconds
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Vector querying via Hive fails 1 [hudi]

["bvaradar (via GitHub)" <gi...@apache.org>]

bvaradar closed issue #18579: Vector querying via Hive fails 1
URL: https://github.com/apache/hudi/issues/18579


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org