Re: [PR] Support Spark 4.3 [kyuubi]

["wangzhigang1999 (via GitHub)" <gi...@apache.org>]

wangzhigang1999 commented on PR #7704:
URL: https://github.com/apache/kyuubi/pull/7704#issuecomment-5522553279

   I found a Spark 4.3 compatibility gap while testing this PR through Kyuubi JDBC on Kubernetes.
   
   Open a session with:
   
   ```text
   jdbc:hive2://<host>:10009/default;#spark.sql.timestampNanosTypes.enabled=true
   ```
   
   Then run:
   
   ```sql
   SELECT localtimestamp(9);
   ```
   
   Spark finishes the query, but Beeline fails while fetching the result-set metadata:
   
   ```text
   IllegalArgumentException: Unrecognized type name: timestamp_ntz(9)
     at SchemaHelper.toTTypeId(SchemaHelper.scala:59)
   ```
   
   `SchemaHelper` currently handles `TimestampType` and `TimestampNTZType`. Spark 4.3's `TimestampNTZNanosType` and `TimestampLTZNanosType` extend `AnyTimestampNanoType`, so they reach the fallback case.
   
   Could we add handling and tests for both nanos types at precisions 7–9, including metadata precision and Thrift/Arrow result conversion?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org