You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@kyuubi.apache.org by "pan3793 (via GitHub)" <gi...@apache.org> on 2023/09/20 11:56:57 UTC
[GitHub] [kyuubi] pan3793 commented on issue #5317: [Bug] Hive Connector throws NotSerializableException on reading Hive Avro table
pan3793 commented on issue #5317:
URL: https://github.com/apache/kyuubi/issues/5317#issuecomment-1727580215
I constructed a quick UT with a similar setup, but can not reproduce
```
test("read and write Hive serde table - avro") {
withSparkSession() { spark =>
val table = "hive.default.employee_avro"
try {
spark.sql(
s""" CREATE TABLE IF NOT EXISTS
| $table (id String, year String, month string)
| STORED AS AVRO
|""".stripMargin)
spark.sql(
s""" INSERT OVERWRITE $table VALUES("Cheng", "2023", "0920")
|""".stripMargin)
checkQueryResult(s"SELECT * FROM $table", spark, Array(Row.apply("Cheng", "2023", "0920")))
} finally {
spark.sql(s"DROP TABLE IF EXISTS $table")
}
}
}
```
I also verified the table is corrected to set as AVRO
```
(kyuubi) ➜ kyuubi git:(master) file /Users/chengpan/Projects/apache-kyuubi/spark-warehouse/employee_avro/part-00000-f928cd40-d791-4587-b17c-5bd496410295-c000
/Users/chengpan/Projects/apache-kyuubi/spark-warehouse/employee_avro/part-00000-f928cd40-d791-4587-b17c-5bd496410295-c000: Apache Avro version 1
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org