You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "hellochueng (via GitHub)" <gi...@apache.org> on 2023/04/12 08:32:27 UTC
[GitHub] [iceberg] hellochueng opened a new issue, #7329: how can i use spark-shell Time Travel query a hive catalog table
hellochueng opened a new issue, #7329:
URL: https://github.com/apache/iceberg/issues/7329
### Query engine
spark-shell
### Question
spark ddl
CREATE TABLE hive_prod.temp.iceberg_hive_test1(id bigint,name string, data string)USING iceberg;
spark-shell
spark.read.format("iceberg").option("start-snapshot-id", "10963874102873")
.option("end-snapshot-id", "63874143573109").load("**/temp/iceberg_hive_test1").createTempView("t1")
throw Exception
java.io.FileNotFoundException: File does not exist: ***/temp/iceberg_hive_test1/metadata/version-hint.text
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] hellochueng closed issue #7329: how can i use spark-shell Time Travel query a hive catalog table
Posted by "hellochueng (via GitHub)" <gi...@apache.org>.
hellochueng closed issue #7329: how can i use spark-shell Time Travel query a hive catalog table
URL: https://github.com/apache/iceberg/issues/7329
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] singhpk234 commented on issue #7329: how can i use spark-shell Time Travel query a hive catalog table
Posted by "singhpk234 (via GitHub)" <gi...@apache.org>.
singhpk234 commented on issue #7329:
URL: https://github.com/apache/iceberg/issues/7329#issuecomment-1505677580
If you are giving a path in the load command, it assumes it's an HadoopTable and hence tries to find the version-hint.text in the metadata path what you can do instead is, directly give the fully qualified table name in the `load()`.
please ref the doc below :
- https://iceberg.apache.org/docs/latest/spark-queries/#catalogs-with-dataframereader
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org