You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "dragon-feng (via GitHub)" <gi...@apache.org> on 2023/04/03 03:33:05 UTC
[GitHub] [iceberg] dragon-feng opened a new issue, #7268: Failed to find data source: iceberg. Please find packages at
dragon-feng opened a new issue, #7268:
URL: https://github.com/apache/iceberg/issues/7268
### Query engine
spark
### Question
This problem cannot be solved using issues #4628, hadoop version 3.1.0, spark version 3.2.3, and iceberg version 0.14.1
diagnostics: User class threw exception: java.lang.ClassNotFoundException:
Failed to find data source: iceberg. Please find packages at
http://spark.apache.org/third-party-projects.html
at org.apache.spark.sql.errors.QueryExecutionErrors$.failedToFindDataSourceError(QueryExecutionErrors.scala:443)
at org.apache.spark.sql.execution.datasources.DataSource$.lookupDataSource(DataSource.scala:670)
at org.apache.spark.sql.streaming.DataStreamWriter.startInternal(DataStreamWriter.scala:362)
at org.apache.spark.sql.streaming.DataStreamWriter.start(DataStreamWriter.scala:248)
at com.myit.app.streaming.StructStreamingIceberg$.main(StructStreamingIceberg.scala:87)
at com.myit.app.streaming.StructStreamingIceberg.main(StructStreamingIceberg.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.yarn.ApplicationMaster$$anon$2.run(ApplicationMaster.scala:737)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] nastra commented on issue #7268: Failed to find data source: iceberg. Please find packages at
Posted by "nastra (via GitHub)" <gi...@apache.org>.
nastra commented on issue #7268:
URL: https://github.com/apache/iceberg/issues/7268#issuecomment-1493841914
@dragon-feng can you please specify how you start spark and construct the catalog instance? You would normally need the `--packages` option (https://iceberg.apache.org/docs/latest/getting-started/#using-iceberg-in-spark-3) to grab the correct spark+iceberg dependency
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Failed to find data source: iceberg. Please find packages at [iceberg]
Posted by "NhatDuy11 (via GitHub)" <gi...@apache.org>.
NhatDuy11 commented on issue #7268:
URL: https://github.com/apache/iceberg/issues/7268#issuecomment-1754691644
Can someone tell me if I am using Spark 2.4.5 and Scala 2.11.12 which version of Apache Iceberg should I use?, thank you very much everyone!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] dragon-feng closed issue #7268: Failed to find data source: iceberg. Please find packages at
Posted by "dragon-feng (via GitHub)" <gi...@apache.org>.
dragon-feng closed issue #7268: Failed to find data source: iceberg. Please find packages at
URL: https://github.com/apache/iceberg/issues/7268
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Failed to find data source: iceberg. Please find packages at [iceberg]
Posted by "imkindia12 (via GitHub)" <gi...@apache.org>.
imkindia12 commented on issue #7268:
URL: https://github.com/apache/iceberg/issues/7268#issuecomment-1785570428
@NhatDuy11 your spark version appear the time you invoke spark-shell, Using V2 version is helps in using time travel and other ILM features.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org