You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "andygrove (via GitHub)" <gi...@apache.org> on 2024/10/10 21:33:38 UTC
[I] java.lang.NoClassDefFoundError: Could not initialize class org.apache.comet.package$ [datafusion-comet]
andygrove opened a new issue, #1012:
URL: https://github.com/apache/datafusion-comet/issues/1012
### Describe the bug
I am building a Docker image using the Dockerfile from this repo and then trying to execute queries in k8s. I get the following error.
```
Caused by: java.lang.NoClassDefFoundError: Could not initialize class org.apache.comet.package$ ││ at org.apache.comet.vector.NativeUtil.<init>(NativeUtil.scala:48) ││ at org.apache.comet.CometExecIterator.<init>(CometExecIterator.scala:52)
```
As far as I can tell, the root cause is an exception being thrown in the following code:
```
package object comet {
val CometArrowAllocator = new RootAllocator(Long.MaxValue)
```
### Steps to reproduce
_No response_
### Expected behavior
_No response_
### Additional context
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] java.lang.NoClassDefFoundError: Could not initialize class org.apache.comet.package$ [datafusion-comet]
Posted by "andygrove (via GitHub)" <gi...@apache.org>.
andygrove closed issue #1012: java.lang.NoClassDefFoundError: Could not initialize class org.apache.comet.package$
URL: https://github.com/apache/datafusion-comet/issues/1012
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] java.lang.NoClassDefFoundError: Could not initialize class org.apache.comet.package$ [datafusion-comet]
Posted by "tbar4 (via GitHub)" <gi...@apache.org>.
tbar4 commented on issue #1012:
URL: https://github.com/apache/datafusion-comet/issues/1012#issuecomment-2408315054
Getting a similar error:
```scala
scala> (0 until 10).toDF("a").write.mode("overwrite").parquet("/tmp/test")
24/10/11 19:32:10 WARN CometSparkSessionExtensions: Comet extension is disabled because of error when loading native lib. Falling back to Spark
java.lang.NoClassDefFoundError: Could not initialize class org.apache.comet.NativeBase
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] java.lang.NoClassDefFoundError: Could not initialize class org.apache.comet.package$ [datafusion-comet]
Posted by "andygrove (via GitHub)" <gi...@apache.org>.
andygrove commented on issue #1012:
URL: https://github.com/apache/datafusion-comet/issues/1012#issuecomment-2427046782
> Getting a similar error:
>
> ```scala
> scala> (0 until 10).toDF("a").write.mode("overwrite").parquet("/tmp/test")
> 24/10/11 19:32:10 WARN CometSparkSessionExtensions: Comet extension is disabled because of error when loading native lib. Falling back to Spark
> java.lang.NoClassDefFoundError: Could not initialize class org.apache.comet.NativeBase
> ```
There is a specific issue for the NativeBase error: https://github.com/apache/datafusion-comet/issues/999
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org