You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@gluten.apache.org by "zjuwangg (via GitHub)" <gi...@apache.org> on 2025/05/22 06:51:13 UTC
[I] [FLINK]Build velox4j exception encountered when as docs instruction [incubator-gluten]
zjuwangg opened a new issue, #9726:
URL: https://github.com/apache/incubator-gluten/issues/9726
### Problem description
Following velox4j build instructions in https://github.com/apache/incubator-gluten/blob/main/gluten-flink/docs/Flink.md.
Two exception occurs
1. using `mvn clean install`
```
Running io.github.zhztheplayer.velox4j.write.TableWriteTraitsTest
SLF4J(W): No SLF4J providers were found.
SLF4J(W): Defaulting to no-operation (NOP) logger implementation
SLF4J(W): See https://www.slf4j.org/codes.html#noProviders for further details.
Created work directory /tmp/velox4j-15675535451210828441.
Found required libraries in container velox4j-lib/Linux/amd64.
Copying library velox4j-lib/Linux/amd64/libfolly.so.0.58.0-dev to /tmp/velox4j-15675535451210828441/lib/libfolly.so.0.58.0-dev...
Copying library velox4j-lib/Linux/amd64/libprotobuf.so.32 to /tmp/velox4j-15675535451210828441/lib/libprotobuf.so.32...
Copying library velox4j-lib/Linux/amd64/libvelox.so to /tmp/velox4j-15675535451210828441/lib/libvelox.so...
Copying library velox4j-lib/Linux/amd64/libvelox4j.so to /tmp/velox4j-15675535451210828441/lib/libvelox4j.so...
Copying library velox4j-lib/Linux/amd64/libglog.so.0 to /tmp/velox4j-15675535451210828441/lib/libglog.so.0...
Copying library velox4j-lib/Linux/amd64/libsnappy.so.1 to /tmp/velox4j-15675535451210828441/lib/libsnappy.so.1...
Copying library velox4j-lib/Linux/amd64/libunwind.so.8 to /tmp/velox4j-15675535451210828441/lib/libunwind.so.8...
Copying library velox4j-lib/Linux/amd64/liblz4.so.1 to /tmp/velox4j-15675535451210828441/lib/liblz4.so.1...
Copying library velox4j-lib/Linux/amd64/libbz2.so.1.0 to /tmp/velox4j-15675535451210828441/lib/libbz2.so.1.0...
Copying library velox4j-lib/Linux/amd64/libz.so.1 to /tmp/velox4j-15675535451210828441/lib/libz.so.1...
Copying library velox4j-lib/Linux/amd64/libboost_program_options.so.1.84.0 to /tmp/velox4j-15675535451210828441/lib/libboost_program_options.so.1.84.0...
Copying library velox4j-lib/Linux/amd64/liblzma.so.5 to /tmp/velox4j-15675535451210828441/lib/liblzma.so.5...
Copying library velox4j-lib/Linux/amd64/libssl.so.1.1 to /tmp/velox4j-15675535451210828441/lib/libssl.so.1.1...
Copying library velox4j-lib/Linux/amd64/libboost_filesystem.so.1.84.0 to /tmp/velox4j-15675535451210828441/lib/libboost_filesystem.so.1.84.0...
Copying library velox4j-lib/Linux/amd64/libzstd.so.1 to /tmp/velox4j-15675535451210828441/lib/libzstd.so.1...
Copying library velox4j-lib/Linux/amd64/libdouble-conversion.so.3 to /tmp/velox4j-15675535451210828441/lib/libdouble-conversion.so.3...
Copying library velox4j-lib/Linux/amd64/libsodium.so.23 to /tmp/velox4j-15675535451210828441/lib/libsodium.so.23...
Copying library velox4j-lib/Linux/amd64/libgflags.so.2.2 to /tmp/velox4j-15675535451210828441/lib/libgflags.so.2.2...
Copying library velox4j-lib/Linux/amd64/libre2.so.5 to /tmp/velox4j-15675535451210828441/lib/libre2.so.5...
Copying library velox4j-lib/Linux/amd64/libevent-2.1.so.7 to /tmp/velox4j-15675535451210828441/lib/libevent-2.1.so.7...
Copying library velox4j-lib/Linux/amd64/libcrypto.so.1.1 to /tmp/velox4j-15675535451210828441/lib/libcrypto.so.1.1...
Copying library velox4j-lib/Linux/amd64/libboost_context.so.1.84.0 to /tmp/velox4j-15675535451210828441/lib/libboost_context.so.1.84.0...
WARNING: Logging before InitGoogleLogging() is written to STDERR
I0522 14:16:43.675778 127761 JniLoader.cc:29] Initializing Velox4J...
I0522 14:16:43.677974 127761 JniLoader.cc:43] Velox4J initialized.
All required libraries were successfully loaded.
I0522 14:16:43.902742 127761 HiveConnector.cpp:56] Hive connector connector-hive created with maximum of 20000 cached file handles with expiration of 0ms.
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.257 sec
Running io.github.zhztheplayer.velox4j.eval.EvaluationTest
W0522 14:16:44.089741 127761 ObjectStore.cc:34] Unclosed object [Store ID: 7, Resource handle ID: 7, Description: N8facebook5velox10BaseVectorE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
W0522 14:16:44.089778 127761 ObjectStore.cc:34] Unclosed object [Store ID: 7, Resource handle ID: 6, Description: N7velox4j9EvaluatorE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
W0522 14:16:44.089804 127761 ObjectStore.cc:34] Unclosed object [Store ID: 7, Resource handle ID: 5, Description: N8facebook5velox17SelectivityVectorE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
W0522 14:16:44.089807 127761 ObjectStore.cc:34] Unclosed object [Store ID: 7, Resource handle ID: 4, Description: N8facebook5velox10BaseVectorE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
W0522 14:16:44.094135 127761 ObjectStore.cc:34] Unclosed object [Store ID: 8, Resource handle ID: 16, Description: N8facebook5velox10BaseVectorE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
W0522 14:16:44.094161 127761 ObjectStore.cc:34] Unclosed object [Store ID: 8, Resource handle ID: 15, Description: N8facebook5velox10BaseVectorE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
W0522 14:16:44.094163 127761 ObjectStore.cc:34] Unclosed object [Store ID: 8, Resource handle ID: 14, Description: N8facebook5velox10BaseVectorE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
W0522 14:16:44.094165 127761 ObjectStore.cc:34] Unclosed object [Store ID: 8, Resource handle ID: 13, Description: N8facebook5velox10BaseVectorE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
W0522 14:16:44.094168 127761 ObjectStore.cc:34] Unclosed object [Store ID: 8, Resource handle ID: 12, Description: N8facebook5velox10BaseVectorE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
W0522 14:16:44.094170 127761 ObjectStore.cc:34] Unclosed object [Store ID: 8, Resource handle ID: 11, Description: N8facebook5velox10BaseVectorE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
W0522 14:16:44.094172 127761 ObjectStore.cc:34] Unclosed object [Store ID: 8, Resource handle ID: 10, Description: N8facebook5velox10BaseVectorE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
W0522 14:16:44.094173 127761 ObjectStore.cc:34] Unclosed object [Store ID: 8, Resource handle ID: 9, Description: N8facebook5velox10BaseVectorE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
W0522 14:16:44.094175 127761 ObjectStore.cc:34] Unclosed object [Store ID: 8, Resource handle ID: 8, Description: N8facebook5velox10BaseVectorE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
W0522 14:16:44.094177 127761 ObjectStore.cc:34] Unclosed object [Store ID: 8, Resource handle ID: 7, Description: N8facebook5velox10BaseVectorE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
W0522 14:16:44.094178 127761 ObjectStore.cc:34] Unclosed object [Store ID: 8, Resource handle ID: 6, Description: N7velox4j9EvaluatorE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
W0522 14:16:44.094188 127761 ObjectStore.cc:34] Unclosed object [Store ID: 8, Resource handle ID: 5, Description: N8facebook5velox17SelectivityVectorE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
W0522 14:16:44.094192 127761 ObjectStore.cc:34] Unclosed object [Store ID: 8, Resource handle ID: 4, Description: N8facebook5velox10BaseVectorE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
W0522 14:16:44.095960 127761 ObjectStore.cc:34] Unclosed object [Store ID: 9, Resource handle ID: 7, Description: N8facebook5velox10BaseVectorE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
W0522 14:16:44.095986 127761 ObjectStore.cc:34] Unclosed object [Store ID: 9, Resource handle ID: 6, Description: N7velox4j9EvaluatorE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
W0522 14:16:44.095996 127761 ObjectStore.cc:34] Unclosed object [Store ID: 9, Resource handle ID: 5, Description: N8facebook5velox17SelectivityVectorE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
W0522 14:16:44.095999 127761 ObjectStore.cc:34] Unclosed object [Store ID: 9, Resource handle ID: 4, Description: N8facebook5velox10BaseVectorE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.11 sec
Running io.github.zhztheplayer.velox4j.jni.JniApiTest
Stateful velox plan is -- Aggregation[2][FINAL [c0] a0 := count("a0"), a1 := sum("a1")] -> c0:BIGINT, a0:BIGINT, a1:BIGINT
-- Aggregation[1][PARTIAL [c0] a0 := count(1), a1 := sum(ROW["c1"])] -> c0:BIGINT, a0:BIGINT, a1:BIGINT
-- Values[0][3 rows in 1 vectors] -> c0:BIGINT, c1:INTEGER, c2:BOOLEAN
E0522 14:16:44.102514 127761 Exceptions.h:66] Line: /home/wanggang.terry/velox4j/src/main/cpp/build/_deps/velox-src/velox/exec/Driver.cpp:966, Function:mayPushdownAggregation, Expression: Aggregation operator not found in its Driver: PartialAggregation[1] 1, Source: RUNTIME, ErrorCode: INVALID_STATE
Stateful velox plan is -- Aggregation[2][FINAL [c0] a0 := count("a0"), a1 := sum("a1")] -> c0:BIGINT, a0:BIGINT, a1:BIGINT
-- Aggregation[1][PARTIAL [c0] a0 := count(1), a1 := sum(ROW["c1"])] -> c0:BIGINT, a0:BIGINT, a1:BIGINT
-- Values[0][3 rows in 1 vectors] -> c0:BIGINT, c1:INTEGER, c2:BOOLEAN
E0522 14:16:44.127048 127761 Exceptions.h:66] Line: /home/wanggang.terry/velox4j/src/main/cpp/build/_deps/velox-src/velox/exec/Driver.cpp:966, Function:mayPushdownAggregation, Expression: Aggregation operator not found in its Driver: PartialAggregation[1] 1, Source: RUNTIME, ErrorCode: INVALID_STATE
Stateful velox plan is -- Aggregation[2][FINAL [c0] a0 := count("a0"), a1 := sum("a1")] -> c0:BIGINT, a0:BIGINT, a1:BIGINT
-- Aggregation[1][PARTIAL [c0] a0 := count(1), a1 := sum(ROW["c1"])] -> c0:BIGINT, a0:BIGINT, a1:BIGINT
-- Values[0][3 rows in 1 vectors] -> c0:BIGINT, c1:INTEGER, c2:BOOLEAN
E0522 14:16:44.134207 127761 Exceptions.h:66] Line: /home/wanggang.terry/velox4j/src/main/cpp/build/_deps/velox-src/velox/exec/Driver.cpp:966, Function:mayPushdownAggregation, Expression: Aggregation operator not found in its Driver: PartialAggregation[1] 1, Source: RUNTIME, ErrorCode: INVALID_STATE
Stateful velox plan is -- Aggregation[2][FINAL [c0] a0 := count("a0"), a1 := sum("a1")] -> c0:BIGINT, a0:BIGINT, a1:BIGINT
-- Aggregation[1][PARTIAL [c0] a0 := count(1), a1 := sum(ROW["c1"])] -> c0:BIGINT, a0:BIGINT, a1:BIGINT
-- Values[0][3 rows in 1 vectors] -> c0:BIGINT, c1:INTEGER, c2:BOOLEAN
E0522 14:16:44.142392 127800 Exceptions.h:66] Line: /home/wanggang.terry/velox4j/src/main/cpp/build/_deps/velox-src/velox/exec/Driver.cpp:966, Function:mayPushdownAggregation, Expression: Aggregation operator not found in its Driver: PartialAggregation[1] 1, Source: RUNTIME, ErrorCode: INVALID_STATE
E0522 14:16:44.146425 127800 Exceptions.h:66] Line: /home/wanggang.terry/velox4j/src/main/cpp/main/velox4j/jni/JniCommon.cc:56, Function:checkException, Expression: Error during calling Java code from native code: io.github.zhztheplayer.velox4j.exception.VeloxException: Exception: VeloxRuntimeError
Error Source: RUNTIME
Error Code: INVALID_STATE
Reason: Aggregation operator not found in its Driver: PartialAggregation[1] 1
Retriable: False
Function: mayPushdownAggregation
File: /home/wanggang.terry/velox4j/src/main/cpp/build/_deps/velox-src/velox/exec/Driver.cpp
Line: 966
Stack trace:
# 0 facebook::velox::VeloxException::VeloxException(char const*, unsigned long, char const*, std::basic_string_view<char, std::char_traits<char> >, std::basic_string_view<char, std::char_traits<char> >, std::basic_string_view<char, std::char_traits<char> >, std::basic_string_view<char, std::char_traits<char> >, bool, facebook::velox::VeloxException::Type, std::basic_string_view<char, std::char_traits<char> >)
# 1 void facebook::velox::detail::veloxCheckFail<facebook::velox::VeloxRuntimeError, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&>(facebook::velox::detail::VeloxCheckFailArgs const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)
# 2 facebook::velox::exec::Driver::mayPushdownAggregation(facebook::velox::exec::Operator*) const
# 3 facebook::velox::exec::HashAggregation::addInput(std::shared_ptr<facebook::velox::RowVector>)
# 4 facebook::velox::stateful::StatefulTask::next(int&)
# 5 velox4j::StatefulSerialTask::advance0(bool)
# 6 velox4j::(anonymous namespace)::upIteratorAdvance(JNIEnv_*, _jobject*, long)
# 7 0x00007f4c40807a30
at io.github.zhztheplayer.velox4j.jni.StaticJniWrapper.upIteratorAdvance(Native Method)
at io.github.zhztheplayer.velox4j.jni.StaticJniApi.upIteratorAdvance(StaticJniApi.java:72)
at io.github.zhztheplayer.velox4j.query.SerialTask.advance(SerialTask.java:36)
at io.github.zhztheplayer.velox4j.iterator.UpIterators$AsJavaIterator.hasNext(UpIterators.java:41)
at io.github.zhztheplayer.velox4j.iterator.DownIterators$FromJavaIterator.advance0(DownIterators.java:37)
at io.github.zhztheplayer.velox4j.iterator.DownIterators$BaseDownIterator.advance(DownIterators.java:62)
at io.github.zhztheplayer.velox4j.jni.StaticJniWrapper.upIteratorAdvance(Native Method)
at io.github.zhztheplayer.velox4j.jni.StaticJniApi.upIteratorAdvance(StaticJniApi.java:72)
at io.github.zhztheplayer.velox4j.iterator.GenericUpIterator.advance(GenericUpIterator.java:34)
at io.github.zhztheplayer.velox4j.iterator.UpIterators$AsJavaIterator.hasNext(UpIterators.java:41)
at io.github.zhztheplayer.velox4j.test.UpIteratorTests$IteratorAssertionBuilder.run(UpIteratorTests.java:126)
at io.github.zhztheplayer.velox4j.test.SampleQueryTests.assertIterator(SampleQueryTests.java:52)
at io.github.zhztheplayer.velox4j.test.SampleQueryTests.assertIterator(SampleQueryTests.java:41)
at io.github.zhztheplayer.velox4j.jni.JniApiTest$2.run(JniApiTest.java:233)
at java.base/java.lang.Thread.run(Thread.java:829)
, Source: RUNTIME, ErrorCode: INVALID_STATE
5月 22, 2025 2:16:44 下午 com.google.common.util.concurrent.UncaughtExceptionHandlers$Exiter uncaughtException
严重: Caught an exception in Thread[Thread-0,5,main]. Shutting down.
io.github.zhztheplayer.velox4j.exception.VeloxException: Exception: VeloxRuntimeError
Error Source: RUNTIME
Error Code: INVALID_STATE
Reason: Error during calling Java code from native code: io.github.zhztheplayer.velox4j.exception.VeloxException: Exception: VeloxRuntimeError
Error Source: RUNTIME
Error Code: INVALID_STATE
Reason: Aggregation operator not found in its Driver: PartialAggregation[1] 1
Retriable: False
Function: mayPushdownAggregation
File: /home/wanggang.terry/velox4j/src/main/cpp/build/_deps/velox-src/velox/exec/Driver.cpp
Line: 966
Stack trace:
# 0 facebook::velox::VeloxException::VeloxException(char const*, unsigned long, char const*, std::basic_string_view<char, std::char_traits<char> >, std::basic_string_view<char, std::char_traits<char> >, std::basic_string_view<char, std::char_traits<char> >, std::basic_string_view<char, std::char_traits<char> >, bool, facebook::velox::VeloxException::Type, std::basic_string_view<char, std::char_traits<char> >)
# 1 void facebook::velox::detail::veloxCheckFail<facebook::velox::VeloxRuntimeError, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&>(facebook::velox::detail::VeloxCheckFailArgs const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)
# 2 facebook::velox::exec::Driver::mayPushdownAggregation(facebook::velox::exec::Operator*) const
# 3 facebook::velox::exec::HashAggregation::addInput(std::shared_ptr<facebook::velox::RowVector>)
# 4 facebook::velox::stateful::StatefulTask::next(int&)
# 5 velox4j::StatefulSerialTask::advance0(bool)
# 6 velox4j::(anonymous namespace)::upIteratorAdvance(JNIEnv_*, _jobject*, long)
# 7 0x00007f4c40807a30
at io.github.zhztheplayer.velox4j.jni.StaticJniWrapper.upIteratorAdvance(Native Method)
at io.github.zhztheplayer.velox4j.jni.StaticJniApi.upIteratorAdvance(StaticJniApi.java:72)
at io.github.zhztheplayer.velox4j.query.SerialTask.advance(SerialTask.java:36)
at io.github.zhztheplayer.velox4j.iterator.UpIterators$AsJavaIterator.hasNext(UpIterators.java:41)
at io.github.zhztheplayer.velox4j.iterator.DownIterators$FromJavaIterator.advance0(DownIterators.java:37)
at io.github.zhztheplayer.velox4j.iterator.DownIterators$BaseDownIterator.advance(DownIterators.java:62)
at io.github.zhztheplayer.velox4j.jni.StaticJniWrapper.upIteratorAdvance(Native Method)
at io.github.zhztheplayer.velox4j.jni.StaticJniApi.upIteratorAdvance(StaticJniApi.java:72)
at io.github.zhztheplayer.velox4j.iterator.GenericUpIterator.advance(GenericUpIterator.java:34)
at io.github.zhztheplayer.velox4j.iterator.UpIterators$AsJavaIterator.hasNext(UpIterators.java:41)
at io.github.zhztheplayer.velox4j.test.UpIteratorTests$IteratorAssertionBuilder.run(UpIteratorTests.java:126)
at io.github.zhztheplayer.velox4j.test.SampleQueryTests.assertIterator(SampleQueryTests.java:52)
at io.github.zhztheplayer.velox4j.test.SampleQueryTests.assertIterator(SampleQueryTests.java:41)
at io.github.zhztheplayer.velox4j.jni.JniApiTest$2.run(JniApiTest.java:233)
at java.base/java.lang.Thread.run(Thread.java:829)
Retriable: False
Function: checkException
File: /home/wanggang.terry/velox4j/src/main/cpp/main/velox4j/jni/JniCommon.cc
Line: 56
Stack trace:
# 0 facebook::velox::VeloxException::VeloxException(char const*, unsigned long, char const*, std::basic_string_view<char, std::char_traits<char> >, std::basic_string_view<char, std::char_traits<char> >, std::basic_string_view<char, std::char_traits<char> >, std::basic_string_view<char, std::char_traits<char> >, bool, facebook::velox::VeloxException::Type, std::basic_string_view<char, std::char_traits<char> >)
# 1 void facebook::velox::detail::veloxCheckFail<facebook::velox::VeloxRuntimeError, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&>(facebook::velox::detail::VeloxCheckFailArgs const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)
# 2 velox4j::checkException(JNIEnv_*)
# 3 velox4j::DownIterator::advance()
# 4 velox4j::DownIterator::read(folly::SemiFuture<folly::Unit>&)
# 5 velox4j::(anonymous namespace)::ExternalStreamAsUpIterator::advance()
# 6 velox4j::(anonymous namespace)::upIteratorAdvance(JNIEnv_*, _jobject*, long)
# 7 0x00007f4c40807a30
at io.github.zhztheplayer.velox4j.jni.StaticJniWrapper.upIteratorAdvance(Native Method)
at io.github.zhztheplayer.velox4j.jni.StaticJniApi.upIteratorAdvance(StaticJniApi.java:72)
at io.github.zhztheplayer.velox4j.iterator.GenericUpIterator.advance(GenericUpIterator.java:34)
at io.github.zhztheplayer.velox4j.iterator.UpIterators$AsJavaIterator.hasNext(UpIterators.java:41)
at io.github.zhztheplayer.velox4j.test.UpIteratorTests$IteratorAssertionBuilder.run(UpIteratorTests.java:126)
at io.github.zhztheplayer.velox4j.test.SampleQueryTests.assertIterator(SampleQueryTests.java:52)
at io.github.zhztheplayer.velox4j.test.SampleQueryTests.assertIterator(SampleQueryTests.java:41)
at io.github.zhztheplayer.velox4j.jni.JniApiTest$2.run(JniApiTest.java:233)
at java.base/java.lang.Thread.run(Thread.java:829)
W0522 14:16:44.190097 127767 ObjectStore.cc:34] Unclosed object [Store ID: 4, Resource handle ID: 19, Description: N7velox4j7SessionE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
W0522 14:16:44.190137 127767 ObjectStore.cc:34] Unclosed object [Store ID: 17, Resource handle ID: 7, Description: N7velox4j12_GLOBAL__N_126ExternalStreamAsUpIteratorE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
W0522 14:16:44.190142 127767 ObjectStore.cc:34] Unclosed object [Store ID: 17, Resource handle ID: 6, Description: N7velox4j12DownIteratorE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
E0522 14:16:44.190171 127767 Exceptions.h:66] Line: /home/wanggang.terry/velox4j/src/main/cpp/main/velox4j/jni/JniCommon.cc:136, Function:getLocalJNIEnv, Expression: Failed to reattach current thread to JVM., Source: RUNTIME, ErrorCode: INVALID_STATE
W0522 14:16:44.190284 127767 DownIterator.cc:56] Unable to destroy the global reference to the Java side down iterator: Exception: VeloxRuntimeError
Error Source: RUNTIME
Error Code: INVALID_STATE
Reason: Failed to reattach current thread to JVM.
Retriable: False
Function: getLocalJNIEnv
File: /home/wanggang.terry/velox4j/src/main/cpp/main/velox4j/jni/JniCommon.cc
Line: 136
Stack trace:
# 0 facebook::velox::VeloxException::VeloxException(char const*, unsigned long, char const*, std::basic_string_view<char, std::char_traits<char> >, std::basic_string_view<char, std::char_traits<char> >, std::basic_string_view<char, std::char_traits<char> >, std::basic_string_view<char, std::char_traits<char> >, bool, facebook::velox::VeloxException::Type, std::basic_string_view<char, std::char_traits<char> >)
# 1 void facebook::velox::detail::veloxCheckFail<facebook::velox::VeloxRuntimeError, char const*>(facebook::velox::detail::VeloxCheckFailArgs const&, char const*)
# 2 velox4j::getLocalJNIEnv()
# 3 velox4j::DownIterator::close()
# 4 velox4j::DownIterator::~DownIterator()
# 5 std::_Hashtable<unsigned int, std::pair<unsigned int const, std::shared_ptr<void> >, std::allocator<std::pair<unsigned int const, std::shared_ptr<void> > >, std::__detail::_Select1st, std::equal_to<unsigned int>, std::hash<unsigned int>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<false, false, true> >::_M_erase(unsigned long, std::__detail::_Hash_node_base*, std::__detail::_Hash_node<std::pair<unsigned int const, std::shared_ptr<void> >, false>*)
# 6 velox4j::ResourceMap<std::shared_ptr<void> >::erase(unsigned int)
# 7 velox4j::ObjectStore::~ObjectStore()
# 8 velox4j::ObjectStore::~ObjectStore()
# 9 std::_Hashtable<unsigned int, std::pair<unsigned int const, std::shared_ptr<void> >, std::allocator<std::pair<unsigned int const, std::shared_ptr<void> > >, std::__detail::_Select1st, std::equal_to<unsigned int>, std::hash<unsigned int>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<false, false, true> >::_M_erase(unsigned long, std::__detail::_Hash_node_base*, std::__detail::_Hash_node<std::pair<unsigned int const, std::shared_ptr<void> >, false>*)
# 10 velox4j::ResourceMap<std::shared_ptr<void> >::erase(unsigned int)
# 11 velox4j::ObjectStore::~ObjectStore()
# 12 velox4j::ObjectStore::~ObjectStore()
# 13 0x00000000000468a7
# 14 on_exit
# 15 0x000000000086fd1e
# 16 0x0000000000e9e9bd
# 17 0x0000000000e9e4a0
# 18 0x0000000000ea4597
# 19 0x0000000000ea4bd0
# 20 0x0000000000ea4f36
# 21 0x0000000000e2f5c0
# 22 0x0000000000bed07e
# 23 start_thread
# 24 clone
W0522 14:16:44.193984 127767 ObjectStore.cc:34] Unclosed object [Store ID: 17, Resource handle ID: 5, Description: N7velox4j18StatefulSerialTaskE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
I0522 14:16:44.194094 127767 Task.cpp:2307] Terminating task Task - EID 3 with state Finished after running for 0ms
W0522 14:16:44.194274 127767 ObjectStore.cc:34] Unclosed object [Store ID: 17, Resource handle ID: 4, Description: N7velox4j21StatefulQueryExecutorE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
W0522 14:16:44.194311 127767 ObjectStore.cc:34] Unclosed object [Store ID: 4, Resource handle ID: 18, Description: N7velox4j7SessionE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
W0522 14:16:44.194317 127767 ObjectStore.cc:34] Unclosed object [Store ID: 16, Resource handle ID: 5, Description: N7velox4j18StatefulSerialTaskE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
I0522 14:16:44.194362 127767 Task.cpp:2307] Terminating task Task - EID 2 with state Finished after running for 0ms
W0522 14:16:44.194386 127767 ObjectStore.cc:34] Unclosed object [Store ID: 16, Resource handle ID: 4, Description: N7velox4j21StatefulQueryExecutorE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
W0522 14:16:44.194407 127767 ObjectStore.cc:34] Unclosed object [Store ID: 4, Resource handle ID: 14, Description: N7velox4j7SessionE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
W0522 14:16:44.194412 127767 ObjectStore.cc:34] Unclosed object [Store ID: 12, Resource handle ID: 5, Description: N7velox4j18StatefulSerialTaskE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
I0522 14:16:44.194434 127767 Task.cpp:2307] Terminating task Task - EID 1 with state Finished after running for 0ms
W0522 14:16:44.194454 127767 ObjectStore.cc:34] Unclosed object [Store ID: 12, Resource handle ID: 4, Description: N7velox4j21StatefulQueryExecutorE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
W0522 14:16:44.194463 127767 ObjectStore.cc:34] Unclosed object [Store ID: 4, Resource handle ID: 12, Description: N7velox4j7SessionE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
W0522 14:16:44.194469 127767 ObjectStore.cc:34] Unclosed object [Store ID: 10, Resource handle ID: 5, Description: N7velox4j18StatefulSerialTaskE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
I0522 14:16:44.194496 127767 Task.cpp:2307] Terminating task Task - EID 0 with state Finished after running for 0ms
W0522 14:16:44.194511 127767 ObjectStore.cc:34] Unclosed object [Store ID: 10, Resource handle ID: 4, Description: N7velox4j21StatefulQueryExecutorE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
W0522 14:16:44.194523 127767 ObjectStore.cc:34] Unclosed object [Store ID: 4, Resource handle ID: 11, Description: N7velox4j13MemoryManagerE] is found when object store is closing. Velox4J will destroy it automatically but it's recommended to manually close the object through the Java API CppObject#close() after use, to minimize peak memory pressure of the application.
E0522 14:16:44.194545 127767 Exceptions.h:66] Line: /home/wanggang.terry/velox4j/src/main/cpp/main/velox4j/jni/JniCommon.cc:136, Function:getLocalJNIEnv, Expression: Failed to reattach current thread to JVM., Source: RUNTIME, ErrorCode: INVALID_STATE
W0522 14:16:44.194622 127767 ExceptionTracer.cpp:187] Invalid trace stack for exception of type: facebook::velox::VeloxRuntimeError
terminate called after throwing an instance of 'facebook::velox::VeloxRuntimeError'
what(): Exception: VeloxRuntimeError
Error Source: RUNTIME
Error Code: INVALID_STATE
Reason: Failed to reattach current thread to JVM.
Retriable: False
Function: getLocalJNIEnv
File: /home/wanggang.terry/velox4j/src/main/cpp/main/velox4j/jni/JniCommon.cc
Line: 136
Stack trace:
# 0 facebook::velox::VeloxException::VeloxException(char const*, unsigned long, char const*, std::basic_string_view<char, std::char_traits<char> >, std::basic_string_view<char, std::char_traits<char> >, std::basic_string_view<char, std::char_traits<char> >, std::basic_string_view<char, std::char_traits<char> >, bool, facebook::velox::VeloxException::Type, std::basic_string_view<char, std::char_traits<char> >)
# 1 void facebook::velox::detail::veloxCheckFail<facebook::velox::VeloxRuntimeError, char const*>(facebook::velox::detail::VeloxCheckFailArgs const&, char const*)
# 2 velox4j::getLocalJNIEnv()
# 3 velox4j::JavaAllocationListener::allocationChanged(long)
# 4 velox4j::(anonymous namespace)::ListenableArbitrator::removePool(facebook::velox::memory::MemoryPool*)
# 5 facebook::velox::memory::MemoryManager::dropPool(facebook::velox::memory::MemoryPool*)
# 6 facebook::velox::memory::MemoryPoolImpl::~MemoryPoolImpl()
# 7 velox4j::MemoryManager::tryDestruct()
# 8 velox4j::MemoryManager::~MemoryManager()
# 9 std::_Hashtable<unsigned int, std::pair<unsigned int const, std::shared_ptr<void> >, std::allocator<std::pair<unsigned int const, std::shared_ptr<void> > >, std::__detail::_Select1st, std::equal_to<unsigned int>, std::hash<unsigned int>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<false, false, true> >::_M_erase(unsigned long, std::__detail::_Hash_node_base*, std::__detail::_Hash_node<std::pair<unsigned int const, std::shared_ptr<void> >, false>*)
# 10 velox4j::ResourceMap<std::shared_ptr<void> >::erase(unsigned int)
# 11 velox4j::ObjectStore::~ObjectStore()
# 12 velox4j::ObjectStore::~ObjectStore()
# 13 0x00000000000468a7
# 14 on_exit
# 15 0x000000000086fd1e
# 16 0x0000000000e9e9bd
# 17 0x0000000000e9e4a0
# 18 0x0000000000ea4597
# 19 0x0000000000ea4bd0
# 20 0x0000000000ea4f36
# 21 0x0000000000e2f5c0
# 22 0x0000000000bed07e
# 23 start_thread
# 24 clone
Aborted (core dumped)
Results :
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 22.979 s
[INFO] Finished at: 2025-05-22T14:16:44+08:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12.4:test (default-test) on project velox4j: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.12.4:test failed: The forked VM terminated without saying properly goodbye. VM crash or System.exit called ? -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
```
2. skip tests and run `mvn clean install -DskipTests`
```
[INFO] --- maven-gpg-plugin:3.2.7:sign (sign-artifacts) @ velox4j ---
[INFO] Signer 'gpg' is signing 4 files with key B63AD11C6D45C37BFD6379B248804000454F1974
gpg: skipped "B63AD11C6D45C37BFD6379B248804000454F1974": No secret key
gpg: signing failed: No secret key
```
### System information
Gluten Version: 1.5.0-SNAPSHOT
Commit: 995860eaf904b281ecd940e280190038b931d8f7
CMake Version: 3.28.3
System: Linux-5.4.143.bsk.8-amd64
Arch: x86_64
CPU Name: Model name: Intel(R) Xeon(R) Platinum 8336C CPU @ 2.30GHz
C++ Compiler: /usr/bin/c++
C++ Compiler Version: 10.3.0
C Compiler: /usr/bin/cc
C Compiler Version: 10.3.0
CMake Prefix Path: /usr/local;/usr;/;/usr/local/lib/python3.8/dist-packages/cmake/data;/usr/local;/usr/X11R6;/usr/pkg;/opt
### CMake log
```bash
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [FLINK]Build velox4j exception encountered when as docs instruction [incubator-gluten]
Posted by "zjuwangg (via GitHub)" <gi...@apache.org>.
zjuwangg commented on issue #9726:
URL: https://github.com/apache/incubator-gluten/issues/9726#issuecomment-2900199559
@zhztheplayer @shuai-xu @zhanglistar please help have a look :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [FLINK]Build velox4j exception encountered when as docs instruction [incubator-gluten]
Posted by "zhztheplayer (via GitHub)" <gi...@apache.org>.
zhztheplayer commented on issue #9726:
URL: https://github.com/apache/incubator-gluten/issues/9726#issuecomment-2900569491
> However, the build stability of the bigo-sg/velox4g/gluten projects currently leaves considerable room for improvement.
Yes, I second this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [FLINK]Build velox4j exception encountered when as docs instruction [incubator-gluten]
Posted by "zhztheplayer (via GitHub)" <gi...@apache.org>.
zhztheplayer commented on issue #9726:
URL: https://github.com/apache/incubator-gluten/issues/9726#issuecomment-2900374267
The issues are expected with `bigo-sg/velox4j/gluten`. The fork has UTs failing and code style violations. I was using something like `-DskipTests -Dspoteless.skip` to bypass these failures.
For issue 2, it's now required to specify `-Dgpg.skip` to avoid the error, the same applies to `velox4j/velox4j`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [FLINK]Build velox4j exception encountered when as docs instruction [incubator-gluten]
Posted by "zjuwangg (via GitHub)" <gi...@apache.org>.
zjuwangg commented on issue #9726:
URL: https://github.com/apache/incubator-gluten/issues/9726#issuecomment-2900424410
> The issues are expected with `bigo-sg/velox4j/gluten`. The fork has UTs failing and code style violations. I was using something like `-DskipTests -Dspoteless.skip` to bypass these failures.
>
> For issue 2, it's now required to specify `-Dgpg.skip` to avoid the error, the same applies to `velox4j/velox4j`
Thanks @zhztheplayer.
I skip the test / gpg check / code style check and finally worked.
However, the build stability of the **bigo-sg/velox4g/gluten** projects currently leaves considerable room for improvement.
cc @shuai-xu @zhanglistar
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org