You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@gluten.apache.org by "jinchengchenghh (via GitHub)" <gi...@apache.org> on 2025/06/10 07:30:05 UTC
[I] Pass TPCH [incubator-gluten]
jinchengchenghh opened a new issue, #9932:
URL: https://github.com/apache/incubator-gluten/issues/9932
### Description
Supported status for SF 1
```
Summary: 14 out of 22 queries passed.
| Query ID | Passed | Row Count | Planning Time (Millis) | Query Time (Millis) | Speedup |
| | | Vanilla | Gluten | Vanilla | Gluten | Vanilla | Gluten | |
|----------|--------|---------|--------|------------|------------|-----------|-----------|---------|
| q2| true| 100| 100| 411| 390| 2549| 1083| 135.36%|
| q3| true| 10| 10| 36| 118| 3132| 1264| 147.78%|
| q4| true| 5| 5| 37| 107| 2833| 1095| 158.72%|
| q5| true| 5| 5| 74| 198| 4896| 2150| 127.72%|
| q6| true| 1| 1| 24| 46| 678| 319| 112.54%|
| q10| true| 20| 20| 45| 175| 3317| 1436| 130.99%|
| q11| true| 1048| 1048| 70| 138| 1019| 722| 41.14%|
| q13| true| 42| 42| 22| 87| 3717| 1027| 261.93%|
| q14| true| 1| 1| 15| 62| 989| 608| 62.66%|
| q15| true| 1| 1| 61| 89| 1813| 922| 96.64%|
| q16| true| 18314| 18314| 33| 98| 1380| 659| 109.41%|
| q18| true| 57| 57| 37| 143| 6772| 1883| 259.64%|
| q19| true| 1| 1| 22| 70| 1459| 701| 108.13%|
| q21| true| 100| 100| 57| 582| 9361| 3228| 189.99%|
| all| true| 19705| 19705| 944| 2303| 43915| 17097| 156.86%|
Failed queries (a failed query with correct row count indicates value mismatches):
| Query ID | Passed | Row Count | Planning Time (Millis) | Query Time (Millis) | Speedup |
| | | Vanilla | Gluten | Vanilla | Gluten | Vanilla | Gluten | |
|----------|--------|---------|--------|------------|------------|-----------|-----------|---------|
| q1| false| 4| N/A| 177| N/A| 4096| N/A| N/A|
| q7| false| 4| N/A| 83| N/A| 3852| N/A| N/A|
| q8| false| 2| N/A| 87| N/A| 2420| N/A| N/A|
| q9| false| 175| N/A| 43| N/A| 3971| N/A| N/A|
| q12| false| 2| N/A| 22| N/A| 2149| N/A| N/A|
| q17| false| 1| N/A| 31| N/A| 2941| N/A| N/A|
| q20| false| 186| N/A| 81| N/A| 1599| N/A| N/A|
| q22| false| 7| N/A| 45| N/A| 1294| N/A| N/A|
```
There are 4 issues:
```
Error Code: INVALID_STATE
Reason: Cannot change vector type from ROW<"0":VARCHAR,"1":INTEGER> to ROW<n0_0:VARCHAR,n1_1:BIGINT>. The old and new types can be different logical types, but the underlying physical types must match.
Retriable: False
Expression: type_->kindEquals(type)
Context: Operator: CudfToVelox[1-to-velox] 3
Function: setType
File: /opt/gluten/dev/../ep/build-velox/build/velox_ep/velox/vector/BaseVector.h
Exception: VeloxRuntimeError
Error Source: RUNTIME
Error Code: INVALID_STATE
Reason: Field not found, col_0
Retriable: False
Function: pushExprToTree
File: /opt/gluten/ep/build-velox/build/velox_ep/velox/experimental/cudf/exec/ExpressionEvaluator.cpp
Line: 523
Caused by: org.apache.gluten.exception.GlutenException: Error during calling Java code from native code: org.apache.gluten.exception.GlutenException: org.apache.gluten.exception.GlutenException: Exception: VeloxRuntimeError
Error Source: RUNTIME
Error Code: INVALID_STATE
Reason: Unsupported expression: try_cast
Retriable: False
Function: pushExprToTree
File: /opt/gluten/ep/build-velox/build/velox_ep/velox/experimental/cudf/exec/ExpressionEvaluator.cpp
Line: 526
Stack trace:
# 0 _ZN8facebook5velox7process10StackTraceC1Ei
06:22:37.403 [Executor task launch worker for task 2.0 in stage 107.0 (TID 645)] ERROR org.apache.spark.executor.Executor - Exception in task 2.0 in stage 107.0 (TID 645)
org.apache.gluten.exception.GlutenException: org.apache.gluten.exception.GlutenException: Error during calling Java code from native code: org.apache.gluten.exception.GlutenException: org.apache.gluten.exception.GlutenException: Exception: VeloxRuntimeError
Error Source: RUNTIME
Error Code: NOT_IMPLEMENTED
Reason: Unsupported switch complex operation switch(or(equalto(n3_5, 1-URGENT:VARCHAR), equalto(n3_5, 2-HIGH:VARCHAR)), 1:INTEGER, 0:INTEGER)
Retriable: False
Function: pushExprToTree
File: /opt/gluten/ep/build-velox/build/velox_ep/velox/experimental/cudf/exec/ExpressionEvaluator.cpp
Line: 461
Stack trace:
# 0 _ZN8facebook5velox7process10StackTraceC1Ei
```
### Gluten version
None
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] Pass TPCH [incubator-gluten]
Posted by "jinchengchenghh (via GitHub)" <gi...@apache.org>.
jinchengchenghh commented on issue #9932:
URL: https://github.com/apache/incubator-gluten/issues/9932#issuecomment-2964711383
try_cast is fixed by https://github.com/rapidsai/velox/pull/32
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] Pass TPCH [incubator-gluten]
Posted by "jinchengchenghh (via GitHub)" <gi...@apache.org>.
jinchengchenghh commented on issue #9932:
URL: https://github.com/apache/incubator-gluten/issues/9932#issuecomment-2964711774
switch complex data type is fixed by https://github.com/rapidsai/velox/pull/33
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] Pass TPCH [incubator-gluten]
Posted by "jinchengchenghh (via GitHub)" <gi...@apache.org>.
jinchengchenghh commented on issue #9932:
URL: https://github.com/apache/incubator-gluten/issues/9932#issuecomment-2965705154
For Q7, the year type returns integer while presto returns int64_t and cudf returns smallint, but I don't find a operator to cast column to int32, there is only CAST_TO_INT64, we may need to add CAST_TO_INT32 like this one?https://github.com/rapidsai/cudf/pull/9379/files, or cast the function result.
```
-- Project[16][expressions: (n16_7:VARCHAR, "n15_11"), (n16_8:VARCHAR, "n15_13"), (n16_9:INTEGER, year("n15_9")), (n16_10:DOUBLE, multiply("n15_7",subtract(1,"n15_8")))] -> n16_7:VARCHAR, n16_8:VARCHAR, n16_9:INTEGER, n16_10:DOUBLE
Cannot change vector type from ROW<"0":VARCHAR,"1":VARCHAR,"2":SMALLINT,"3":DOUBLE> to ROW<n16_7:VARCHAR,n16_8:VARCHAR,n16_9:INTEGER,n17_3:DOUBLE>. The old and new types can be different logical types, but the underlying physical types must match.
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [VL] Pass TPCH on GPU backend [incubator-gluten]
Posted by "jinchengchenghh (via GitHub)" <gi...@apache.org>.
jinchengchenghh commented on issue #9932:
URL: https://github.com/apache/incubator-gluten/issues/9932#issuecomment-2986659511
Q15 returns 0 row when decimal as double is accepted result
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] Pass TPCH [incubator-gluten]
Posted by "jinchengchenghh (via GitHub)" <gi...@apache.org>.
jinchengchenghh commented on issue #9932:
URL: https://github.com/apache/incubator-gluten/issues/9932#issuecomment-2966011351
Q15 result mismatch
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] Pass TPCH [incubator-gluten]
Posted by "jinchengchenghh (via GitHub)" <gi...@apache.org>.
jinchengchenghh commented on issue #9932:
URL: https://github.com/apache/incubator-gluten/issues/9932#issuecomment-2964712826
Field not found is under progress with https://github.com/rapidsai/velox/pull/31
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] Pass TPCH [incubator-gluten]
Posted by "jinchengchenghh (via GitHub)" <gi...@apache.org>.
jinchengchenghh commented on issue #9932:
URL: https://github.com/apache/incubator-gluten/issues/9932#issuecomment-2964720803
Some of `Cannot change vector type` is fixed by https://github.com/rapidsai/velox/pull/29
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [VL] Pass TPCH on GPU backend [incubator-gluten]
Posted by "jinchengchenghh (via GitHub)" <gi...@apache.org>.
jinchengchenghh commented on issue #9932:
URL: https://github.com/apache/incubator-gluten/issues/9932#issuecomment-2975152337
Q15 result mismatch sometimes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [VL] Pass TPCH on GPU backend [incubator-gluten]
Posted by "jinchengchenghh (via GitHub)" <gi...@apache.org>.
jinchengchenghh closed issue #9932: [VL] Pass TPCH on GPU backend
URL: https://github.com/apache/incubator-gluten/issues/9932
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org