You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@gluten.apache.org by "taiyang-li (via GitHub)" <gi...@apache.org> on 2024/12/24 10:30:35 UTC
[I] [CH] Support case-insensitive column matching for fields in struct [incubator-gluten]
taiyang-li opened a new issue, #8324:
URL: https://github.com/apache/incubator-gluten/issues/8324
### Description
Query: d_8950.sql
```
header:appid Nullable(Int64) Nullable(size = 0, Int64(size = 0), UInt8(size = 0)), uidstat Nullable(Array(Nullable(Tuple(onlinetype Nullable(Int32))))) Nullable(size = 0, Array(size = 0, UInt64(size = 0), Nullable(size = 0, Tuple(size = 0, Nullable(size = 0, Int32(size = 0), UInt8(size = 0))), UInt8(size = 0))), UInt8(size = 0)) max_decoding_threads:1 max_io_threads:1 min_bytes_for_seek:8192
xxx headerappid Nullable(Int64) Nullable(size = 0, Int64(size = 0), UInt8(size = 0)), uidstat Nullable(Array(Nullable(Tuple(onlinetype Nullable(Int32))))) Nullable(size = 0, Array(size = 0, UInt64(size = 0), Nullable(size = 0, Tuple(size = 0, Nullable(size = 0, Int32(size = 0), UInt8(size = 0))), UInt8(size = 0))), UInt8(size = 0)) format_name:Parquet allow_missing_columns:1 null_as_default:1 case_insensitive_matching:1 is_stream:0
xxx arrow table:appId: int64
uidStat: list<item: struct<onlineType: int32 not null>>
child 0, item: struct<onlineType: int32 not null>
child 0, onlineType: int32 not null
old column:
i:0 value:[tuple(2), tuple(2), tuple(2), tuple(2)]
i:1 value:[tuple(2), tuple(2), tuple(2)]
i:2 value:[tuple(7)]
i:3 value:[tuple(2), tuple(2)]
i:4 value:[tuple(2)]
i:5 value:[tuple(2)]
i:6 value:[tuple(2), tuple(2)]
i:7 value:[tuple(2), tuple(2), tuple(2), tuple(2), tuple(2), tuple(2)]
i:8 value:[tuple(2), tuple(2), tuple(2)]
i:9 value:[tuple(2)]
cast from uidstat Nullable(Array(Nullable(Tuple(onlineType Int32)))) Nullable(size = 65409, Array(size = 65409, UInt64(size = 65409), Nullable(size = 798049, Tuple(size = 798049, Int32(size = 798049)), UInt8(size = 798049))), UInt8(size = 65409)) to Nullable(Array(Nullable(Tuple(onlinetype Nullable(Int32)))))
new column:
i:0 value:[tuple(NULL), tuple(NULL), tuple(NULL), tuple(NULL)]
i:1 value:[tuple(NULL), tuple(NULL), tuple(NULL)]
i:2 value:[tuple(NULL)]
i:3 value:[tuple(NULL), tuple(NULL)]
i:4 value:[tuple(NULL)]
i:5 value:[tuple(NULL)]
i:6 value:[tuple(NULL), tuple(NULL)]
i:7 value:[tuple(NULL), tuple(NULL), tuple(NULL), tuple(NULL), tuple(NULL), tuple(NULL)]
i:8 value:[tuple(NULL), tuple(NULL), tuple(NULL)]
i:9 value:[tuple(NULL)]
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [CH] Support case-insensitive column matching for fields in struct otherwise struct column read from orc/parquet would be wrong [incubator-gluten]
Posted by "taiyang-li (via GitHub)" <gi...@apache.org>.
taiyang-li closed issue #8324: [CH] Support case-insensitive column matching for fields in struct otherwise struct column read from orc/parquet would be wrong
URL: https://github.com/apache/incubator-gluten/issues/8324
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org