You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by GitBox <gi...@apache.org> on 2023/01/06 20:08:56 UTC
[GitHub] [arrow-julia] Moelf opened a new issue, #373: Addtional `Missing` gets injected into Schema
Moelf opened a new issue, #373:
URL: https://github.com/apache/arrow-julia/issues/373
```julia
julia> rnt.vector_variant_int64_string
5-element RNTupleField{Vector{Union{Int64, String}}}:
Union{Int64, String}["one"]
Union{Int64, String}["one", 2]
Union{Int64, String}["one", 2, 3]
Union{Int64, String}["one", 2, 3, 4]
Union{Int64, String}["one", 2, 3, 4, 5]
julia> DataFrame(rnt).vector_variant_int64_string
5-element Vector{Vector{Union{Int64, String}}}:
["one"]
["one", 2]
["one", 2, 3]
["one", 2, 3, 4]
["one", 2, 3, 4, 5]
julia> Arrow.write(a, DataFrame(rnt))
"/tmp/jl_Lk5W1G92XO"
julia> Arrow.Table(a)
Arrow.Table with 5 rows, 13 columns, and schema:
:string String
:vector_int32 Vector{Int32} (alias for Array{Int32, 1})
:array_float Vector{Float32} (alias for Array{Float32, 1})
:vector_vector_int32 Vector{Vector{Int32}} (alias for Array{Array{Int32, 1}, 1})
:vector_string Vector{String} (alias for Array{String, 1})
:vector_vector_string Vector{Vector{String}} (alias for Array{Array{String, 1}, 1})
:variant_int32_string Union{Missing, Int32, String}
:vector_variant_int64_string Vector{Union{Missing, Int64, String}} (alias for Array{Union{Missing, Int64, String}, 1})
:tuple_int32_string NamedTuple{(:_0, :_1), Tuple{Int32, String}}
:pair_int32_string NamedTuple{(:_0, :_1), Tuple{Int32, String}}
:vector_tuple_int32_string Vector{NamedTuple{(:_0, :_1), Tuple{Int32, String}}} (alias for Array{NamedTuple{(:_0, :_1), Tuple{Int32, String}}, 1})
:lorentz_vector NamedTuple{(:pt, :eta, :phi, :mass), NTuple{4, Float32}}
:array_lv Vector{NamedTuple{(:pt, :eta, :phi, :mass), NTuple{4, Float32}}} (alias for Array{NamedTuple{(:pt, :eta, :phi, :mass), NTuple{4, Float32}}, 1})
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-julia] quinnj commented on issue #373: Addtional `Missing` gets injected into Schema
Posted by GitBox <gi...@apache.org>.
quinnj commented on issue #373:
URL: https://github.com/apache/arrow-julia/issues/373#issuecomment-1374638211
Hmmmm, yes, I think I remember that for the Union types, the arrow spec makes it hard because it always allows nulls, so we default to including `Missing` in the Union to account for this. We can/should figure out how to do this cleaner though.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-julia] Moelf commented on issue #373: Addtional `Missing` gets injected into Schema
Posted by GitBox <gi...@apache.org>.
Moelf commented on issue #373:
URL: https://github.com/apache/arrow-julia/issues/373#issuecomment-1374670910
I see, but for a column of `Vector{Union{T, T2}}` you don't need Missing right? because the empty element would just be a
```
Union{T,T2][]
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Addtional `Missing` gets injected into Schema [arrow-julia]
Posted by "Moelf (via GitHub)" <gi...@apache.org>.
Moelf commented on issue #373:
URL: https://github.com/apache/arrow-julia/issues/373#issuecomment-1922237623
corretness bug, bump?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org