You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by GitBox <gi...@apache.org> on 2023/01/06 20:08:56 UTC

[GitHub] [arrow-julia] Moelf opened a new issue, #373: Addtional `Missing` gets injected into Schema

Moelf opened a new issue, #373:
URL: https://github.com/apache/arrow-julia/issues/373

   ```julia
   julia> rnt.vector_variant_int64_string
   5-element RNTupleField{Vector{Union{Int64, String}}}:
    Union{Int64, String}["one"]
    Union{Int64, String}["one", 2]
    Union{Int64, String}["one", 2, 3]
    Union{Int64, String}["one", 2, 3, 4]
    Union{Int64, String}["one", 2, 3, 4, 5]
   
   julia> DataFrame(rnt).vector_variant_int64_string
   5-element Vector{Vector{Union{Int64, String}}}:
    ["one"]
    ["one", 2]
    ["one", 2, 3]
    ["one", 2, 3, 4]
    ["one", 2, 3, 4, 5]
   
   julia> Arrow.write(a, DataFrame(rnt))
   "/tmp/jl_Lk5W1G92XO"
   
   julia> Arrow.Table(a)
   Arrow.Table with 5 rows, 13 columns, and schema:
    :string                       String
    :vector_int32                 Vector{Int32} (alias for Array{Int32, 1})
    :array_float                  Vector{Float32} (alias for Array{Float32, 1})
    :vector_vector_int32          Vector{Vector{Int32}} (alias for Array{Array{Int32, 1}, 1})
    :vector_string                Vector{String} (alias for Array{String, 1})
    :vector_vector_string         Vector{Vector{String}} (alias for Array{Array{String, 1}, 1})
    :variant_int32_string         Union{Missing, Int32, String}
    :vector_variant_int64_string  Vector{Union{Missing, Int64, String}} (alias for Array{Union{Missing, Int64, String}, 1})
    :tuple_int32_string           NamedTuple{(:_0, :_1), Tuple{Int32, String}}
    :pair_int32_string            NamedTuple{(:_0, :_1), Tuple{Int32, String}}
    :vector_tuple_int32_string    Vector{NamedTuple{(:_0, :_1), Tuple{Int32, String}}} (alias for Array{NamedTuple{(:_0, :_1), Tuple{Int32, String}}, 1})
    :lorentz_vector               NamedTuple{(:pt, :eta, :phi, :mass), NTuple{4, Float32}}
    :array_lv                     Vector{NamedTuple{(:pt, :eta, :phi, :mass), NTuple{4, Float32}}} (alias for Array{NamedTuple{(:pt, :eta, :phi, :mass), NTuple{4, Float32}}, 1})
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow-julia] quinnj commented on issue #373: Addtional `Missing` gets injected into Schema

Posted by GitBox <gi...@apache.org>.
quinnj commented on issue #373:
URL: https://github.com/apache/arrow-julia/issues/373#issuecomment-1374638211

   Hmmmm, yes, I think I remember that for the Union types, the arrow spec makes it hard because it always allows nulls, so we default to including `Missing` in the Union to account for this. We can/should figure out how to do this cleaner though.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow-julia] Moelf commented on issue #373: Addtional `Missing` gets injected into Schema

Posted by GitBox <gi...@apache.org>.
Moelf commented on issue #373:
URL: https://github.com/apache/arrow-julia/issues/373#issuecomment-1374670910

   I see, but for a column of `Vector{Union{T, T2}}` you don't need Missing right? because the empty element would just be a 
   ```
   Union{T,T2][]
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Addtional `Missing` gets injected into Schema [arrow-julia]

Posted by "Moelf (via GitHub)" <gi...@apache.org>.
Moelf commented on issue #373:
URL: https://github.com/apache/arrow-julia/issues/373#issuecomment-1922237623

   corretness bug, bump?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org