You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "schlichtanders (via GitHub)" <gi...@apache.org> on 2024/01/18 10:15:40 UTC
[I] copy does not copy to standard Julia Types [arrow-julia]
schlichtanders opened a new issue, #495:
URL: https://github.com/apache/arrow-julia/issues/495
While the documentation says that a copy would ensure to have normal Julia Types
> df = copy(DataFrame(Arrow.Table(file))): Build a [DataFrame](https://juliadata.github.io/DataFrames.jl/stable/), where the columns are regular in-memory vectors (specifically, Base.Vectors and/or PooledVectors). This requires that you have enough memory to load the entire DataFrame into memory.
this is not the case
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] copy does not copy to standard Julia Types [arrow-julia]
Posted by "Moelf (via GitHub)" <gi...@apache.org>.
Moelf commented on issue #495:
URL: https://github.com/apache/arrow-julia/issues/495#issuecomment-1908147021
Because you extracted just a column, which is not a data frame, so copy specialized for data frame doesn't work
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] copy does not copy to standard Julia Types [arrow-julia]
Posted by "ericphanson (via GitHub)" <gi...@apache.org>.
ericphanson commented on issue #495:
URL: https://github.com/apache/arrow-julia/issues/495#issuecomment-1908158279
Maybe `collect` is what's desired here, for materializing a column into a `Vector`? Naively `collect` should be "iterate this collection into an `Array`", though I haven't tried it in this case
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] copy does not copy to standard Julia Types [arrow-julia]
Posted by "ericphanson (via GitHub)" <gi...@apache.org>.
ericphanson commented on issue #495:
URL: https://github.com/apache/arrow-julia/issues/495#issuecomment-1908154831
I think the other answer is because (if I understand correctly) it's a DataFrames.jl feature, not an Arrow.jl feature, it's just documented here because it's a common ask
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] copy does not copy to standard Julia Types [arrow-julia]
Posted by "schlichtanders (via GitHub)" <gi...@apache.org>.
schlichtanders commented on issue #495:
URL: https://github.com/apache/arrow-julia/issues/495#issuecomment-1907709655
Interesting, could be, but then, why are only DataFrames supported for copy and not regular Arrays?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] copy does not copy to standard Julia Types [arrow-julia]
Posted by "Moelf (via GitHub)" <gi...@apache.org>.
Moelf commented on issue #495:
URL: https://github.com/apache/arrow-julia/issues/495#issuecomment-1898530594
maybe that's because `result_old[!, "workers"]` is not a `::DataFrame`?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org