You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@arrow.apache.org by Frederic Branczyk <fb...@gmail.com> on 2021/12/05 18:04:01 UTC
[Go] Cannot find pqarrow module
Hello,
I was reading through the Go Arrow documentation, and in particular I was
searching for parquet to arrow (and vice versa) conversion, when I stumbled
upon this line:
https://github.com/apache/arrow/blob/5bacdeaf290e833948e002e529a7ef070c8577e6/go/parquet/doc.go#L44
It describes that there is a module called "pqarrow" but even after
searching through the whole repository and extensive google searching I
couldn't find this.
What am I missing? Did this potentially move and the docs just need some
updating? If so, where did they move to?
Best regards,
Frederic
RE: [Go] Cannot find pqarrow module
Posted by Matthew Topol <mt...@factset.com>.
Awesome thanks much! So far the only usage of that has been internally at work where I developed it and it’s worked very well for us so far (which is what led to me contributing the Parquet library in the first place). So any feedback on it is much appreciated and will absolutely be taken into account!
Same goes for any questions you may happen across when trying to use it! Looking forward to any feedback you may have, and feel free to ask any other questions you may come across when using the library. Make sure you’re using the github.com/apache/arrow/go/v6/…. Import paths for the most recent release, and the v7 if you want to use the bleeding edge (which you’d need if you point it at my branch).
From: Frederic Branczyk <fb...@gmail.com>
Sent: Monday, December 6, 2021 11:12 AM
To: user@arrow.apache.org
Subject: Re: [Go] Cannot find pqarrow module
Ah great thank you! We’re still very early in our journey with arrow and parquet, so this is not a problem at all, and if we get to it before the PR is merged we will definitely let you know our thoughts and experiences with your branch!
Ah great thank you! We’re still very early in our journey with arrow and parquet, so this is not a problem at all, and if we get to it before the PR is merged we will definitely let you know our thoughts and experiences with your branch!
On Mon 6. Dec 2021 at 16:24, Matthew Topol <mt...@factset.com>> wrote:
Hey Frederic,
Currently the Parquet packages for Go Arrow are still in the process of getting code reviewed and submitted. The “pqarrow” module is actually the next, and last, piece to get reviewed and merged once this PR (https://github.com/apache/arrow/pull/11538<https://urldefense.com/v3/__https:/github.com/apache/arrow/pull/11538__;!!PBKjc0U4!aM6D646sg-IKL_dw3n5Z4yWd03h7zJx8KyEdDr9kQSGLSoeU_e-uOQmb6kgGGbY$>) is finally approved and merged. For the time being, if you want to test it out, you can run this command in your local development:
`go mod edit -replace github.com/apache/arrow/go=github.com/zeroshade/arrow/go@parquet-pqarrow`<mailto:github.com/apache/arrow/go=github.com/zeroshade/arrow/go@parquet-pqarrow%60>
That will pull down my working branch which you can play with and test (but I don’t recommend using it in anything production yet) until it gets merged into the main repo.
Sorry for the confusion and inconvenience.
--Matt
From: Frederic Branczyk <fb...@gmail.com>>
Sent: Sunday, December 5, 2021 1:04 PM
To: user@arrow.apache.org<ma...@arrow.apache.org>
Subject: [Go] Cannot find pqarrow module
Hello, I was reading through the Go Arrow documentation, and in particular I was searching for parquet to arrow (and vice versa) conversion, when I stumbled upon this line: https://github.com/apache/arrow/blob/5bacdeaf290e833948e002e529a7ef070c8577e6/go/parquet/doc.go#L44<https://urldefense.com/v3/__https:/github.com/apache/arrow/blob/5bacdeaf290e833948e002e529a7ef070c8577e6/go/parquet/doc.go*L44__;Iw!!PBKjc0U4!aM6D646sg-IKL_dw3n5Z4yWd03h7zJx8KyEdDr9kQSGLSoeU_e-uOQmbeh990vI$>
Hello,
I was reading through the Go Arrow documentation, and in particular I was searching for parquet to arrow (and vice versa) conversion, when I stumbled upon this line:
https://github.com/apache/arrow/blob/5bacdeaf290e833948e002e529a7ef070c8577e6/go/parquet/doc.go#L44<https://urldefense.com/v3/__https:/github.com/apache/arrow/blob/5bacdeaf290e833948e002e529a7ef070c8577e6/go/parquet/doc.go*L44__;Iw!!PBKjc0U4!f9yrpu3EDlQmJHhfKD0EBBCO84k5PHxIBd9ga64wO9TVk0unQwk0xkVnOJX5Dwo$>
It describes that there is a module called "pqarrow" but even after searching through the whole repository and extensive google searching I couldn't find this.
What am I missing? Did this potentially move and the docs just need some updating? If so, where did they move to?
Best regards,
Frederic
Re: [Go] Cannot find pqarrow module
Posted by Frederic Branczyk <fb...@gmail.com>.
Ah great thank you! We’re still very early in our journey with arrow and
parquet, so this is not a problem at all, and if we get to it before the PR
is merged we will definitely let you know our thoughts and experiences with
your branch!
On Mon 6. Dec 2021 at 16:24, Matthew Topol <mt...@factset.com> wrote:
> Hey Frederic,
>
>
>
> Currently the Parquet packages for Go Arrow are still in the process of
> getting code reviewed and submitted. The “pqarrow” module is actually the
> next, and last, piece to get reviewed and merged once this PR (
> https://github.com/apache/arrow/pull/11538) is finally approved and
> merged. For the time being, if you want to test it out, you can run this
> command in your local development:
>
>
>
> `go mod edit -replace
> github.com/apache/arrow/go=github.com/zeroshade/arrow/go@parquet-pqarrow`
>
>
>
> That will pull down my working branch which you can play with and test
> (but I don’t recommend using it in anything production yet) until it gets
> merged into the main repo.
>
>
>
> Sorry for the confusion and inconvenience.
>
>
>
> --Matt
>
>
>
> *From:* Frederic Branczyk <fb...@gmail.com>
> *Sent:* Sunday, December 5, 2021 1:04 PM
> *To:* user@arrow.apache.org
> *Subject:* [Go] Cannot find pqarrow module
>
>
>
> Hello, I was reading through the Go Arrow documentation, and in particular
> I was searching for parquet to arrow (and vice versa) conversion, when I
> stumbled upon this line:
> https://github.com/apache/arrow/blob/5bacdeaf290e833948e002e529a7ef070c8577e6/go/parquet/doc.go#L44
>
> Hello,
>
>
>
> I was reading through the Go Arrow documentation, and in particular I was
> searching for parquet to arrow (and vice versa) conversion, when I stumbled
> upon this line:
>
>
>
>
> https://github.com/apache/arrow/blob/5bacdeaf290e833948e002e529a7ef070c8577e6/go/parquet/doc.go#L44
> <https://urldefense.com/v3/__https:/github.com/apache/arrow/blob/5bacdeaf290e833948e002e529a7ef070c8577e6/go/parquet/doc.go*L44__;Iw!!PBKjc0U4!f9yrpu3EDlQmJHhfKD0EBBCO84k5PHxIBd9ga64wO9TVk0unQwk0xkVnOJX5Dwo$>
>
>
>
> It describes that there is a module called "pqarrow" but even after
> searching through the whole repository and extensive google searching I
> couldn't find this.
>
>
>
> What am I missing? Did this potentially move and the docs just need some
> updating? If so, where did they move to?
>
>
>
> Best regards,
>
> Frederic
>
RE: [Go] Cannot find pqarrow module
Posted by Matthew Topol <mt...@factset.com>.
Hey Frederic,
Currently the Parquet packages for Go Arrow are still in the process of getting code reviewed and submitted. The “pqarrow” module is actually the next, and last, piece to get reviewed and merged once this PR (https://github.com/apache/arrow/pull/11538) is finally approved and merged. For the time being, if you want to test it out, you can run this command in your local development:
`go mod edit -replace github.com/apache/arrow/go=github.com/zeroshade/arrow/go@parquet-pqarrow`<mailto:github.com/apache/arrow/go=github.com/zeroshade/arrow/go@parquet-pqarrow%60>
That will pull down my working branch which you can play with and test (but I don’t recommend using it in anything production yet) until it gets merged into the main repo.
Sorry for the confusion and inconvenience.
--Matt
From: Frederic Branczyk <fb...@gmail.com>
Sent: Sunday, December 5, 2021 1:04 PM
To: user@arrow.apache.org
Subject: [Go] Cannot find pqarrow module
Hello, I was reading through the Go Arrow documentation, and in particular I was searching for parquet to arrow (and vice versa) conversion, when I stumbled upon this line: https://github.com/apache/arrow/blob/5bacdeaf290e833948e002e529a7ef070c8577e6/go/parquet/doc.go#L44
Hello,
I was reading through the Go Arrow documentation, and in particular I was searching for parquet to arrow (and vice versa) conversion, when I stumbled upon this line:
https://github.com/apache/arrow/blob/5bacdeaf290e833948e002e529a7ef070c8577e6/go/parquet/doc.go#L44<https://urldefense.com/v3/__https:/github.com/apache/arrow/blob/5bacdeaf290e833948e002e529a7ef070c8577e6/go/parquet/doc.go*L44__;Iw!!PBKjc0U4!f9yrpu3EDlQmJHhfKD0EBBCO84k5PHxIBd9ga64wO9TVk0unQwk0xkVnOJX5Dwo$>
It describes that there is a module called "pqarrow" but even after searching through the whole repository and extensive google searching I couldn't find this.
What am I missing? Did this potentially move and the docs just need some updating? If so, where did they move to?
Best regards,
Frederic