You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2021/05/26 07:21:54 UTC

[GitHub] [arrow-rs] crepererum opened a new issue #368: Provide `Arc`-based constructor for `parquet::util::cursor::SliceableCursor`

crepererum opened a new issue #368:
URL: https://github.com/apache/arrow-rs/issues/368


   **Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
   As a user of `arrow-rs`, I would like to be able to inspect a parquet file stream that I have just created (e.g. to extract `ParquetMetadata`) before storing data to disk / cloud / anywhere else. To do so, I construct a `SliceableCursor` which I then feed into a `SerializedFileReader`. However, `SliceableCursor` takes its content as `Vec<u8>` even though it just uses an `Arc<Vec<u8>>` internally, so I'm required to copy the parquet data (`Vec<u8>`) just to inspect it.
   
   **Describe the solution you'd like**
   Allow `SliceableCursor` to be constructed from an `Arc` directly.
   
   **Describe alternatives you've considered**
   None.
   
   **Additional context**
   Downstream user is IOx, see [here](https://github.com/influxdata/influxdb_iox/blob/638d754e0f6fd2ff20e38f3b8d53d8f750a70986/parquet_file/src/metadata.rs#L183-L188). This issue affects `arrow-rs` commit `94a82cd5512a9cf9bc341100b862f2ff7f3ab159`.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-rs] jorgecarleitao closed issue #368: Provide `Arc`-based constructor for `parquet::util::cursor::SliceableCursor`

Posted by GitBox <gi...@apache.org>.

jorgecarleitao closed issue #368:
URL: https://github.com/apache/arrow-rs/issues/368


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-rs] crepererum commented on issue #368: Provide `Arc`-based constructor for `parquet::util::cursor::SliceableCursor`

Posted by GitBox <gi...@apache.org>.

crepererum commented on issue #368:
URL: https://github.com/apache/arrow-rs/issues/368#issuecomment-848532551


   I'm claiming this issue.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org