You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/04/25 03:03:13 UTC

[GitHub] [beam] nguyennk92 commented on pull request #17347: [BEAM-14304] implement parquetio to read/write parquet files

nguyennk92 commented on PR #17347:
URL: https://github.com/apache/beam/pull/17347#issuecomment-1108017052

   > Expanding the filesystem to support a *Seeker variant for reading is a great idea. We might not always be able to get an efficient implementation (it'll depend on the underlying filesystem), but we can always implement the inefficient approach (actually reading the data to get to the desired spot) as a stop gap if needed.
   
   Yes, I'm working on that idea, basically the only obstacle is having `gcs` to return a `io.ReadCloseSeeker` for `OpenRead`. I kinda have an "inefficient solution". I will make another PR for that alone, as it was not trivial I think. I'm reading the Java version for ideas to implement a Seeker variant with more efficiency


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org