You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2021/09/21 07:28:02 UTC
[GitHub] [arrow] oss-maker opened a new issue #11195: Question: Can arrow be used to load a parquet file from an Azure blob store (abfs://) using Arrow cpp
oss-maker opened a new issue #11195:
URL: https://github.com/apache/arrow/issues/11195
I'm trying to read a parquet file from azure data lake storage gen 2 (abfss://) using the cpp sdk.
If the above is not possible, if I am able to open a stream to the abfs storage, can this input stream be used as input to the parquet cpp reader?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] emkornfield closed issue #11195: Question: Can arrow be used to load a parquet file from an Azure blob store (abfs://) using Arrow cpp
Posted by GitBox <gi...@apache.org>.
emkornfield closed issue #11195:
URL: https://github.com/apache/arrow/issues/11195
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] jorisvandenbossche commented on issue #11195: Question: Can arrow be used to load a parquet file from an Azure blob store (abfs://) using Arrow cpp
Posted by GitBox <gi...@apache.org>.
jorisvandenbossche commented on issue #11195:
URL: https://github.com/apache/arrow/issues/11195#issuecomment-923865746
The C++ filesystem implementation does not yet have support for Azure, so it's not possible to do this directly.
There is an open issue about this: https://issues.apache.org/jira/browse/ARROW-2034
If you can open the file yourself and get a seekable stream, then probably yes: you can create a Parquet FileReader from a RandomAccessFile, see https://arrow.apache.org/docs/cpp/parquet.html#filereader
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org