You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2021/01/04 12:32:01 UTC

[GitHub] [arrow] jorisvandenbossche commented on issue #9026: Interpretation of underlying logic of pyarrow manipulate hive

jorisvandenbossche commented on issue #9026:
URL: https://github.com/apache/arrow/issues/9026#issuecomment-753949295


   > So at present, i must use pd.read_csv with the f returned by fs.open and retrieve schema info from mysql's TBLS where the detail schema info truly located of hive metastore. I think this design is not perfect.
   
   Arrow doesn't have functionality to natively interact with or understand hive metastores. So if you have a CSV file stored, and you want to read this following the schema stored in the hive metastore, then you will at the moment always need to do something manually like what you described above.
   
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org