You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@orc.apache.org by "Alan Gates (JIRA)" <ji...@apache.org> on 2017/10/16 22:40:00 UTC
[jira] [Updated] (ORC-255) Add support for reading ACID2 files to
ORC
[ https://issues.apache.org/jira/browse/ORC-255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alan Gates updated ORC-255:
---------------------------
Description:
When ORC was split out of Hive the reading and writing of ACID files was left in Hive. This blocks non-Hive users from reading or writing ACID. I propose to add support for ACID to ORC.
At this point I only propose to add support for ACID 2 (that is, the version that will be released in Hive 3, which simplifies the storage to have only inserts and deletes (updates are an insert plus a delete)). Also, I am initially at least just adding support via the vector batch interface, not the row by row interface.
Also, note that to use this readers and writers would still have to interact with the Hive metastore to get a list of valid transactions and acquire appropriate locks.
was:
When ORC was split out of Hive the reading and writing of ACID files was left in Hive. This blocks non-Hive users from reading or writing ACID. I propose to add support for ACID to ORC.
At this point I only propose to add support for ACID 2 (that is, the version that will be released in Hive 3, which simplifies the storage to have only inserts and deletes (updates are an insert plus a delete)).
Also, note that to use this readers and writers would still have to interact with the Hive metastore to get a list of valid transactions and acquire appropriate locks.
> Add support for reading ACID2 files to ORC
> ------------------------------------------
>
> Key: ORC-255
> URL: https://issues.apache.org/jira/browse/ORC-255
> Project: ORC
> Issue Type: New Feature
> Components: ACID
> Reporter: Alan Gates
> Assignee: Alan Gates
>
> When ORC was split out of Hive the reading and writing of ACID files was left in Hive. This blocks non-Hive users from reading or writing ACID. I propose to add support for ACID to ORC.
> At this point I only propose to add support for ACID 2 (that is, the version that will be released in Hive 3, which simplifies the storage to have only inserts and deletes (updates are an insert plus a delete)). Also, I am initially at least just adding support via the vector batch interface, not the row by row interface.
> Also, note that to use this readers and writers would still have to interact with the Hive metastore to get a list of valid transactions and acquire appropriate locks.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)