You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2021/08/14 00:58:00 UTC
[jira] [Commented] (IMPALA-10797) Support statements that do not
require reading JSON File
[ https://issues.apache.org/jira/browse/IMPALA-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17398995#comment-17398995 ]
ASF subversion and git services commented on IMPALA-10797:
----------------------------------------------------------
Commit b1ca0894462e4b9c040fda41622f8b97b1ec15e1 in impala's branch refs/heads/master from ShikhaAsrani
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=b1ca089 ]
IMPALA-10797: Frontend changes to enable 'stored as JSONFILE'
This change will allow usage of commands that do not require reading the
Json File like:
- Create Table <Table> stored as JSONFILE
- Show Create Table <Table>
- Describe <Table>
Changes:
- Added JSON as FileFormat to thrift and HdfsFileFormat.
- Allowing Sql keyword 'jsonfile' and mapping it to JSON format.
- Adding JSON serDe.
- JsonFiles have input format same as TextFile, so we need to use SerDe
library in use to differentiate between the two formats. Overloaded the
functions querying File Format based on input format to consider serDe
library too.
- Added tests for 'Create Table' and 'Show Create Table' commmands
Pending Changes:
- test for Describe command - to be added with backend changes.
Change-Id: I5b8cb2f59df3af09902b49d3bdac16c19954b305
Reviewed-on: http://gerrit.cloudera.org:8080/17727
Reviewed-by: Quanlong Huang <hu...@gmail.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
> Support statements that do not require reading JSON File
> --------------------------------------------------------
>
> Key: IMPALA-10797
> URL: https://issues.apache.org/jira/browse/IMPALA-10797
> Project: IMPALA
> Issue Type: Sub-task
> Reporter: Shikha Asrani
> Assignee: Shikha Asrani
> Priority: Major
>
> Statements like Create using "STORED AS JSONFILE" clause, Describe, Show Partitions do not require reading the JSON File, hence can be supported without JSON File reader in place.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org