You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2016/03/16 10:46:33 UTC
[jira] [Commented] (DRILL-4459) SchemaChangeException while
querying hive json table
[ https://issues.apache.org/jira/browse/DRILL-4459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197107#comment-15197107 ]
ASF GitHub Bot commented on DRILL-4459:
---------------------------------------
GitHub user vdiravka opened a pull request:
https://github.com/apache/drill/pull/431
DRILL-4459: SchemaChangeException while querying hive json table
- added Var16Char for comparison drill functions;
- added UTest for hive GET_JSON_OBJECT UDF.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/vdiravka/drill DRILL-4459
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/drill/pull/431.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #431
----
commit 71802544886d024fde3c22e6a507a4c7ca537148
Author: Vitalii Diravka <vi...@gmail.com>
Date: 2016-03-10T14:52:28Z
DRILL-4459: SchemaChangeException while querying hive json table
- added Var16Char for comparison drill functions;
- added UTest for hive GET_JSON_OBJECT UDF.
----
> SchemaChangeException while querying hive json table
> ----------------------------------------------------
>
> Key: DRILL-4459
> URL: https://issues.apache.org/jira/browse/DRILL-4459
> Project: Apache Drill
> Issue Type: Bug
> Components: Functions - Drill, Functions - Hive
> Affects Versions: 1.4.0
> Environment: MapR-Drill 1.4.0
> Hive-1.2.0
> Reporter: Vitalii Diravka
> Assignee: Vitalii Diravka
> Fix For: 1.7.0
>
>
> getting the SchemaChangeException while querying json documents stored in hive table.
> {noformat}
> Error: SYSTEM ERROR: SchemaChangeException: Failure while trying to materialize incoming schema. Errors:
>
> Error in expression at index -1. Error: Missing function implementation: [castBIT(VAR16CHAR-OPTIONAL)]. Full expression: --UNKNOWN EXPRESSION--..
> {noformat}
> minimum reproduce
> {noformat}
> created sample json documents using the attached script(randomdata.sh)
> hive>create table simplejson(json string);
> hive>load data local inpath '/tmp/simple.json' into table simplejson;
> now query it through Drill.
> Drill Version
> select * from sys.version;
> +-----------+----------------+-------------+-------------+------------+
> | commit_id | commit_message | commit_time | build_email | build_time |
> +-----------+----------------+-------------+-------------+------------+
> | eafe0a245a0d4c0234bfbead10c6b2d7c8ef413d | DRILL-3901: Don't do early expansion of directory in the non-metadata-cache case because it already happens during ParquetGroupScan's metadata gathering operation. | 07.10.2015 @ 17:12:57 UTC | Unknown | 07.10.2015 @ 17:36:16 UTC |
> +-----------+----------------+-------------+-------------+------------+
> 0: jdbc:drill:zk=> select * from hive.`default`.simplejson where GET_JSON_OBJECT(simplejson.json, '$.DocId') = 'DocId2759947' limit 1;
> Error: SYSTEM ERROR: SchemaChangeException: Failure while trying to materialize incoming schema. Errors:
>
> Error in expression at index -1. Error: Missing function implementation: [castBIT(VAR16CHAR-OPTIONAL)]. Full expression: --UNKNOWN EXPRESSION--..
> Fragment 1:1
> [Error Id: 74f054a8-6f1d-4ddd-9064-3939fcc82647 on ip-10-0-0-233:31010] (state=,code=0)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)