You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Aman Sinha (JIRA)" <ji...@apache.org> on 2016/03/13 20:32:33 UTC
[jira] [Commented] (DRILL-4503) Schema change exception even with
all_text_mode enabled
[ https://issues.apache.org/jira/browse/DRILL-4503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15192493#comment-15192493 ]
Aman Sinha commented on DRILL-4503:
-----------------------------------
Note that enabling union_type does not help in this case:
{noformat}
0: jdbc:drill:zk=local> alter session set `exec.enable_union_type` = true;
+-------+----------------------------------+
| ok | summary |
+-------+----------------------------------+
| true | exec.enable_union_type updated. |
+-------+----------------------------------+
1 row selected (0.102 seconds)
0: jdbc:drill:zk=local> select min(a), min(c) from dfs.`mostlynulls_1.json`;
Error: UNSUPPORTED_OPERATION ERROR: Streaming aggregate does not support schema changes
{noformat}
> Schema change exception even with all_text_mode enabled
> -------------------------------------------------------
>
> Key: DRILL-4503
> URL: https://issues.apache.org/jira/browse/DRILL-4503
> Project: Apache Drill
> Issue Type: Bug
> Components: Storage - JSON
> Affects Versions: 1.6.0
> Reporter: Aman Sinha
> Assignee: Aman Sinha
> Labels: 1.7.0
> Attachments: mostlynulls_1.json
>
>
> Both HashAggregate and StreamingAggregate encounter schema change error whey querying a JSON file with non-null values for column 'a' and many null values for column 'c'.
> This occurs even when all_text_mode is enabled, which seems counterintuitive since once all_text_mode is enabled, everything (including nulls) should be treated as varchar and one would expect no schema change errors.
> Here are some example queries that encounter this error:
> {noformat}
> 0: jdbc:drill:zk=local> select a, c from dfs.`mostlynulls_1.json` group by a, c;
> Error: UNSUPPORTED_OPERATION ERROR: Hash aggregate does not support schema changes
> 0: jdbc:drill:zk=local> alter session set `store.json.all_text_mode` = true;
> +-------+------------------------------------+
> | ok | summary |
> +-------+------------------------------------+
> | true | store.json.all_text_mode updated. |
> +-------+------------------------------------+
> 1 row selected (0.15 seconds)
> 0: jdbc:drill:zk=local> select a, c from dfs.`mostlynulls_1.json` group by a, c;
> Error: UNSUPPORTED_OPERATION ERROR: Hash aggregate does not support schema changes
> 0: jdbc:drill:zk=local> select min(a), min(c) from dfs.`mostlynulls_1.json`;
> Error: UNSUPPORTED_OPERATION ERROR: Streaming aggregate does not support schema changes
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)