You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tajo.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2014/12/15 17:57:13 UTC
[jira] [Commented] (TAJO-1226) LogicalPlanVerifier should check not
supported type in file formats
[ https://issues.apache.org/jira/browse/TAJO-1226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246837#comment-14246837 ]
ASF GitHub Bot commented on TAJO-1226:
--------------------------------------
GitHub user charsyam opened a pull request:
https://github.com/apache/tajo/pull/301
TAJO-1226: add json and parquet validator
Result of this patch.
```c
default> create external table table1 ( id int, name text, score float, type text, mytime date) using parquet location 'file:/Users/charsyam/tajo/table';
ERROR: PARQUET doesn't support mytime:DATE
```
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/charsyam/tajo feature/TAJO-1226
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/tajo/pull/301.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #301
----
commit c5faf6435e105e060248b4b9312c104d368c71bb
Author: clark.kang <cl...@kakao.com>
Date: 2014-12-13T16:36:58Z
TAJO-1226: add json and parquet validator
----
> LogicalPlanVerifier should check not supported type in file formats
> -------------------------------------------------------------------
>
> Key: TAJO-1226
> URL: https://issues.apache.org/jira/browse/TAJO-1226
> Project: Tajo
> Issue Type: Improvement
> Components: planner/optimizer
> Reporter: Hyunsik Choi
> Assignee: DaeMyung Kang
> Fix For: 0.9.1
>
>
> *Problem*
> There are a variety of file formats in Hadoop eco systems. BTW, they have different type supports. For example, RCFile supports DATE type, but Parquet does not support DATE. Users can use not supported data types in a specified file format for writing tables.
> But, current Tajo does not check available data types for each file format. So, if a user specifies not supported types in his table for writing, a runtime error will occur while a query is running.
> *Solution*
> We should check not supported data type in logical plan verification phase.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)