[jira] [Commented] (ORC-726) Support Map type in `orc-tools convert`

["Yukihiro Okada (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/ORC-726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17308075#comment-17308075 ] 

Yukihiro Okada commented on ORC-726:
------------------------------------

In current master branch, the convert sub command seems to work well.
{code:java}
(venv) ~/w/I/orc ❯❯❯ java -jar java/tools/target/orc-tools-1.7.0-SNAPSHOT-uber.jar version
ORC 1.7.0-SNAPSHOT

(venv) ~/w/I/orc ❯❯❯ md5sum examples/orc-file-11-format.orc
a064e232d0a53cc34499d4a2d7f0cf7f  examples/orc-file-11-format.orc

(venv) ~/w/I/orc ❯❯❯ java -jar java/tools/target/orc-tools-1.7.0-SNAPSHOT-uber.jar meta examples/orc-file-11-format.orc |grep Type
Processing data file examples/orc-file-11-format.orc [length: 373336]
Type: struct<boolean1:boolean,byte1:tinyint,short1:smallint,int1:int,long1:bigint,float1:float,double1:double,bytes1:binary,string1:string,middle:struct<list:array<struct<int1:int,string1:string>>>,list:array<struct<int1:int,string1:string>>,map:map<string,struct<int1:int,string1:string>>,ts:timestamp,decimal1:decimal(38,10)>

(venv) ~/w/I/orc ❯❯❯ java -jar java/tools/target/orc-tools-1.7.0-SNAPSHOT-uber.jar convert examples/orc-file-11-format.orc
Merging schema from examples/orc-file-11-format.orc
Processing examples/orc-file-11-format.orc
{code}
 

 

> Support Map type in `orc-tools convert`
> ---------------------------------------
>
>                 Key: ORC-726
>                 URL: https://issues.apache.org/jira/browse/ORC-726
>             Project: ORC
>          Issue Type: Sub-task
>          Components: tools
>    Affects Versions: 1.7.0
>            Reporter: Dongjoon Hyun
>            Priority: Major
>
> {code}
> $ orc-tools version
> ORC 1.6.6
> $ orc-tools convert examples/orc-file-11-format.orc
> Merging schema from examples/orc-file-11-format.orc
> Exception in thread "main" java.lang.IllegalArgumentException: Unhandled type map<string,struct<int1:int,string1:string>>
> 	at org.apache.orc.tools.json.JsonSchemaFinder.makeHiveType(JsonSchemaFinder.java:315)
> 	at org.apache.orc.tools.json.JsonSchemaFinder.makeHiveType(JsonSchemaFinder.java:302)
> 	at org.apache.orc.tools.json.JsonSchemaFinder.addSchema(JsonSchemaFinder.java:320)
> 	at org.apache.orc.tools.convert.ConvertTool.buildSchema(ConvertTool.java:78)
> 	at org.apache.orc.tools.convert.ConvertTool.<init>(ConvertTool.java:185)
> 	at org.apache.orc.tools.convert.ConvertTool.main(ConvertTool.java:165)
> 	at org.apache.orc.tools.Driver.main(Driver.java:116)
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)