[jira] [Created] (DRILL-2005) Create table fails to write out a parquet file created from hive- read works fine

["Ramana Inukonda Nagaraj (JIRA)" <ji...@apache.org>]

Ramana Inukonda Nagaraj created DRILL-2005:
----------------------------------------------

             Summary: Create table fails to write out a parquet file created from hive- read works fine
                 Key: DRILL-2005
                 URL: https://issues.apache.org/jira/browse/DRILL-2005
             Project: Apache Drill
          Issue Type: Bug
          Components: Storage - Writer
    Affects Versions: 0.7.0
            Reporter: Ramana Inukonda Nagaraj
            Assignee: Parth Chandra
            Priority: Critical
         Attachments: hive_alltypes.parquet

Created a parquet file in hive having the following DDL
hive> desc alltypesparquet; 
OK
c1 int 
c2 boolean 
c3 double 
c4 string 
c5 array<int> 
c6 map<int,string> 
c7 map<string,string> 
c8 struct<r:string,s:int,t:double>	
c9 tinyint 
c10 smallint 
c11 float 
c12 bigint 
c13 array<array<string>>	
c15 struct<r:int,s:struct<a:int,b:string>>	
c16 array<struct<m:map<string,string>,n:int>>	
Time taken: 0.076 seconds, Fetched: 15 row(s)

Now tried to write the file out using drill
0: jdbc:drill:> create table hive_alltypesparquet as select * from `/user/hive/warehouse/alltypesparquet`;
Query failed: Query failed: Failure while running fragment., Attempted to access index 2147483646 when value capacity is 4095 [ 7c030695-9dee-4e15-b9a7-7c807dbd3e5f on 10.10.30.167:31010 ]
[ 7c030695-9dee-4e15-b9a7-7c807dbd3e5f on 10.10.30.167:31010 ]

Drill is able to read the file (reasonably well- see 1997,1999,2000)
0: jdbc:drill:> select * from `/user/hive/warehouse/alltypesparquet`;
+------------+------------+------------+------------+------------+------------+------------+------------+------------+------------+------------+------------+------------+------------+------------+
|     c1     |     c2     |     c3     |     c4     |     c5     |     c6     |     c7     |     c8     |     c9     |    c10     |    c11     |    c12     |    c13     |    c15     |    c16     |
+------------+------------+------------+------------+------------+------------+------------+------------+------------+------------+------------+------------+------------+------------+------------+
| null       | null       | null       | null       | {"bag":[]} | {"map":[]} | {"map":[]} | {}         | null       | null       | null       | null       | {"bag":[]} | {"s":{}}   | {"bag":[]} |
| -1         | false      | -1.1       | [B@62369833 | {"bag":[]} | {"map":[]} | {"map":[]} | {}         | -1         | -1         | -1.0       | -1         | {"bag":[]} | {"s":{}}   | {"bag":[]} |
| 1          | true       | 1.1        | [B@6e426ea4 | {"bag":[{"array_element":1},{"array_element":2}]} | {"map":[{"key":1,"value":"eA=="},{"key":2,"value":"eQ=="}]} | {"map":[{"key":"aw==","value":"dg=="}]} | {"r":"YQ==","s":9,"t":2.2} | 1          | 1          | 1.0        | 1          | {"bag":[{"array_element":{"bag":[{"array_element":"YQ=="},{"array_element":"Yg=="}]}},{"array_element":{"bag":[{"array_element":"Yw=="},{"array_element":"ZA=="}]}}]} | {"r":1,"s":{"a":2,"b":"eA=="}} | {"bag":[{"array_element":{"m":{"map":[]},"n":1}},{"array_element":{"m":{"map":[{"key":"YQ==","value":"Yg=="},{"key":"Yw==","value":"ZA=="}]},"n":2}}]} |
+------------+------------+------------+------------+------------+------------+------------+------------+------------+------------+------------+------------+------------+------------+------------+
3 rows selected (0.101 seconds)




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)