You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Volodymyr Vysotskyi (JIRA)" <ji...@apache.org> on 2018/12/24 16:23:00 UTC

[jira] [Created] (DRILL-6927) Query fails when hive table with timestamp data is queried with enabled int96_as_timestamp and optimize_scan_with_native_reader options

Volodymyr Vysotskyi created DRILL-6927:
------------------------------------------

             Summary: Query fails when hive table with timestamp data is queried with enabled int96_as_timestamp and optimize_scan_with_native_reader options
                 Key: DRILL-6927
                 URL: https://issues.apache.org/jira/browse/DRILL-6927
             Project: Apache Drill
          Issue Type: Bug
    Affects Versions: 1.14.0
            Reporter: Volodymyr Vysotskyi
             Fix For: Future


Steps to reproduce:
1. Create hive table with timestamp column:
{code:sql}
create table test_timestamp stored as PARQUET as select timestamp '2018-01-01 12:12:12.123' as c1;
{code}
2. Enable {{store.parquet.reader.int96_as_timestamp}} and {{store.hive.parquet.optimize_scan_with_native_reader}}:
{code:sql}
set `store.parquet.reader.int96_as_timestamp`=true;
set `store.hive.parquet.optimize_scan_with_native_reader`=true;
{code}
3. Query hive table using Drill:
{code:sql}
select * from hive.test_timestamp;
{code}
Query fails with error:
{noformat}
Error: SYSTEM ERROR: SchemaChangeException: Failure while trying to materialize incoming schema.  Errors:
 
Error in expression at index -1.  Error: Missing function implementation: [convert_fromtimestamp_impala(TIMESTAMP-OPTIONAL)].  Full expression: --UNKNOWN EXPRESSION--..

Fragment 0:0
{noformat}
Stack trace:
{noformat}
Error in expression at index -1.  Error: Missing function implementation: [convert_fromtimestamp_impala(TIMESTAMP-OPTIONAL)].  Full expression: --UNKNOWN EXPRESSION--..
	at org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.setupNewSchemaFromInput(ProjectRecordBatch.java:498) ~[drill-java-exec-1.15.0-SNAPSHOT.jar:1.15.0-SNAPSHOT]
	at org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.setupNewSchema(ProjectRecordBatch.java:583) ~[drill-java-exec-1.15.0-SNAPSHOT.jar:1.15.0-SNAPSHOT]
	at org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext(AbstractUnaryRecordBatch.java:101) ~[drill-java-exec-1.15.0-SNAPSHOT.jar:1.15.0-SNAPSHOT]
	at org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:143) ~[drill-java-exec-1.15.0-SNAPSHOT.jar:1.15.0-SNAPSHOT]
	at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:186) ~[drill-java-exec-1.15.0-SNAPSHOT.jar:1.15.0-SNAPSHOT]
	at org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:104) ~[drill-java-exec-1.15.0-SNAPSHOT.jar:1.15.0-SNAPSHOT]
	at org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:83) ~[drill-java-exec-1.15.0-SNAPSHOT.jar:1.15.0-SNAPSHOT]
	at org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:94) ~[drill-java-exec-1.15.0-SNAPSHOT.jar:1.15.0-SNAPSHOT]
	at org.apache.drill.exec.work.fragment.FragmentExecutor$1.run(FragmentExecutor.java:297) ~[drill-java-exec-1.15.0-SNAPSHOT.jar:1.15.0-SNAPSHOT]
	at org.apache.drill.exec.work.fragment.FragmentExecutor$1.run(FragmentExecutor.java:284) ~[drill-java-exec-1.15.0-SNAPSHOT.jar:1.15.0-SNAPSHOT]
	at java.security.AccessController.doPrivileged(Native Method) ~[na:1.8.0_141]
	at javax.security.auth.Subject.doAs(Subject.java:422) ~[na:1.8.0_141]
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1669) ~[hadoop-common-2.7.0-mapr-1808.jar:na]
	at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:284) [drill-java-exec-1.15.0-SNAPSHOT.jar:1.15.0-SNAPSHOT]
	... 4 common frames omitted
{noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)