You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2018/04/01 12:37:00 UTC

[jira] [Commented] (DRILL-6016) Error reading INT96 created by Apache Spark

    [ https://issues.apache.org/jira/browse/DRILL-6016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16421642#comment-16421642 ] 

ASF GitHub Bot commented on DRILL-6016:
---------------------------------------

Github user vdiravka commented on a diff in the pull request:

    https://github.com/apache/drill/pull/1166#discussion_r178456935
  
    --- Diff: exec/java-exec/src/test/java/org/apache/drill/exec/physical/impl/writer/TestParquetWriter.java ---
    @@ -780,17 +780,31 @@ public void testImpalaParquetBinaryAsVarBinary_DictChange() throws Exception {
       Test the reading of a binary field as drill timestamp where data is in dictionary _and_ non-dictionary encoded pages
        */
       @Test
    -  @Ignore("relies on particular time zone, works for UTC")
       public void testImpalaParquetBinaryAsTimeStamp_DictChange() throws Exception {
         try {
           testBuilder()
    -          .sqlQuery("select int96_ts from dfs.`parquet/int96_dict_change` order by int96_ts")
    +          .sqlQuery("select min(int96_ts) date_value from dfs.`parquet/int96_dict_change`")
    --- End diff --
    
    It is just more obvious what result is expected. But using MIN is ok.


> Error reading INT96 created by Apache Spark
> -------------------------------------------
>
>                 Key: DRILL-6016
>                 URL: https://issues.apache.org/jira/browse/DRILL-6016
>             Project: Apache Drill
>          Issue Type: Bug
>    Affects Versions: 1.13.0
>            Reporter: Rahul Raj
>            Assignee: Rahul Raj
>            Priority: Major
>              Labels: ready-to-commit
>             Fix For: 1.14.0
>
>
> Hi,
> I am getting the error - SYSTEM ERROR : ClassCastException: org.apache.drill.exec.vector.TimeStampVector cannot be cast to org.apache.drill.exec.vector.VariableWidthVector while trying to read a spark INT96 datetime field on Drill 1.11 in spite of setting the property store.parquet.reader.int96_as_timestamp to  true.
> I believe this was fixed in drill 1.10(https://issues.apache.org/jira/browse/DRILL-4373). What could be wrong.
> I have attached the dataset at https://github.com/rajrahul/files/blob/master/result.tar.gz



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)