You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@orc.apache.org by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/08/31 23:00:00 UTC

[jira] [Resolved] (ORC-965) Got "Overflow detected" at spark-orc with zstd

     [ https://issues.apache.org/jira/browse/ORC-965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dongjoon Hyun resolved ORC-965.
-------------------------------
    Fix Version/s: 1.6.11
                   1.7.0
         Assignee: Dongjoon Hyun
       Resolution: Fixed

This is resolved via https://github.com/apache/orc/pull/890

> Got "Overflow detected" at spark-orc with zstd
> ----------------------------------------------
>
>                 Key: ORC-965
>                 URL: https://issues.apache.org/jira/browse/ORC-965
>             Project: ORC
>          Issue Type: Bug
>          Components: Java
>    Affects Versions: 1.6.9, 1.6.10
>            Reporter: melin
>            Assignee: Dongjoon Hyun
>            Priority: Blocker
>             Fix For: 1.7.0, 1.6.11
>
>
>  Write to the orc format data and throw a Overflow detected exception。
> sql: insert overwrite table nlp_dev.bank_txt_classified_v2 partition(file_no, class_label) SELECT * from nlp_dev.tdl_table_qiusuo_20210821
> orc: 1.6.10
> aircompression: 0.20 | 0.19
> spark 3.0.4
> !https://user-images.githubusercontent.com/1145830/130343897-c3f56361-a126-4817-b9d3-4f8646b5154e.png!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)