You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@orc.apache.org by "melin (Jira)" <ji...@apache.org> on 2021/08/23 12:13:00 UTC

[jira] [Updated] (ORC-965) Got "Overflow detected" at spark-orc with zstd

     [ https://issues.apache.org/jira/browse/ORC-965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

melin updated ORC-965:
----------------------
    Description: 
 Write to the orc format data and throw a Overflow detected exception。

sql: insert overwrite table nlp_dev.bank_txt_classified_v2 partition(file_no, class_label) SELECT * from nlp_dev.tdl_table_qiusuo_20210821

orc: 1.6.10

aircompression: 0.20 | 0.19

spark 3.0.4

!https://user-images.githubusercontent.com/1145830/130343897-c3f56361-a126-4817-b9d3-4f8646b5154e.png!

> Got "Overflow detected" at spark-orc with zstd
> ----------------------------------------------
>
>                 Key: ORC-965
>                 URL: https://issues.apache.org/jira/browse/ORC-965
>             Project: ORC
>          Issue Type: Bug
>            Reporter: melin
>            Priority: Major
>
>  Write to the orc format data and throw a Overflow detected exception。
> sql: insert overwrite table nlp_dev.bank_txt_classified_v2 partition(file_no, class_label) SELECT * from nlp_dev.tdl_table_qiusuo_20210821
> orc: 1.6.10
> aircompression: 0.20 | 0.19
> spark 3.0.4
> !https://user-images.githubusercontent.com/1145830/130343897-c3f56361-a126-4817-b9d3-4f8646b5154e.png!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)