You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "zero222 (Jira)" <ji...@apache.org> on 2020/08/06 09:51:00 UTC
[jira] [Comment Edited] (SPARK-30577) StorageLevel.DISK_ONLY_2
causes the data loss
[ https://issues.apache.org/jira/browse/SPARK-30577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17172177#comment-17172177 ]
zero222 edited comment on SPARK-30577 at 8/6/20, 9:50 AM:
----------------------------------------------------------
spark-2.4.6 can work normally with DISK_ONLY_2. But when spark-3.0 access the table of the hive with 1.2 verison, it get "TApplicationException: Invalid method name: 'get_all_functions'". Is there a good solution Under the condition of hive1.2 ? Thanks !
was (Author: zero222):
spark-2.4.6 can work normally with DISK_ONLY_2. But when spark-3.0 sql access the table of the hive with 1.2 verison, it get "TApplicationException: Invalid method name: 'get_all_functions'". Is there a good solution Under the condition of hive1.2 ? Thanks !
> StorageLevel.DISK_ONLY_2 causes the data loss
> ---------------------------------------------
>
> Key: SPARK-30577
> URL: https://issues.apache.org/jira/browse/SPARK-30577
> Project: Spark
> Issue Type: Bug
> Components: Spark Core, SQL
> Affects Versions: 2.3.0
> Reporter: zero222
> Priority: Major
> Attachments: DISK_ONLY_2.png
>
>
> As shown in the attachment，after I load the data of the hive table which is immutable and cache the data in the level of the DISK_ONLY_2，the count value of the data is different every time.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org