You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Svitlana Ponomarova (Jira)" <ji...@apache.org> on 2021/02/04 16:18:00 UTC
[jira] [Updated] (SPARK-34362) scala.MatchError: 2.3 (of class
java.lang.String) for Hive on Google Dataproc 1.4
[ https://issues.apache.org/jira/browse/SPARK-34362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Svitlana Ponomarova updated SPARK-34362:
----------------------------------------
Description:
According to Google Dataproc 1.4 release notes:
[https://cloud.google.com/dataproc/docs/concepts/versioning/dataproc-release-1.4]
2.4.7 is supported spark version.
Use *spark-hive_2.11-2.4.7.jar* for Hive on Dataproc 1.4 causes:
{noformat}
scala.MatchError: 2.3 (of class java.lang.String) scala.MatchError: 2.3
(of class java.lang.String)
at org.apache.spark.sql.hive.client.IsolatedClientLoader$.hiveVersion(IsolatedClientLoader.scala:89)
at org.apache.spark.sql.hive.HiveUtils$.newClientForMetadata(HiveUtils.scala:300) at org.apache.spark.sql.hive.HiveUtils$.newClientForMetadata(HiveUtils.scala:287) at org.apache.spark.sql.hive.HiveExternalCatalog.client$lzycompute(HiveExternalCatalog.scala:66)
at org.apache.spark.sql.hive.HiveExternalCatalog.client(HiveExternalCatalog.scala:65)
{noformat}
was:
According to Google Dataproc 1.4 release notes:
[https://cloud.google.com/dataproc/docs/concepts/versioning/dataproc-release-1.4]
2.4.7 is supported spark version.
Use spark-hive_2.11-2.4.7.jar for Hive on Dataproc 1.4 causes:
{noformat}
scala.MatchError: 2.3 (of class java.lang.String) scala.MatchError: 2.3
(of class java.lang.String)
at org.apache.spark.sql.hive.client.IsolatedClientLoader$.hiveVersion(IsolatedClientLoader.scala:89)
at org.apache.spark.sql.hive.HiveUtils$.newClientForMetadata(HiveUtils.scala:300) at org.apache.spark.sql.hive.HiveUtils$.newClientForMetadata(HiveUtils.scala:287) at org.apache.spark.sql.hive.HiveExternalCatalog.client$lzycompute(HiveExternalCatalog.scala:66)
at org.apache.spark.sql.hive.HiveExternalCatalog.client(HiveExternalCatalog.scala:65)
{noformat}
> scala.MatchError: 2.3 (of class java.lang.String) for Hive on Google Dataproc 1.4
> ---------------------------------------------------------------------------------
>
> Key: SPARK-34362
> URL: https://issues.apache.org/jira/browse/SPARK-34362
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.4.7
> Reporter: Svitlana Ponomarova
> Priority: Critical
>
> According to Google Dataproc 1.4 release notes:
> [https://cloud.google.com/dataproc/docs/concepts/versioning/dataproc-release-1.4]
> 2.4.7 is supported spark version.
> Use *spark-hive_2.11-2.4.7.jar* for Hive on Dataproc 1.4 causes:
> {noformat}
> scala.MatchError: 2.3 (of class java.lang.String) scala.MatchError: 2.3
> (of class java.lang.String)
> at org.apache.spark.sql.hive.client.IsolatedClientLoader$.hiveVersion(IsolatedClientLoader.scala:89)
> at org.apache.spark.sql.hive.HiveUtils$.newClientForMetadata(HiveUtils.scala:300) at org.apache.spark.sql.hive.HiveUtils$.newClientForMetadata(HiveUtils.scala:287) at org.apache.spark.sql.hive.HiveExternalCatalog.client$lzycompute(HiveExternalCatalog.scala:66)
> at org.apache.spark.sql.hive.HiveExternalCatalog.client(HiveExternalCatalog.scala:65)
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org