You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2016/12/13 18:39:59 UTC
[jira] [Updated] (SPARK-18835) Do not expose shaded types in
JavaTypeInference API
[ https://issues.apache.org/jira/browse/SPARK-18835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Marcelo Vanzin updated SPARK-18835:
-----------------------------------
Fix Version/s: 2.2.0
> Do not expose shaded types in JavaTypeInference API
> ---------------------------------------------------
>
> Key: SPARK-18835
> URL: https://issues.apache.org/jira/browse/SPARK-18835
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.1.0
> Reporter: Marcelo Vanzin
> Assignee: Marcelo Vanzin
> Priority: Minor
> Fix For: 2.1.1, 2.2.0
>
>
> Currently, {{inferDataType(TypeToken)}} is called from a different maven module, and because we shade Guava, that sometimes leads to errors (e.g. when running tests using maven):
> {noformat}
> udf3Test(test.org.apache.spark.sql.JavaUDFSuite) Time elapsed: 0.084 sec <<< ERROR!
> java.lang.NoSuchMethodError: org.apache.spark.sql.catalyst.JavaTypeInference$.inferDataType(Lcom/google/common/reflect/TypeToken;)Lscala/Tuple2;
> at test.org.apache.spark.sql.JavaUDFSuite.udf3Test(JavaUDFSuite.java:107)
> Results :
> Tests in error:
> JavaUDFSuite.udf3Test:107 ยป NoSuchMethod org.apache.spark.sql.catalyst.JavaTyp...
> {noformat}
> Instead, we shouldn't expose Guava types in these APIs.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org