You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2016/12/12 23:53:58 UTC
[jira] [Created] (SPARK-18835) Do not expose shaded types in
JavaTypeInference API
Marcelo Vanzin created SPARK-18835:
--------------------------------------
Summary: Do not expose shaded types in JavaTypeInference API
Key: SPARK-18835
URL: https://issues.apache.org/jira/browse/SPARK-18835
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 2.1.0
Reporter: Marcelo Vanzin
Priority: Minor
Currently, {{inferDataType(TypeToken)}} is called from a different maven module, and because we shade Guava, that sometimes leads to errors (e.g. when running tests using maven):
{noformat}
udf3Test(test.org.apache.spark.sql.JavaUDFSuite) Time elapsed: 0.084 sec <<< ERROR!
java.lang.NoSuchMethodError: org.apache.spark.sql.catalyst.JavaTypeInference$.inferDataType(Lcom/google/common/reflect/TypeToken;)Lscala/Tuple2;
at test.org.apache.spark.sql.JavaUDFSuite.udf3Test(JavaUDFSuite.java:107)
Results :
Tests in error:
JavaUDFSuite.udf3Test:107 ยป NoSuchMethod org.apache.spark.sql.catalyst.JavaTyp...
{noformat}
Instead, we shouldn't expose Guava types in these APIs.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org