[jira] [Commented] (TOREE-345) Spark 2.0.0 Fails when trying to use spark-avro

["Hollin Wilkins (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TOREE-345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15540668#comment-15540668 ] 

Hollin Wilkins commented on TOREE-345:
--------------------------------------

Stacktrace:
{code}
Name: Compile Error
Message: error: error while loading package, class file '/Users/hollinwilkins/Lib/spark-2.0.0-bin-hadoop2.7/jars/spark-sql_2.11-2.0.0.jar(org/apache/spark/sql/execution/package.class)' has location not matching its contents: contains package object execution
error: error while loading QueryExecution, class file '/Users/hollinwilkins/Lib/spark-2.0.0-bin-hadoop2.7/jars/spark-sql_2.11-2.0.0.jar(org/apache/spark/sql/execution/QueryExecution.class)' has location not matching its contents: contains class QueryExecution
error: error while loading package, class file '/Users/hollinwilkins/Lib/spark-2.0.0-bin-hadoop2.7/jars/spark-catalyst_2.11-2.0.0.jar(org/apache/spark/sql/catalyst/plans/package.class)' has location not matching its contents: contains package object plans
error: error while loading LogicalPlan, class file '/Users/hollinwilkins/Lib/spark-2.0.0-bin-hadoop2.7/jars/spark-catalyst_2.11-2.0.0.jar(org/apache/spark/sql/catalyst/plans/logical/LogicalPlan.class)' has location not matching its contents: contains class LogicalPlan
error: error while loading package, class file '/Users/hollinwilkins/Lib/spark-2.0.0-bin-hadoop2.7/jars/spark-catalyst_2.11-2.0.0.jar(org/apache/spark/sql/catalyst/encoders/package.class)' has location not matching its contents: contains package object encoders
error: error while loading ExpressionEncoder, class file '/Users/hollinwilkins/Lib/spark-2.0.0-bin-hadoop2.7/jars/spark-catalyst_2.11-2.0.0.jar(org/apache/spark/sql/catalyst/encoders/ExpressionEncoder.class)' has location not matching its contents: contains class ExpressionEncoder
error: error while loading NamedExpression, class file '/Users/hollinwilkins/Lib/spark-2.0.0-bin-hadoop2.7/jars/spark-catalyst_2.11-2.0.0.jar(org/apache/spark/sql/catalyst/expressions/NamedExpression.class)' has location not matching its contents: contains class NamedExpression
error: error while loading Expression, class file '/Users/hollinwilkins/Lib/spark-2.0.0-bin-hadoop2.7/jars/spark-catalyst_2.11-2.0.0.jar(org/apache/spark/sql/catalyst/expressions/Expression.class)' has location not matching its contents: contains class Expression
error: error while loading DataFrameNaFunctions, class file '/Users/hollinwilkins/Lib/spark-2.0.0-bin-hadoop2.7/jars/spark-sql_2.11-2.0.0.jar(org/apache/spark/sql/DataFrameNaFunctions.class)' has location not matching its contents: contains class DataFrameNaFunctions
error: error while loading DataFrameStatFunctions, class file '/Users/hollinwilkins/Lib/spark-2.0.0-bin-hadoop2.7/jars/spark-sql_2.11-2.0.0.jar(org/apache/spark/sql/DataFrameStatFunctions.class)' has location not matching its contents: contains class DataFrameStatFunctions
error: error while loading Column, class file '/Users/hollinwilkins/Lib/spark-2.0.0-bin-hadoop2.7/jars/spark-sql_2.11-2.0.0.jar(org/apache/spark/sql/Column.class)' has location not matching its contents: contains class Column
error: error while loading TypedColumn, class file '/Users/hollinwilkins/Lib/spark-2.0.0-bin-hadoop2.7/jars/spark-sql_2.11-2.0.0.jar(org/apache/spark/sql/TypedColumn.class)' has location not matching its contents: contains class TypedColumn
error: error while loading RelationalGroupedDataset, class file '/Users/hollinwilkins/Lib/spark-2.0.0-bin-hadoop2.7/jars/spark-sql_2.11-2.0.0.jar(org/apache/spark/sql/RelationalGroupedDataset.class)' has location not matching its contents: contains class RelationalGroupedDataset
error: error while loading package, class file '/Users/hollinwilkins/Lib/spark-2.0.0-bin-hadoop2.7/jars/spark-core_2.11-2.0.0.jar(org/apache/spark/api/java/function/package.class)' has location not matching its contents: contains package object function
error: error while loading ReduceFunction, class file '/Users/hollinwilkins/Lib/spark-2.0.0-bin-hadoop2.7/jars/spark-core_2.11-2.0.0.jar(org/apache/spark/api/java/function/ReduceFunction.class)' has location not matching its contents: contains class ReduceFunction
error: error while loading KeyValueGroupedDataset, class file '/Users/hollinwilkins/Lib/spark-2.0.0-bin-hadoop2.7/jars/spark-sql_2.11-2.0.0.jar(org/apache/spark/sql/KeyValueGroupedDataset.class)' has location not matching its contents: contains class KeyValueGroupedDataset
error: error while loading MapFunction, class file '/Users/hollinwilkins/Lib/spark-2.0.0-bin-hadoop2.7/jars/spark-core_2.11-2.0.0.jar(org/apache/spark/api/java/function/MapFunction.class)' has location not matching its contents: contains class MapFunction
error: error while loading Metadata, class file '/Users/hollinwilkins/Lib/spark-2.0.0-bin-hadoop2.7/jars/spark-catalyst_2.11-2.0.0.jar(org/apache/spark/sql/types/Metadata.class)' has location not matching its contents: contains class Metadata
error: error while loading FilterFunction, class file '/Users/hollinwilkins/Lib/spark-2.0.0-bin-hadoop2.7/jars/spark-core_2.11-2.0.0.jar(org/apache/spark/api/java/function/FilterFunction.class)' has location not matching its contents: contains class FilterFunction
error: error while loading MapPartitionsFunction, class file '/Users/hollinwilkins/Lib/spark-2.0.0-bin-hadoop2.7/jars/spark-core_2.11-2.0.0.jar(org/apache/spark/api/java/function/MapPartitionsFunction.class)' has location not matching its contents: contains class MapPartitionsFunction
error: error while loading FlatMapFunction, class file '/Users/hollinwilkins/Lib/spark-2.0.0-bin-hadoop2.7/jars/spark-core_2.11-2.0.0.jar(org/apache/spark/api/java/function/FlatMapFunction.class)' has location not matching its contents: contains class FlatMapFunction
error: error while loading ForeachFunction, class file '/Users/hollinwilkins/Lib/spark-2.0.0-bin-hadoop2.7/jars/spark-core_2.11-2.0.0.jar(org/apache/spark/api/java/function/ForeachFunction.class)' has location not matching its contents: contains class ForeachFunction
error: error while loading ForeachPartitionFunction, class file '/Users/hollinwilkins/Lib/spark-2.0.0-bin-hadoop2.7/jars/spark-core_2.11-2.0.0.jar(org/apache/spark/api/java/function/ForeachPartitionFunction.class)' has location not matching its contents: contains class ForeachPartitionFunction
error: error while loading StorageLevel, class file '/Users/hollinwilkins/Lib/spark-2.0.0-bin-hadoop2.7/jars/spark-core_2.11-2.0.0.jar(org/apache/spark/storage/StorageLevel.class)' has location not matching its contents: contains class StorageLevel
error: error while loading DataFrameWriter, class file '/Users/hollinwilkins/Lib/spark-2.0.0-bin-hadoop2.7/jars/spark-sql_2.11-2.0.0.jar(org/apache/spark/sql/DataFrameWriter.class)' has location not matching its contents: contains class DataFrameWriter
error: error while loading DataStreamWriter, class file '/Users/hollinwilkins/Lib/spark-2.0.0-bin-hadoop2.7/jars/spark-sql_2.11-2.0.0.jar(org/apache/spark/sql/streaming/DataStreamWriter.class)' has location not matching its contents: contains class DataStreamWriter
StackTrace: 
{code}

> Spark 2.0.0 Fails when trying to use spark-avro
> -----------------------------------------------
>
>                 Key: TOREE-345
>                 URL: https://issues.apache.org/jira/browse/TOREE-345
>             Project: TOREE
>          Issue Type: Bug
>         Environment: Spark 2.0.0, Scala 2.11, Hadoop 2.7, Toree Git SHA: 7c1bfb6df7130477c558e69bbb518b0af364e06a
>            Reporter: Hollin Wilkins
>
> When trying to use the spark-avro project to load Avro files from Jupyter, we get errors.
> First:
> {code}
> %AddDeps com.databricks spark-avro_2.11 3.0.1 --transitive --trace
> {code}
> Then try to load an every file and show it:
> {code}
> spark.sqlContext.read.format("com.databricks.spark.avro").load("/tmp/test.avro").show()
> {code}
> And we get an error. I will attach the trace as a file.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)