You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by cjdc <cr...@cern.ch> on 2014/12/01 09:55:59 UTC
Re: Spark SQL 1.0.0 - RDD from snappy compress avro file
Hi Vikas and Simone,
thanks for the replies.
Yeah I understand this would be easier with 1.2 but this is completely out
of my control. I really have to work with 1.0.0.
About Simone's approach, during the imports I get:
/scala> import org.apache.avro.mapreduce.{ AvroJob, AvroKeyInputFormat,
AvroKeyOutputFormat }
<console>:17: error: object mapreduce is not a member of package
org.apache.avro
import org.apache.avro.mapreduce.{ AvroJob, AvroKeyInputFormat,
AvroKeyOutputFormat }
^
scala> import org.apache.avro.mapred.AvroKey
<console>:17: error: object mapred is not a member of package
org.apache.avro
import org.apache.avro.mapred.AvroKey
^
scala> import com.twitter.chill.avro.AvroSerializer
<console>:18: error: object avro is not a member of package
com.twitter.chill
import com.twitter.chill.avro.AvroSerializer
^/
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-1-0-0-RDD-from-snappy-compress-avro-file-tp19998p20073.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: Spark SQL 1.0.0 - RDD from snappy compress avro file
Posted by cjdc <cr...@cern.ch>.
Ideas?
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-1-0-0-RDD-from-snappy-compress-avro-file-tp19998p20267.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: Spark SQL 1.0.0 - RDD from snappy compress avro file
Posted by cjdc <cr...@cern.ch>.
btw the same error from above also happen on 1.1.0 (just tested)
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-1-0-0-RDD-from-snappy-compress-avro-file-tp19998p20106.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org