You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Yang Cao <cy...@gmail.com> on 2016/07/28 07:15:09 UTC

create external table from partitioned avro file

Hi,

I am using spark 1.6 and I hope to create a hive external table based on one partitioned avro file. Currently, I don’t find any build-in api to do this work. I tried the write.format().saveAsTable, with format com.databricks.spark.avro. it returned error can’t file Hive serde for this. Also, same problem with function createExternalTable(). Spark seems can recognize avro format. Need help for this task. Welcome any suggestion.

THX
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org

Re: create external table from partitioned avro file

Posted by Gourav Sengupta <go...@gmail.com>.

Why avro?

Regards,
Gourav Sengupta

On Thu, Jul 28, 2016 at 8:15 AM, Yang Cao <cy...@gmail.com> wrote:

> Hi,
>
> I am using spark 1.6 and I hope to create a hive external table based on
> one partitioned avro file. Currently, I don’t find any build-in api to do
> this work. I tried the write.format().saveAsTable, with format
> com.databricks.spark.avro. it returned error can’t file Hive serde for
> this. Also, same problem with function createExternalTable(). Spark seems
> can recognize avro format. Need help for this task. Welcome any suggestion.
>
> THX
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>
>