You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@spark.apache.org by Koert Kuipers <ko...@tresata.com> on 2016/06/27 19:22:25 UTC

SPARK-15982 breaks external DataSources

hey,

since SPARK-15982 was fixed (https://github.com/apache/spark/pull/13727) i
believe all external DataSources that rely on using .load(path) without
being a FileFormat themselves are broken.

i noticed this because our unit tests for the elasticsearch datasource
broke.

i commented on the pullreq with the specific issue i am facing.

best,
koert

Re: SPARK-15982 breaks external DataSources

Posted by Reynold Xin <rx...@databricks.com>.

Yup this is bad. Can you create a JIRA ticket too?


On Mon, Jun 27, 2016 at 12:22 PM, Koert Kuipers <ko...@tresata.com> wrote:

> hey,
>
> since SPARK-15982 was fixed (https://github.com/apache/spark/pull/13727)
> i believe all external DataSources that rely on using .load(path) without
> being a FileFormat themselves are broken.
>
> i noticed this because our unit tests for the elasticsearch datasource
> broke.
>
> i commented on the pullreq with the specific issue i am facing.
>
> best,
> koert
>