You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by lokkju <gi...@git.apache.org> on 2017/10/26 15:05:38 UTC

[GitHub] spark issue #16479: [SPARK-19085][SQL] cleanup OutputWriterFactory and Outpu...

Github user lokkju commented on the issue:

    https://github.com/apache/spark/pull/16479
  
    So it turns out just copying the conversion code doesn't work, as seen in spark-avro/#240 - and now I'm running into the same thing writing my own datasource.  As an datasource in the end requires implementing a class that extends OutputWriter, and the OutputWriter interface changed, a datasource plugin doesn't seem to be able to support both pre and post versions of 2.2.x in the same plugin.
    
    Any suggestions on how to handle this, without requiring users to match a the spark version to the new datasource version?


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org