You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@phoenix.apache.org by twdsilva <gi...@git.apache.org> on 2019/01/03 05:51:40 UTC
[GitHub] phoenix issue #423: PHOENIX-5059 Use the Datasource v2 api in the spark conn...
Github user twdsilva commented on the issue:
https://github.com/apache/phoenix/pull/423
The PR adds ```PhoenixDataSource``` which implements the new [DataSourceV2 API](https://issues.apache.org/jira/browse/SPARK-15689). This will allow further optimizations in the future such as limit and aggregate pushdown, see [SPARK-22386](https://issues.apache.org/jira/browse/SPARK-22386)
```PhoenixSparkIT``` and ```PhoenixSparkITTenantSpecific``` were converted to use this API.
```PhoenixRelation``` and related classes that implemented the old API were deprecated.
I also bumped up the spark version to 2.4.0 and set the java source and target version to 1.8 for the maven-compiler-plugin.
@jmahonin can you please review?
---