You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@phoenix.apache.org by twdsilva <gi...@git.apache.org> on 2019/01/03 05:51:40 UTC

[GitHub] phoenix issue #423: PHOENIX-5059 Use the Datasource v2 api in the spark conn...

Github user twdsilva commented on the issue:

    https://github.com/apache/phoenix/pull/423
  
    The PR adds ```PhoenixDataSource``` which implements the new [DataSourceV2 API](https://issues.apache.org/jira/browse/SPARK-15689). This will allow further optimizations in the future such as limit and aggregate pushdown, see [SPARK-22386](https://issues.apache.org/jira/browse/SPARK-22386) 
    
    ```PhoenixSparkIT``` and ```PhoenixSparkITTenantSpecific``` were converted to use this API. 
    ```PhoenixRelation``` and related classes that implemented the old API were deprecated.
    I also bumped up the spark version to  2.4.0 and set the java source and target version to 1.8 for the maven-compiler-plugin.
    
    @jmahonin can you please review?



---