You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Apache Spark (Jira)" <ji...@apache.org> on 2020/07/30 15:08:00 UTC

[jira] [Assigned] (SPARK-29886) Add support for Spark style HashDistribution and Partitioning to V2 Datasource

     [ https://issues.apache.org/jira/browse/SPARK-29886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Apache Spark reassigned SPARK-29886:
------------------------------------

    Assignee: Apache Spark

> Add support for Spark style HashDistribution and Partitioning to V2 Datasource
> ------------------------------------------------------------------------------
>
>                 Key: SPARK-29886
>                 URL: https://issues.apache.org/jira/browse/SPARK-29886
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 3.1.0
>            Reporter: Andrew K Long
>            Assignee: Apache Spark
>            Priority: Major
>
> Currently a v2 datasource does not have the ability specify that its Distribution iscompatible with sparks HashClusteredDistribution.  We need to add the appropriate class in the interface and add support in DataSourcePartitioning so that EnsureRequirements is aware of the tables partitioning.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org