You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "John Zhuge (JIRA)" <ji...@apache.org> on 2019/06/05 19:41:00 UTC
[jira] [Updated] (SPARK-27961) DataSourceV2Relation should not have
refresh method
[ https://issues.apache.org/jira/browse/SPARK-27961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
John Zhuge updated SPARK-27961:
-------------------------------
Description:
The newly added `Refresh` method in [PR #24401|https://github.com/apache/spark/pull/24401] prevented me from moving DataSourceV2Relation into catalyst. It calls `case table: FileTable => table.fileIndex.refresh()` while `FileTable` belongs to sql/core.
More importantly, [~rdblue] pointed out DataSourceV2Relation is immutable by design, it should not have refresh method.
was:
The newly added `Refresh` method in PR #24401 prevented me from moving DataSourceV2Relation into catalyst. It calls `case table: FileTable => table.fileIndex.refresh()` while `FileTable` belongs to sql/core.
More importantly, [~rdblue] pointed out DataSourceV2Relation is immutable by design, it should not have refresh method.
> DataSourceV2Relation should not have refresh method
> ---------------------------------------------------
>
> Key: SPARK-27961
> URL: https://issues.apache.org/jira/browse/SPARK-27961
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 3.0.0
> Reporter: John Zhuge
> Priority: Minor
>
> The newly added `Refresh` method in [PR #24401|https://github.com/apache/spark/pull/24401] prevented me from moving DataSourceV2Relation into catalyst. It calls `case table: FileTable => table.fileIndex.refresh()` while `FileTable` belongs to sql/core.
> More importantly, [~rdblue] pointed out DataSourceV2Relation is immutable by design, it should not have refresh method.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org