You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@spark.apache.org by Jacek Laskowski <ja...@japila.pl> on 2018/02/03 18:33:41 UTC

[SQL] Why CatalogImpl.refreshTable considers views special (vs SessionCatalog.refreshTable)?

Hi,

I just found out that CatalogImpl.refreshTable [1] considers views special
and triggers refresh explicitly even though SessionCatalog.refreshTable
does it for all table types [2]?

It seems that CatalogImpl.refreshTable makes it unnecessarily.

[1]
https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/internal/CatalogImpl.scala#L483

[2]
https://github.com/apache/spark/blob/master/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/SessionCatalog.scala#L750-L754

Pozdrawiam,
Jacek Laskowski
----
https://about.me/JacekLaskowski
Mastering Spark SQL https://bit.ly/mastering-spark-sql
Spark Structured Streaming https://bit.ly/spark-structured-streaming
Mastering Kafka Streams https://bit.ly/mastering-kafka-streams
Follow me at https://twitter.com/jaceklaskowski