You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Jacek Laskowski <ja...@japila.pl> on 2020/08/08 12:36:24 UTC
Why is V2SessionCatalog not a CatalogExtension?
Hi,
Just started exploring Catalog Plugin API and noticed these two classes:
CatalogExtension and V2SessionCatalog.
Why is V2SessionCatalog not a CatalogExtension?
- V2SessionCatalog extends TableCatalog with SupportsNamespaces [1]
- CatalogExtension extends TableCatalog, SupportsNamespaces [2]
[1]
https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/V2SessionCatalog.scala#L41
[2]
https://github.com/apache/spark/blob/master/sql/catalyst/src/main/java/org/apache/spark/sql/connector/catalog/CatalogExtension.java#L33
Pozdrawiam,
Jacek Laskowski
----
https://about.me/JacekLaskowski
"The Internals Of" Online Books <https://books.japila.pl/>
Follow me on https://twitter.com/jaceklaskowski
<https://twitter.com/jaceklaskowski>
Re: Why is V2SessionCatalog not a CatalogExtension?
Posted by Russell Spitzer <ru...@gmail.com>.
A v2catalog can stand alone, it doesn't have to extend the built in catalog.
On Sat, Aug 8, 2020, 7:36 AM Jacek Laskowski <ja...@japila.pl> wrote:
> Hi,
>
> Just started exploring Catalog Plugin API and noticed these two classes:
> CatalogExtension and V2SessionCatalog.
>
> Why is V2SessionCatalog not a CatalogExtension?
>
> - V2SessionCatalog extends TableCatalog with SupportsNamespaces [1]
> - CatalogExtension extends TableCatalog, SupportsNamespaces [2]
>
> [1]
> https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/V2SessionCatalog.scala#L41
> [2]
> https://github.com/apache/spark/blob/master/sql/catalyst/src/main/java/org/apache/spark/sql/connector/catalog/CatalogExtension.java#L33
>
> Pozdrawiam,
> Jacek Laskowski
> ----
> https://about.me/JacekLaskowski
> "The Internals Of" Online Books <https://books.japila.pl/>
> Follow me on https://twitter.com/jaceklaskowski
>
> <https://twitter.com/jaceklaskowski>
>