You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "huanghanyu-vungle (via GitHub)" <gi...@apache.org> on 2023/04/25 07:23:16 UTC

[GitHub] [iceberg] huanghanyu-vungle opened a new issue, #7427: Whether to support using spark to create Iceberg View

huanghanyu-vungle opened a new issue, #7427:
URL: https://github.com/apache/iceberg/issues/7427

   ### Query engine
   
   spark 
   
   ### Question
   
   use jar: iceberg-spark-runtime-3.3_2.12-1.2.1.jar
   config("spark.sql.catalog.hive_stg", "org.apache.iceberg.spark.SparkCatalog")
   sql:
   `spark.sql("CREATE VIEW hive_stg.xxx.common_view AS select min(ingest_time) as s, max(ingest_time) as t from hive_stg.xxxx.xxxx").show()`
   
   error: Catalog hive_stg does not support views
   
   It seems that the view is not supported
   but I saw that it is mentioned in the documentation that it already supports : https://iceberg.apache.org/view-spec/
   
   Is there something wrong with my use?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


[GitHub] [iceberg] nastra commented on issue #7427: Whether to support using spark to create Iceberg View

Posted by "nastra (via GitHub)" <gi...@apache.org>.
nastra commented on issue #7427:
URL: https://github.com/apache/iceberg/issues/7427#issuecomment-1521366079

   The view spec has been defined and is currently being implemented to the Java APIs, but there is no View support for Spark yet


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


[GitHub] [iceberg] nastra commented on issue #7427: Whether to support using spark to create Iceberg View

Posted by "nastra (via GitHub)" <gi...@apache.org>.
nastra commented on issue #7427:
URL: https://github.com/apache/iceberg/issues/7427#issuecomment-1523753307

   I'm going to close this. @huanghanyu-vungle please feel free to re-open if necessary


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


[GitHub] [iceberg] nastra closed issue #7427: Whether to support using spark to create Iceberg View

Posted by "nastra (via GitHub)" <gi...@apache.org>.
nastra closed issue #7427: Whether to support using spark to create Iceberg View
URL: https://github.com/apache/iceberg/issues/7427


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


[GitHub] [iceberg] aokolnychyi commented on issue #7427: Whether to support using spark to create Iceberg View

Posted by "aokolnychyi (via GitHub)" <gi...@apache.org>.
aokolnychyi commented on issue #7427:
URL: https://github.com/apache/iceberg/issues/7427#issuecomment-1523792862

   @huanghanyu-vungle, you can use Spark views in the session catalog. That's the only catalog that supports views in Spark at the moment.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org