You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/10/15 15:03:56 UTC

[GitHub] [arrow-datafusion] francis-du opened a new issue, #3842: Support cache/uncache table syntax

francis-du opened a new issue, #3842:
URL: https://github.com/apache/arrow-datafusion/issues/3842

   **Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
   
   Currently, DataFrame can cache tables in memory, but cannot cache DataFusion tables or views through SQL. 
   
   **Describe the solution you'd like**
   
   I want to cache views and tables via `CACHE TABLE <table_name>` syntax like Spark SQL.At the same time, it is also necessary to support the `UNCACHE TABLE <table_name>` syntax to allow users to delete tables and views that do not require caching in memory.
   
   Here are some docs about`CACHE TABLE` and `UNCACHE TABLE` in Spark SQL:
   
   1.`CACHE TABLE`: https://docs.databricks.com/spark/latest/spark-sql/language-manual/sql-ref-syntax-aux-cache-cache-table.html
   
   2.`UNCACHE TABLE`: https://docs.databricks.com/spark/latest/spark-sql/language-manual/sql-ref-syntax-aux-cache-uncache-table.html
   
   **Describe alternatives you've considered**
   
   I has been implemented the syntax in https://github.com/sqlparser-rs/sqlparser-rs/pull/670, I will support it in DataFusion next, if anyone is interested, welcome to discuss here.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-datafusion] francis-du commented on issue #3842: [SQL] - Support cache/uncache table syntax

Posted by GitBox <gi...@apache.org>.
francis-du commented on issue #3842:
URL: https://github.com/apache/arrow-datafusion/issues/3842#issuecomment-1279770633

   I looked at some code and I found `CREATE TABLE` is indeed possible to create an in-memory table. And also use`DROP TABLE` uncache in-memory table. 😢


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-datafusion] francis-du closed issue #3842: [SQL] - Support cache/uncache table syntax

Posted by GitBox <gi...@apache.org>.
francis-du closed issue #3842: [SQL] - Support cache/uncache table syntax
URL: https://github.com/apache/arrow-datafusion/issues/3842


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-datafusion] Dandandan commented on issue #3842: [SQL] - Support cache/uncache table syntax

Posted by GitBox <gi...@apache.org>.
Dandandan commented on issue #3842:
URL: https://github.com/apache/arrow-datafusion/issues/3842#issuecomment-1279768151

   How much different is this from `CREATE TABLE AS` (which currently also creates an in memory table)?
   
   I am not necessarily against this, but I think the syntax is very spark-specific. We can do about the same currently?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-datafusion] francis-du commented on issue #3842: [SQL] - Support cache/uncache table syntax

Posted by GitBox <gi...@apache.org>.
francis-du commented on issue #3842:
URL: https://github.com/apache/arrow-datafusion/issues/3842#issuecomment-1279771078

   It doesn't look like it's necessary to support those syntax 😥


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org