You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by "chenruotao (via GitHub)" <gi...@apache.org> on 2023/05/08 08:32:00 UTC
[GitHub] [spark] chenruotao opened a new pull request, #41090: [SPARK-43406][SQL] enable spark sql to drop multiple partitions in on…
chenruotao opened a new pull request, #41090:
URL: https://github.com/apache/spark/pull/41090
Now spark sql cannot drop multiple partitions in one call, so I fix it
With this patch we can drop multiple partitions like this :
alter table test.table_partition drop partition(dt<='2023-04-02', dt>='2023-03-31')
this is my test demo with hms
1、insert five data into partitioned table test.table_partition
insert into table test.table_partition partition(dt='2023-03-30') values('chenruotao','100');
insert into table test.table_partition partition(dt='2023-03-31') values('chenruotao','100');
insert into table test.table_partition partition(dt='2023-04-01') values('chenruotao','100');
insert into table test.table_partition partition(dt='2023-04-02') values('chenruotao','100');
insert into table test.table_partition partition(dt='2023-04-03') values('chenruotao','100');
<img width="420" alt="image" src="https://user-images.githubusercontent.com/20615138/236775512-d54fa998-7f0b-40d9-ae30-7c2de6e7facc.png">
2、execute sql to drop multiple partitions：
alter table test.table_partition drop partition(dt<='2023-04-02', dt>='2023-03-31');
<img width="394" alt="image" src="https://user-images.githubusercontent.com/20615138/236775777-2ba14634-0a87-4fee-a819-38774273fb1e.png">
3、execute sql to drop one partitions：
alter table test.table_partition drop partition(dt='2023-03-30');
<img width="321" alt="image" src="https://user-images.githubusercontent.com/20615138/236775891-ea53f3fb-e670-4cdc-8765-45d56d5d156e.png">
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] github-actions[bot] closed pull request #41090: [SPARK-43406][SQL] enable spark sql to drop multiple partitions in on…
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed pull request #41090: [SPARK-43406][SQL] enable spark sql to drop multiple partitions in on…
URL: https://github.com/apache/spark/pull/41090
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-43406][SQL] enable spark sql to drop multiple partitions in on… [spark]
Posted by "zviklausner (via GitHub)" <gi...@apache.org>.
zviklausner commented on PR #41090:
URL: https://github.com/apache/spark/pull/41090#issuecomment-2088156388
Hi
Can we please reopen this and get this issue released, we would benefit a lot from this feature
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-43406][SQL] enable spark sql to drop multiple partitions in on… [spark]
Posted by "chenruotao (via GitHub)" <gi...@apache.org>.
chenruotao commented on PR #41090:
URL: https://github.com/apache/spark/pull/41090#issuecomment-2088170823
> Hi Can we please reopen this and get this issue released, we would benefit a lot from this feature
me too, but no one cared about this feature some time ago，so it closed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] github-actions[bot] commented on pull request #41090: [SPARK-43406][SQL] enable spark sql to drop multiple partitions in on…
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #41090:
URL: https://github.com/apache/spark/pull/41090#issuecomment-1681425475
We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable.
If you'd like to revive this PR, please reopen it and ask a committer to remove the Stale tag!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org