You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Nikolina Vraneš (Jira)" <ji...@apache.org> on 2026/07/15 15:35:00 UTC
[jira] [Updated] (SPARK-58139) Improve BIN BY test coverage for DST and bin alignment
[ https://issues.apache.org/jira/browse/SPARK-58139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nikolina Vraneš updated SPARK-58139:
------------------------------------
Description:
Add BIN BY execution test coverage for day-time interval edge cases that share the time_bucket bin-boundary arithmetic:
- DST fall-back: a 1-day LTZ bin across the 2024-11-03 fall-back (the 25-hour day gets a larger ratio share than an adjacent 24-hour day), and a compound 2-day width across the same transition.
- Sub-day bin in a non-UTC session, exercising the UTC-arithmetic path (distinct from the civil-time path the multi-day tests use).
- ALIGN TO an origin later than the range, exercising the negative step-back in the bin-boundary arithmetic.
Test-only. Sub-task of SPARK-57133.
was:
BinBySuite covers a DST spring-forward (23-hour day) LTZ case but not the fall-back (25-hour day) case. They are asymmetric: spring-forward shortens a day and fall-back lengthens it, and bin_distribute_ratio divides overlap by real elapsed microseconds, so a bin over the 25-hour day must get a larger share than an adjacent 24-hour day.
Add test coverage for a 1-day LTZ bin across the 2024-11-03 fall-back in America/Los_Angeles, and a compound multi-day width across a DST transition. Test-only.
Sub-task of SPARK-57133.
Summary: Improve BIN BY test coverage for DST and bin alignment (was: Add BIN BY DST fall-back test coverage)
> Improve BIN BY test coverage for DST and bin alignment
> ------------------------------------------------------
>
> Key: SPARK-58139
> URL: https://issues.apache.org/jira/browse/SPARK-58139
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Affects Versions: 5.0.0
> Reporter: Nikolina Vraneš
> Priority: Major
>
> Add BIN BY execution test coverage for day-time interval edge cases that share the time_bucket bin-boundary arithmetic:
> - DST fall-back: a 1-day LTZ bin across the 2024-11-03 fall-back (the 25-hour day gets a larger ratio share than an adjacent 24-hour day), and a compound 2-day width across the same transition.
> - Sub-day bin in a non-UTC session, exercising the UTC-arithmetic path (distinct from the civil-time path the multi-day tests use).
> - ALIGN TO an origin later than the range, exercising the negative step-back in the bin-boundary arithmetic.
> Test-only. Sub-task of SPARK-57133.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org