You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2026/02/09 07:07:00 UTC

[jira] [Updated] (FLINK-39050) Support configurable handling strategy for null rowtime field in watermark generation

     [ https://issues.apache.org/jira/browse/FLINK-39050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ASF GitHub Bot updated FLINK-39050:
-----------------------------------
    Labels: pull-request-available  (was: )

> Support configurable handling strategy for null rowtime field in watermark generation
> -------------------------------------------------------------------------------------
>
>                 Key: FLINK-39050
>                 URL: https://issues.apache.org/jira/browse/FLINK-39050
>             Project: Flink
>          Issue Type: Improvement
>          Components: Table SQL / Planner
>            Reporter: Liu
>            Priority: Major
>              Labels: pull-request-available
>
> h1. Background
> When using event time processing with Flink SQL, if the rowtime field is null, 
> WatermarkAssignerOperator throws a RuntimeException, causing the entire job to fail.
> In production environments, data quality issues may occasionally produce records with 
> null timestamp fields. The current fail-fast behavior lacks flexibility for users who 
> prefer to handle such dirty data gracefully.
> h1. Proposal
> Introduce a new configuration `table.exec.source.rowtime-null-handling` with the 
> following options:
> - FAIL (default): Current behavior, throw exception
> - DROP: Drop the record silently  
> - SKIP_WATERMARK: Forward the record without advancing watermark
> Additionally, add metrics to track the number of records affected by null rowtime.
> h1. Motivation
> 1. Improve fault tolerance for data quality issues
> 2. Align with existing patterns like `json.ignore-parse-errors`
> 3. Provide observability through metrics
> 4. Maintain backward compatibility with default FAIL behavior



--
This message was sent by Atlassian Jira
(v8.20.10#820010)