You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Guowei Ma (Jira)" <ji...@apache.org> on 2026/06/01 03:31:00 UTC
[jira] [Updated] (FLINK-39807) [umbrella] FLIP-577: AI-Native Flink — Umbrella for Multimodal Data Processing
[ https://issues.apache.org/jira/browse/FLINK-39807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Guowei Ma updated FLINK-39807:
------------------------------
Description:
This is the umbrella issue tracking FLIP-577: AI-Native Flink — An Umbrella Proposal for Multimodal Data Processing.
_FLIP:_ [FLIP-577|[https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=421957275]]
_Discussion thread:_ [dev@ thread|[https://lists.apache.org/thread/l5obwo4kvjblqnx24btsv4rwjwoflb6d]]
User workloads are shifting from BI analytics to multimodal data processing centered on model inference — data expands from structured records to images/video/audio/embeddings, resources move from CPU to mixed CPU/GPU, and execution moves from row-oriented to vectorized batch. This umbrella proposes evolving Flink from a unified stream-batch compute engine into one that natively supports AI workloads (AI-Native), decomposed into 11 sub-FLIPs across three layers:
* _Layer 1 — Core Runtime Primitives:_ RpcOperator; multimodal type system and OBJECT_REF.
* _Layer 2 — Workload Expression and Execution:_ Python DataFrame API; multimodal Source/Sink connector API; GPU resource declaration and independent deployment; built-in multimodal operators and AI functions; Arrow columnar transport.
* _Layer 3 — Production-Grade Operational Guarantees:_ non-disruptive scaling for CPU and GPU operators; Unaligned Checkpoint enhancements; Pipeline-Region-based independent checkpoints.
Most sub-FLIPs have no hard dependencies and can be advanced in parallel. This umbrella seeks consensus on the overall direction only; detailed design and APIs are deferred to each sub-FLIP. All changes are incremental. Sub-FLIPs will be tracked as separate issues and linked here.
was:
This is the umbrella issue tracking FLIP-577: AI-Native Flink — An Umbrella Proposal for Multimodal Data Processing.
_FLIP:_ [FLIP-577|[https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=421957275]] _Discussion thread:_ [dev@ thread|[https://lists.apache.org/thread/l5obwo4kvjblqnx24btsv4rwjwoflb6d]]
User workloads are shifting from BI analytics to multimodal data processing centered on model inference — data expands from structured records to images/video/audio/embeddings, resources move from CPU to mixed CPU/GPU, and execution moves from row-oriented to vectorized batch. This umbrella proposes evolving Flink from a unified stream-batch compute engine into one that natively supports AI workloads (AI-Native), decomposed into 11 sub-FLIPs across three layers:
* _Layer 1 — Core Runtime Primitives:_ RpcOperator; multimodal type system and OBJECT_REF.
* _Layer 2 — Workload Expression and Execution:_ Python DataFrame API; multimodal Source/Sink connector API; GPU resource declaration and independent deployment; built-in multimodal operators and AI functions; Arrow columnar transport.
* _Layer 3 — Production-Grade Operational Guarantees:_ non-disruptive scaling for CPU and GPU operators; Unaligned Checkpoint enhancements; Pipeline-Region-based independent checkpoints.
Most sub-FLIPs have no hard dependencies and can be advanced in parallel. This umbrella seeks consensus on the overall direction only; detailed design and APIs are deferred to each sub-FLIP. All changes are incremental. Sub-FLIPs will be tracked as separate issues and linked here.
> [umbrella] FLIP-577: AI-Native Flink — Umbrella for Multimodal Data Processing
> ------------------------------------------------------------------------------
>
> Key: FLINK-39807
> URL: https://issues.apache.org/jira/browse/FLINK-39807
> Project: Flink
> Issue Type: New Feature
> Reporter: Guowei Ma
> Assignee: Guowei Ma
> Priority: Major
>
> This is the umbrella issue tracking FLIP-577: AI-Native Flink — An Umbrella Proposal for Multimodal Data Processing.
> _FLIP:_ [FLIP-577|[https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=421957275]]
> _Discussion thread:_ [dev@ thread|[https://lists.apache.org/thread/l5obwo4kvjblqnx24btsv4rwjwoflb6d]]
> User workloads are shifting from BI analytics to multimodal data processing centered on model inference — data expands from structured records to images/video/audio/embeddings, resources move from CPU to mixed CPU/GPU, and execution moves from row-oriented to vectorized batch. This umbrella proposes evolving Flink from a unified stream-batch compute engine into one that natively supports AI workloads (AI-Native), decomposed into 11 sub-FLIPs across three layers:
> * _Layer 1 — Core Runtime Primitives:_ RpcOperator; multimodal type system and OBJECT_REF.
> * _Layer 2 — Workload Expression and Execution:_ Python DataFrame API; multimodal Source/Sink connector API; GPU resource declaration and independent deployment; built-in multimodal operators and AI functions; Arrow columnar transport.
> * _Layer 3 — Production-Grade Operational Guarantees:_ non-disruptive scaling for CPU and GPU operators; Unaligned Checkpoint enhancements; Pipeline-Region-based independent checkpoints.
> Most sub-FLIPs have no hard dependencies and can be advanced in parallel. This umbrella seeks consensus on the overall direction only; detailed design and APIs are deferred to each sub-FLIP. All changes are incremental. Sub-FLIPs will be tracked as separate issues and linked here.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)