You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@streampark.apache.org by "shangeyao (via GitHub)" <gi...@apache.org> on 2026/07/14 13:01:33 UTC
[I] [Flink] Remove StreamPark dev framework and connector wrappers [streampark]
shangeyao opened a new issue, #4431:
URL: https://github.com/apache/streampark/issues/4431
## Summary
Remove the StreamPark **development framework** documented at https://streampark.apache.org/docs/framework/, including:
- User dev API traits: `FlinkStreaming`, `FlinkTable`, `FlinkStreamTable`, `DataStreamExt`
- Flink connector wrapper modules (`streampark-flink-connector-*`)
- Spark dev traits: `SparkStreaming`, `SparkBatch`, `Spark`
- Spark connector wrapper modules (`streampark-spark-connector-*`)
- Maven `-Pconnector` profile
Console platform capabilities (submit/cancel, SQL mode, SQL validation, K8s, packaging) remain on `shims-base` and refactored sqlclient modules.
## Motivation
- Align with Flink ecosystem direction (Java DataStream / Table API; Flink 2.x dropped Scala DataStream API)
- Reduce maintenance surface (~340 connector/framework source files)
- Separate **platform runtime** from **user authoring SDK**
## Breaking changes
- User jobs extending `FlinkStreaming` / `FlinkTable` / `SparkStreaming` / `SparkBatch` must migrate to native Flink/Spark APIs
- User code importing `org.apache.streampark.flink.connector.*` or `org.apache.streampark.spark.connector.*` must migrate to official connectors
## Non-breaking (preserved)
- Console Flink/Spark SQL job submission via `SqlClient`
- SQL validation (`FlinkSqlValidator`, `SparkSqlValidator`)
- Flink client, packer, kubernetes, shims
## Implementation
PR to follow on branch `feature/remove-dev-framework` (based on `dev`).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Flink] Remove StreamPark dev framework and connector wrappers [streampark]
Posted by "wolfboys (via GitHub)" <gi...@apache.org>.
wolfboys closed issue #4431: [Flink] Remove StreamPark dev framework and connector wrappers
URL: https://github.com/apache/streampark/issues/4431
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org