[GitHub] [hudi] YannByron commented on pull request #5943: [HUDI-4186] Support Hudi with Spark 3.3.0

[GitBox <gi...@apache.org>]

YannByron commented on PR #5943:
URL: https://github.com/apache/hudi/pull/5943#issuecomment-1196208725

   > @alexeykudinkin @XuQianJin-Stars @YannByron This PR is going to add support for Spark 3.3. In the long term, how should we maintain the support matrix for Spark in Hudi? Do we deprecate the support for older Spark versions as we add new versions? cc @xushiyan @vinothchandar
   
   It's not easy to decide.
   Like delta lake, its latest version just supports the current latest version of spark, and it never consider to support the new features and the older spark version at its same version. If users need these, port the new features to the version that they own maintain. After all, i think most production users will not follow the Spark release iteration in a timely manner.
   maybe we can support the two or three latest spark version to provide some convenience to our users.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org