You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Tian Gao (Jira)" <ji...@apache.org> on 2025/11/27 22:03:00 UTC

[jira] [Created] (SPARK-54543) Improve lint on PySpark

Tian Gao created SPARK-54543:
--------------------------------

             Summary: Improve lint on PySpark
                 Key: SPARK-54543
                 URL: https://issues.apache.org/jira/browse/SPARK-54543
             Project: Spark
          Issue Type: Umbrella
          Components: PySpark
    Affects Versions: 4.2.0
            Reporter: Tian Gao


Our lint system for python is not well maintained. For example, the pinned version of `flake8` was released 4 years ago - and it can't even run with Python3.12+.

Upgrading the whole lint system in a single PR introduces too many conflicts and will block people's daily workflow. It's also a nightmare for code sync.

We should try to gradually upgrade the lint system, making our code more robust and easier to maintain.

This JIRA will serve as an umbrella system for all lint related upgrades.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org