You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@gluten.apache.org by "zhouyuan (via GitHub)" <gi...@apache.org> on 2025/03/24 17:15:08 UTC

[I] [VL] new setuptools is not working with old pyspark [incubator-gluten]

zhouyuan opened a new issue, #9123:
URL: https://github.com/apache/incubator-gluten/issues/9123

   ### Backend
   
   VL (Velox)
   
   ### Bug description
   
   ```
   Collecting pyspark==3.3.1
     Downloading pyspark-3.3.1.tar.gz (281.4 MB)
       ERROR: Command errored out with exit status 1:
        command: /usr/bin/python3.9 -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-tue1bbz_/pyspark/setup.py'"'"'; __file__='"'"'/tmp/pip-install-tue1bbz_/pyspark/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base /tmp/pip-pip-egg-info-s8__4pvj
            cwd: /tmp/pip-install-tue1bbz_/pyspark/
       Complete output (15 lines):
       Traceback (most recent call last):
         File "<string>", line 1, in <module>
         File "/tmp/pip-install-tue1bbz_/pyspark/setup.py", line 199, in <module>
           setup(
         File "/usr/local/lib/python3.9/site-packages/setuptools/__init__.py", line 116, in setup
           _install_setup_requires(attrs)
         File "/usr/local/lib/python3.9/site-packages/setuptools/__init__.py", line 87, in _install_setup_requires
           dist.parse_config_files(ignore_option_errors=True)
         File "/usr/local/lib/python3.9/site-packages/setuptools/dist.py", line 730, in parse_config_files
           self._parse_config_files(filenames=inifiles)
         File "/usr/local/lib/python3.9/site-packages/setuptools/dist.py", line 599, in _parse_config_files
           opt = self._enforce_underscore(opt, section)
         File "/usr/local/lib/python3.9/site-packages/setuptools/dist.py", line 629, in _enforce_underscore
           raise InvalidConfigError(
       setuptools.errors.InvalidConfigError: Invalid dash-separated key 'description-file' in 'metadata' (setup.cfg), please use the underscore name 'description_file' instead.
       ----------------------------------------
   ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.
   ```
   
   ### Spark version
   
   None
   
   ### Spark configurations
   
   _No response_
   
   ### System information
   
   _No response_
   
   ### Relevant logs
   
   ```bash
   
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org

Re: [I] [VL] new setuptools is not working with old pyspark [incubator-gluten]

Posted by "zhouyuan (via GitHub)" <gi...@apache.org>.
zhouyuan closed issue #9123: [VL] new setuptools is not working with old pyspark
URL: https://github.com/apache/incubator-gluten/issues/9123


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org

Re: [I] [VL] new setuptools is not working with old pyspark [incubator-gluten]

Posted by "zhouyuan (via GitHub)" <gi...@apache.org>.
zhouyuan commented on issue #9123:
URL: https://github.com/apache/incubator-gluten/issues/9123#issuecomment-2748859315

   the new release of setuptools requires some format of setup.cfg, which is not ready in old pyspark
   https://github.com/pypa/setuptools/issues/4910


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org