You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/03 03:28:02 UTC

[PR] [SPARK-50578][PYTHON][SS][FOLLOW-UP] Add the Python new package into setup.py [spark]

HyukjinKwon opened a new pull request, #50128:
URL: https://github.com/apache/spark/pull/50128

   ### What changes were proposed in this pull request?
   
   This PR is a followup of https://github.com/apache/spark/pull/49156 that adds the Python new package into `setup.py`.
   
   ### Why are the changes needed?
   
   So pip installed pyspark support states with streaming queries
   
   ### Does this PR introduce _any_ user-facing change?
   
   No, the main change has not been released out yet.
   
   ### How was this patch tested?
   
   Will monitor the scheduled build https://github.com/apache/spark/actions/runs/13618426037/job/38064498674
   
   ### Was this patch authored or co-authored using generative AI tooling?
   
   No.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org

Re: [PR] [SPARK-50578][PYTHON][SS][FOLLOW-UP] Add the Python new package into setup.py [spark]

Posted by "jingz-db (via GitHub)" <gi...@apache.org>.
jingz-db commented on PR #50128:
URL: https://github.com/apache/spark/pull/50128#issuecomment-2695343474

   > This is for a scheduled build that tests PySpark installed via PyPI. I think this PR fixes something different from what you mentioned.
   
   Oh I thought you were tagging me for fixing the failed flaky suite on CI.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org

Re: [PR] [SPARK-50578][PYTHON][SS][FOLLOW-UP] Add the Python new package into setup.py [spark]

Posted by "HyukjinKwon (via GitHub)" <gi...@apache.org>.
HyukjinKwon commented on PR #50128:
URL: https://github.com/apache/spark/pull/50128#issuecomment-2693193285

   cc @HeartSaVioR @jingz-db 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org

Re: [PR] [SPARK-50578][PYTHON][SS][FOLLOW-UP] Add the Python new package into setup.py [spark]

Posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org>.
dongjoon-hyun closed pull request #50128: [SPARK-50578][PYTHON][SS][FOLLOW-UP] Add the Python new package into setup.py
URL: https://github.com/apache/spark/pull/50128


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org

Re: [PR] [SPARK-50578][PYTHON][SS][FOLLOW-UP] Add the Python new package into setup.py [spark]

Posted by "HyukjinKwon (via GitHub)" <gi...@apache.org>.
HyukjinKwon commented on PR #50128:
URL: https://github.com/apache/spark/pull/50128#issuecomment-2693618427

   This is for a scheduled build that tests PySpark installed via PyPI. I think this PR fixes something different from what you mentioned.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org

Re: [PR] [SPARK-50578][PYTHON][SS][FOLLOW-UP] Add the Python new package into setup.py [spark]

Posted by "jingz-db (via GitHub)" <gi...@apache.org>.
jingz-db commented on PR #50128:
URL: https://github.com/apache/spark/pull/50128#issuecomment-2693428130

   > cc @HeartSaVioR @jingz-db
   
   Hey @HyukjinKwon , unfortunately this suite is flaky only on CI but I am not able to reproduce the failure locally. Could you run CI one more time and unblock yourself from merging your PR? I filed a JIRA to keep track of the fix (but I probably need sometime to investigate into it as I am not able to reproduce locally): https://issues.apache.org/jira/browse/SPARK-51368
   
   If you think this may impact the overall testing health of Spark tests, feel free to merge this PR for temporarily disabling the flaky schema evolution test case for spark connect suite here: https://github.com/apache/spark/pull/50130


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org