You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Josh Herzberg <jo...@audantic.com> on 2021/03/29 15:29:38 UTC

Error Message Suggestion

Hi,

I'd like to suggest this change to the PySpark code. I haven't contributed
before so https://spark.apache.org/contributing.html suggested emailing
here first.

In the error raised here
https://github.com/apache/spark/blob/b2bfe985e8adf55e5df5887340fd862776033a06/python/pyspark/worker.py#L141,
the columns returned can be difficult to identify. The error would be more
helpful and clear if the columns returned were included in the error
message like so,
[image: image.png]
Happy to help make this happen if I can. Thanks!

Josh

Re: Error Message Suggestion

Posted by Sean Owen <sr...@gmail.com>.
Sure, just open a pull request?

On Mon, Mar 29, 2021 at 10:37 AM Josh Herzberg <jo...@audantic.com> wrote:

> Hi,
>
> I'd like to suggest this change to the PySpark code. I haven't contributed
> before so https://spark.apache.org/contributing.html suggested emailing
> here first.
>
> In the error raised here
> https://github.com/apache/spark/blob/b2bfe985e8adf55e5df5887340fd862776033a06/python/pyspark/worker.py#L141,
> the columns returned can be difficult to identify. The error would be more
> helpful and clear if the columns returned were included in the error
> message like so,
> [image: image.png]
> Happy to help make this happen if I can. Thanks!
>
> Josh
>