You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@spark.apache.org by bo yang <bo...@gmail.com> on 2018/10/12 05:00:04 UTC

Support structured plan logging

Hi All,

Are there any people interested in adding structured plan logging in Spark?
Currently the logical/physical plan could be logged as plain text via
explain() method, which has some issues, for example, string truncation and
difficult for tool/program to use.

This PR <https://github.com/apache/spark/pull/22429> fixes the truncation
issue. A further step is to log the plan as structured content (e.g. json).
Do other people feel similar need?

Thanks,
Bo