You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Arpan Bhandari <ar...@gmail.com> on 2021/02/01 15:38:49 UTC
Re: Spark SQL query
Hey Sachit,
It shows the query plan, which is difficult to diagnose out and depict the
actual query.
Thanks,
Arpan Bhandari
--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org
Re: Spark SQL query
Posted by Arpan Bhandari <ar...@gmail.com>.
Sanchit,
It seems I have to do some sort of analysis from the plan to get the query.
Appreciate all your help on this.
Thanks,
Arpan Bhandari
--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org
Re: Spark SQL query
Posted by Sachit Murarka <co...@gmail.com>.
Application wise it wont show as such.
You can try to corelate it with explain plain output using some filters or
attribute.
Or else if you do not have too much queries in history. Just take queries
and find plan of those queries and match it with shown in UI.
I know thats the tedious task. But I dont think that there is other way.
Thanks
Sachit
On Mon, 1 Feb 2021, 22:32 Arpan Bhandari, <ar...@gmail.com> wrote:
> Sachit,
>
> That is showing all the queries that got executed, but how it would get
> mapped to specific application Id it was associated with ?
>
> Thanks,
> Arpan Bhandari
>
>
>
> --
> Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>
>
Re: Spark SQL query
Posted by Arpan Bhandari <ar...@gmail.com>.
Sachit,
That is showing all the queries that got executed, but how it would get
mapped to specific application Id it was associated with ?
Thanks,
Arpan Bhandari
--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org
Re: Spark SQL query
Posted by Sachit Murarka <co...@gmail.com>.
Hi arpan,
In spark shell when you type
:history.
then also it is not showing?
Thanks
Sachit
On Mon, 1 Feb 2021, 21:13 Arpan Bhandari, <ar...@gmail.com> wrote:
> Hey Sachit,
>
> It shows the query plan, which is difficult to diagnose out and depict the
> actual query.
>
>
> Thanks,
> Arpan Bhandari
>
>
>
> --
> Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>
>