You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Shyam P <sh...@gmail.com> on 2019/03/06 06:31:27 UTC
Re: How to group dataframe year-wise and iterate through groups and
send each year to dataframe to executor?
Thanks a lot Roman.
But provided link as several ways to deal the problem.
Why do we need to do operation on RDD instead dataframe/dataset ?
Do I need a custom partitioner in my case , how to invoke it in spark-sql?
Can anyone provide some sample on handling skewed data with spark-sql?
Thanks,
Shyam
>