You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Aakash Basu <ra...@gmail.com> on 2016/05/24 06:43:54 UTC

Spark JOIN Not working

Hi experts,

I'm extremely new to the Spark Ecosystem, hence need a help from you guys.
While trying to fetch data from CSV files and join querying them in
accordance to the need, when I'm caching the data by using
registeredTempTables and then using select query to select what I need as
per the given condition, I'm getting the data. BUT when I'm trying to do
the same query using JOIN, I'm getting zero results.

Both the codes attached are same, except a few differences, like the
Running_Code.scala uses the Select Query and the
ProductHierarchy_Dimension.scala uses the JOIN queries.

Please help me out in this. Stuck for two long days.

Thanks,
Aakash.

Re: Spark JOIN Not working

Posted by Alonso Isidoro Roman <al...@gmail.com>.
Could you share a bit of the dataset? difficult to test without data...

Alonso Isidoro Roman
[image: https://]about.me/alonso.isidoro.roman
<https://about.me/alonso.isidoro.roman?promo=email_sig&utm_source=email_sig&utm_medium=email_sig&utm_campaign=external_links>

2016-05-24 8:43 GMT+02:00 Aakash Basu <ra...@gmail.com>:

> Hi experts,
>
> I'm extremely new to the Spark Ecosystem, hence need a help from you guys.
> While trying to fetch data from CSV files and join querying them in
> accordance to the need, when I'm caching the data by using
> registeredTempTables and then using select query to select what I need as
> per the given condition, I'm getting the data. BUT when I'm trying to do
> the same query using JOIN, I'm getting zero results.
>
> Both the codes attached are same, except a few differences, like the
> Running_Code.scala uses the Select Query and the
> ProductHierarchy_Dimension.scala uses the JOIN queries.
>
> Please help me out in this. Stuck for two long days.
>
> Thanks,
> Aakash.
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>