You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/18 02:11:00 UTC
[jira] [Commented] (SPARK-37353) Resolved attribute(s) region_id#7993 missing from lm_tam_code#2666,ld_month#2697,geo_sub_district_id#2677 when doing left join
[ https://issues.apache.org/jira/browse/SPARK-37353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17445581#comment-17445581 ]
Hyukjin Kwon commented on SPARK-37353:
--------------------------------------
[~anubhavprince100] mind showing self-contained reproducer? Seems difficult to reproduce.
> Resolved attribute(s) region_id#7993 missing from lm_tam_code#2666,ld_month#2697,geo_sub_district_id#2677 when doing left join
> -------------------------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-37353
> URL: https://issues.apache.org/jira/browse/SPARK-37353
> Project: Spark
> Issue Type: Bug
> Components: Build
> Affects Versions: 2.4.0
> Reporter: Anubhav Tarar
> Priority: Major
>
> For this Code i m getting error
> var df = totalTimeFootfallDf.join(dwellTimeDf,Seq(groupByKeys: _*),"left_outer")
> org.apache.spark.sql.AnalysisException: Resolved attribute(s) region_id#7993 missing from lm_tam_code#2666,ld_month#2697,geo_sub_district_id#2677,lm_subldm_id#2652,geo_province_name_th#2689,lm_amp_code#2665,lm_cat_name_t#2675,lm_prov_code#2664,lm_sub_name_t#2672,lm_name_branch#2694,region_id#422,lm_update_dttm#2669,mkt_region_name_en#2692,lm_radius#369,geo_province_id#2679,lm_name#2655,geo_province_name_en#2684,lm_name_fld_t#2656,geo_region_name_en#2686,geo_district_name_th#2688,geo_sub_region_id#2680,ld_day#2698,lm_master#2653,lm_location_t#2660,lm_zone#2668,lm_latitude#2671,lm_branch_t#2658,geo_sub_district_name_th#2687,lm_cat_id#2674,geo_district_id#2678,lm_symbol#2649,lm_id#2648,lm_name_t#2654,lm_cat_name#2676,geo_district_name_en#2683,lm_name_fld#2657,lm_master_branch#2663,lm_longitude#2670,lm_branch#2659,mkt_sub_region_id#2690,lm_sub_cat_id#2650,geo_sub_region_name_en#2685,lm_sub_cat_name#316,mkt_sub_region_name_en#2691,grid_id#2695,lm_floor#2667,lm_location#2661,geo_sub_district_name_en#2682,lm_master_branch_t#2662,data_date#2693,lm_ldmtag#2651,ld_year#2696 in operator !Project [lm_id#2648, lm_symbol#2649, lm_sub_cat_id#2650, lm_ldmtag#2651, lm_subldm_id#2652, lm_master#2653, lm_name_t#2654, lm_name#2655, lm_name_fld_t#2656, lm_name_fld#2657, lm_branch_t#2658, lm_branch#2659, lm_location_t#2660, lm_location#2661, lm_master_branch_t#2662, lm_master_branch#2663, lm_prov_code#2664, lm_amp_code#2665, lm_tam_code#2666, lm_floor#2667, lm_zone#2668, lm_update_dttm#2669, lm_longitude#2670, lm_latitude#2671, ... 28 more fields]. Attribute(s) with the same name appear in the operation: region_id. Please check if the right attribute(s) are used.;;
> Join LeftOuter
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org