[GitHub] [spark] rezasafi edited a comment on issue #26159: [SPARK-29506][SQL] Use dynamicPartitionOverwrite in FileCommitProtocol when insert into hive table

[GitBox <gi...@apache.org>]

rezasafi edited a comment on issue #26159: [SPARK-29506][SQL] Use dynamicPartitionOverwrite in FileCommitProtocol when insert into hive table
URL: https://github.com/apache/spark/pull/26159#issuecomment-547554077
 
 
   > @rezasafi thanks for referring that. Is it specified to enabling dynamicPartitionOverwrite? As the task id was fixed in setupJob, I think it is also happened without this patch?
   
   Hi @viirya, yeah that issue happens when dynamicPartitionOverwrite is enabled. It seems that after your fix is merged if people there would be more cases that hit SPARK-27194. So was just wondering whether it is better to fix that first before suggesting to use dynamic partition overwrite in more scenarios.
   I haven't looked at @turboFei fix.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org