[GitHub] [spark] gengliangwang opened a new pull request #24356: [SPARK-27448][SQL] File source V2 table provider should be compatible with V1 provider

[GitBox <gi...@apache.org>]

gengliangwang opened a new pull request #24356: [SPARK-27448][SQL] File source V2 table provider should be compatible with V1 provider
URL: https://github.com/apache/spark/pull/24356
 
 
   ## What changes were proposed in this pull request?
   
   In the rule `PreprocessTableCreation`, if an existing table is appended with a different provider, the action will fail.
   Currently, there are two implementations for file sources and creating a table with file source V2 will always fall back to V1 FileFormat. We should consider the following cases as valid:
   1. Appending a table with file source V2 provider using the v1 file format
   2. Appending a table with v1 file format provider using file source V2 format
   
   ## How was this patch tested?
   
   Unit test
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org