You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@orc.apache.org by GitBox <gi...@apache.org> on 2021/12/20 02:54:43 UTC

[GitHub] [orc] yikf edited a comment on pull request #973: [ORC-1062]Rename orc.schema.evolution.case.sensitive to orc.schema.evolution.case.aware

yikf edited a comment on pull request #973:
URL: https://github.com/apache/orc/pull/973#issuecomment-997547955


   @dongjoon-hyun  Also, the configuration default value is true, There are some compatibility problems
   
   We have a case, In spark 2.4, the table can be queried normally even if the schema of the table and file is different in case
   But in spark 3.1, we need to explicitly configure orc.schema.evolution.case.sensitive as false to query normally.(https://github.com/apache/orc/blob/aee81324507de1c5eb8e86bd7aa93a0f6b02bfd9/java/core/src/java/org/apache/orc/impl/SchemaEvolution.java#L514) this cause `fileIncluded ` not to include this column and cant read data
   
   Whether we should set default value as false to maintain compatibility.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@orc.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org