[I] [Feature] [arrow] Improve customization capabilities for data type conversion between Paimon and Arrow formats. [paimon]

["jichen20210919 (via GitHub)" <gi...@apache.org>]

jichen20210919 opened a new issue, #6693:
URL: https://github.com/apache/paimon/issues/6693

   ### Search before asking
   
   - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar.
   
   
   ### Motivation
   
   paimon-arrow module has a good design for paimon-arrow field type conversions, but the top level class has the fixed type conversions, in some use cases, developers may want to customize the field type conversion process to meet the use-case.
   
   
   ### Solution
   
   We propose improving customization capabilities for data type conversion between Paimon and Arrow formats.Below is the visions of the feature:
   
   1. Enhanced Flexibility:
   
   Users can now provide custom type conversion logic for Paimon-to-Arrow and Arrow-to-Paimon transformations
   Support for custom field writer factories through ArrowFieldWriterFactoryVisitor
   Backward compatibility maintained with default visitor implementations
   
   2. Improved Extensibility:
   
   Modular design allowing developers to customize specific aspects of the conversion pipeline
   Separation of concerns through visitor pattern implementation
   No breaking changes to existing API usage
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [x] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org