[GitHub] JingsongLi opened a new pull request #7816: [FLINK-11701][table] Introduce an abstract set of data formats

[GitBox <gi...@apache.org>]

JingsongLi opened a new pull request #7816: [FLINK-11701][table] Introduce an abstract set of data formats
URL: https://github.com/apache/flink/pull/7816
 
 
   ## What is the purpose of the change
   
   Blink uses an abstract set of data formats to make internal calculations use the binary format as much as possible. This minimizes the serialization overhead and java object overhead.
   
   
   ## Brief change log
   
   Data format corresponding relation:
   - BaseRow(BinaryRow and GenericRow) <=> Row
   - int <=> Date //Flink used to use int in the calculation, but the remaining in Row is still Date, we will change it completely.
   - int <=> Time
   - long <=> Timestamp
   - byte[] <=> byte[]
   - primitive type keep same, but use less boxed type.
   
   We decided to build BinaryRow on multiple Segments because we wanted fine-grained memory control. For fast access, we keep the primitive type on a single Segment.
   
   ## Verifying this change
   Unit test.
   
   ## Does this pull request potentially affect one of the following parts:
   
     - Dependencies (does it add or upgrade a dependency): (no)
     - The public API, i.e., is any changed class annotated with `@Public(Evolving)`: (no)
     - The serializers: (no)
     - The runtime per-record code paths (performance sensitive): (no)
     - Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Yarn/Mesos, ZooKeeper: (no)
     - The S3 file system connector: (no)
   
   ## Documentation
   
     - Does this pull request introduce a new feature? (yes)
     - If yes, how is the feature documented? (JavaDocs)
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services