[jira] [Created] (HUDI-1667) Fix bug when HoodieMergeOnReadRDD read record from base file, Hoodie may set non-null value in field which is null if vectorization is enabled.

["Lietong Liu (Jira)" <ji...@apache.org>]

Lietong Liu created HUDI-1667:
---------------------------------

             Summary: Fix bug when HoodieMergeOnReadRDD read record from base file, Hoodie may set non-null value in field which is null if vectorization is enabled.
                 Key: HUDI-1667
                 URL: https://issues.apache.org/jira/browse/HUDI-1667
             Project: Apache Hudi
          Issue Type: Bug
          Components: Common Core
            Reporter: Lietong Liu


When HoodieMergeOnReadRDD read record from base file,  will create new InternalRow base on requiredStructSchema.
{code:java}
//代码占位符
private def createRowWithRequiredSchema(row: InternalRow): InternalRow = {
  val rowToReturn = new SpecificInternalRow(tableState.requiredStructSchema)
  val posIterator = requiredFieldPosition.iterator
  var curIndex = 0
  tableState.requiredStructSchema.foreach(
    f => {
      val curPos = posIterator.next()
      val curField = row.get(curPos, f.dataType)
      rowToReturn.update(curIndex, curField)
      curIndex = curIndex + 1
    }
  )
  rowToReturn
}

{code}
 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)