You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "norrishuang (via GitHub)" <gi...@apache.org> on 2023/05/26 03:07:04 UTC
[GitHub] [iceberg] norrishuang opened a new issue, #7707: FlinkSQL Upsert did'nt support timestamp column as a primary key
norrishuang opened a new issue, #7707:
URL: https://github.com/apache/iceberg/issues/7707
### Apache Iceberg version
1.1.0
### Query engine
Flink
### Please describe the bug 🐞
I used flinksql upsert records into a iceberg table. The primary key has a timestamp column. But it can't worked. and have a exception as below
```
java.lang.ArrayIndexOutOfBoundsException: 6
at org.apache.flink.table.data.binary.BinarySegmentUtils.getLongSlowly(BinarySegmentUtils.java:744)
at org.apache.flink.table.data.binary.BinarySegmentUtils.getLongMultiSegments(BinarySegmentUtils.java:738)
at org.apache.flink.table.data.binary.BinarySegmentUtils.getLong(BinarySegmentUtils.java:726)
at org.apache.flink.table.data.binary.BinarySegmentUtils.readTimestampData(BinarySegmentUtils.java:1022)
at org.apache.flink.table.data.binary.BinaryRowData.getTimestamp(BinaryRowData.java:356)
at org.apache.flink.table.data.RowData.lambda$createFieldGetter$39385f9c$1(RowData.java:260)
at org.apache.flink.table.data.RowData.lambda$createFieldGetter$25774257$1(RowData.java:296)
at org.apache.iceberg.flink.data.RowDataProjection.getValue(RowDataProjection.java:159)
at org.apache.iceberg.flink.data.RowDataProjection.isNullAt(RowDataProjection.java:179)
at org.apache.iceberg.flink.RowDataWrapper.get(RowDataWrapper.java:67)
at org.apache.iceberg.types.JavaHashes$StructLikeHash.hash(JavaHashes.java:92)
at org.apache.iceberg.types.JavaHashes$StructLikeHash.hash(JavaHashes.java:71)
at org.apache.iceberg.util.StructLikeWrapper.hashCode(StructLikeWrapper.java:96)
at java.util.HashMap.hash(HashMap.java:340)
at java.util.HashMap.remove(HashMap.java:800)
at org.apache.iceberg.util.StructLikeMap.remove(StructLikeMap.java:93)
at org.apache.iceberg.io.BaseTaskWriter$BaseEqualityDeltaWriter.internalPosDelete(BaseTaskWriter.java:155)
at org.apache.iceberg.io.BaseTaskWriter$BaseEqualityDeltaWriter.deleteKey(BaseTaskWriter.java:185)
at org.apache.iceberg.flink.sink.BaseDeltaTaskWriter.write(BaseDeltaTaskWriter.java:84)
at org.apache.iceberg.flink.sink.BaseDeltaTaskWriter.write(BaseDeltaTaskWriter.java:40)
at org.apache.iceberg.flink.sink.IcebergStreamWriter.processElement(IcebergStreamWriter.java:72)
at org.apache.flink.streaming.runtime.tasks.OneInputStreamTask$StreamTaskNetworkOutput.emitRecord(OneInputStreamTask.java:233)
at org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.processElement(AbstractStreamTaskNetworkInput.java:134)
at org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.emitNext(AbstractStreamTaskNetworkInput.java:105)
at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:542)
at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:831)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:780)
at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:935)
at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:914)
at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:728)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:550)
at java.lang.Thread.run(Thread.java:750)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] ConeyLiu commented on issue #7707: FlinkSQL Upsert did'nt support timestamp column as a primary key
Posted by "ConeyLiu (via GitHub)" <gi...@apache.org>.
ConeyLiu commented on issue #7707:
URL: https://github.com/apache/iceberg/issues/7707#issuecomment-1594831268
I think this should be fixed by #7836
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org