You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Dong Lin (Jira)" <ji...@apache.org> on 2023/03/01 10:11:00 UTC
[jira] [Commented] (FLINK-31191) VectorIndexer should check whether doublesByColumn is null before snapshot
[ https://issues.apache.org/jira/browse/FLINK-31191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17694977#comment-17694977 ]
Dong Lin commented on FLINK-31191:
----------------------------------
Merged to flink-ml master branch 10c08277fd7c03faef8ffb9fadd5008f2b101a19
> VectorIndexer should check whether doublesByColumn is null before snapshot
> --------------------------------------------------------------------------
>
> Key: FLINK-31191
> URL: https://issues.apache.org/jira/browse/FLINK-31191
> Project: Flink
> Issue Type: Bug
> Components: Library / Machine Learning
> Affects Versions: ml-2.2.0
> Reporter: Zhipeng Zhang
> Assignee: Zhipeng Zhang
> Priority: Major
> Labels: pull-request-available
> Fix For: ml-2.2.0
>
>
> Currently VectorIndexer would lead to NPE when doing checkpoint. It should check whether `doublesByColumn` is null before calling snapshot.
>
> logview: [https://github.com/apache/flink-ml/actions/runs/4249415318/jobs/7389547039]
> details:
>
>
> [735|https://github.com/apache/flink-ml/actions/runs/4249415318/jobs/7389547039#step:4:736]Caused by: java.lang.NullPointerException
> [736|https://github.com/apache/flink-ml/actions/runs/4249415318/jobs/7389547039#step:4:737] at org.apache.flink.ml.feature.vectorindexer.VectorIndexer$ComputeDistinctDoublesOperator.convertToListArray(VectorIndexer.java:232)
> [737|https://github.com/apache/flink-ml/actions/runs/4249415318/jobs/7389547039#step:4:738] at org.apache.flink.ml.feature.vectorindexer.VectorIndexer$ComputeDistinctDoublesOperator.snapshotState(VectorIndexer.java:228)
> [738|https://github.com/apache/flink-ml/actions/runs/4249415318/jobs/7389547039#step:4:739] at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.snapshotState(StreamOperatorStateHandler.java:222)
> [739|https://github.com/apache/flink-ml/actions/runs/4249415318/jobs/7389547039#step:4:740] ... 33 more
--
This message was sent by Atlassian Jira
(v8.20.10#820010)