You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "someguyLi (via GitHub)" <gi...@apache.org> on 2023/04/10 03:18:03 UTC

[GitHub] [hudi] someguyLi opened a new issue, #8415: flink batch query have error: No value present in Option

someguyLi opened a new issue, #8415:
URL: https://github.com/apache/hudi/issues/8415

   I ues flink-cdc sink hudi table, and use flinkSql batch query this hudi table. everything was fine at first. 
   When hudi generates parquet file, source table delete a piece of data. 
   An error will occur in flink batch query: 
   ![image](https://user-images.githubusercontent.com/54828165/230818007-82a38d86-862b-474b-9aaa-9ff085a1b3e7.png)
   my hudi table config: 
   ![image](https://user-images.githubusercontent.com/54828165/230818390-0fdcdea3-ed61-4c66-b414-1a62fdbdfaa6.png)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] danny0405 commented on issue #8415: [SUPPORT] flink batch query have error: No value present in Option

Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on issue #8415:
URL: https://github.com/apache/hudi/issues/8415#issuecomment-1502695394

   The preCombine seems return empty for delete payload, did you check your logs, is there any error stack trace expecially about avro?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] someguyLi commented on issue #8415: [SUPPORT] flink batch query have error: No value present in Option

Posted by "someguyLi (via GitHub)" <gi...@apache.org>.
someguyLi commented on issue #8415:
URL: https://github.com/apache/hudi/issues/8415#issuecomment-1502627314

   > Did you delete the files manually?
   
   No, I just deleted a piece of data from mysql table


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] someguyLi commented on issue #8415: [SUPPORT] flink batch query have error: No value present in Option

Posted by "someguyLi (via GitHub)" <gi...@apache.org>.
someguyLi commented on issue #8415:
URL: https://github.com/apache/hudi/issues/8415#issuecomment-1502739738

   not any error stack trace expecially about avro：
   ![image](https://user-images.githubusercontent.com/54828165/231071649-7c91c63e-0673-47be-bf39-58bf9e0cdbb0.png)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] someguyLi commented on issue #8415: [SUPPORT] flink batch query have error: No value present in Option

Posted by "someguyLi (via GitHub)" <gi...@apache.org>.
someguyLi commented on issue #8415:
URL: https://github.com/apache/hudi/issues/8415#issuecomment-1502740891

   > The preCombine seems return empty for delete payload, did you check your logs, is there any error stack trace expecially about avro?
   
   not any error stack trace expecially about avro：
   ![image](https://user-images.githubusercontent.com/54828165/231071750-e6e41a6f-538a-4eec-89db-0715e92fc49d.png)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] danny0405 commented on issue #8415: [SUPPORT] flink batch query have error: No value present in Option

Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on issue #8415:
URL: https://github.com/apache/hudi/issues/8415#issuecomment-1502834139

   Seems you run it in local IDEA, then you can debug the line why the merging returns `Option.empty`.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] someguyLi commented on issue #8415: [SUPPORT] flink batch query have error: No value present in Option

Posted by "someguyLi (via GitHub)" <gi...@apache.org>.
someguyLi commented on issue #8415:
URL: https://github.com/apache/hudi/issues/8415#issuecomment-1501346044

   flink-cdc and hudi version:
   ![image](https://user-images.githubusercontent.com/54828165/230819522-6e7c1c55-40c9-4c92-a1ee-cce2797dd0a2.png)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] danny0405 commented on issue #8415: [SUPPORT] flink batch query have error: No value present in Option

Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on issue #8415:
URL: https://github.com/apache/hudi/issues/8415#issuecomment-1581864007

   @someguyLi I would close this issue first because it seems a local env setup issue.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] danny0405 commented on issue #8415: [SUPPORT] flink batch query have error: No value present in Option

Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on issue #8415:
URL: https://github.com/apache/hudi/issues/8415#issuecomment-1502595988

   Did you delete the files manually?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] someguyLi commented on issue #8415: [SUPPORT] flink batch query have error: No value present in Option

Posted by "someguyLi (via GitHub)" <gi...@apache.org>.
someguyLi commented on issue #8415:
URL: https://github.com/apache/hudi/issues/8415#issuecomment-1502624382

   > 您是否手动删除了文件？
   
   No, I just deleted a piece of data from mysql table


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] danny0405 closed issue #8415: [SUPPORT] flink batch query have error: No value present in Option

Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 closed issue #8415: [SUPPORT] flink batch query have error: No value present in Option
URL: https://github.com/apache/hudi/issues/8415


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org