You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/07/06 06:26:06 UTC

[GitHub] [hudi] shqiprimbkodelabs opened a new issue, #6052: [SUPPORT] HoodieRollbackException when starting Flink Job on existing Hudi Table

shqiprimbkodelabs opened a new issue, #6052:
URL: https://github.com/apache/hudi/issues/6052

   I am using Hudi with Flink and when I submit the job it fails to rollback. This is issue happens also if any of the checkpoints fails. 
   `Caused by: org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'stream_write: HUDI_TIME_SERIES' (operator e8fc67ede24cef102d7d7a9334f93f11).
       at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:545)
       at org.apache.hudi.sink.StreamWriteOperatorCoordinator.lambda$start$0(StreamWriteOperatorCoordinator.java:188)
       at org.apache.hudi.sink.utils.NonThrownExecutor.lambda$execute$0(NonThrownExecutor.java:103)
       at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
       at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
       at java.lang.Thread.run(Thread.java:750)
   Caused by: org.apache.hudi.exception.HoodieException: Executor executes action [initialize instant ] error
       ... 5 more
   Caused by: org.apache.hudi.exception.HoodieRollbackException: Failed to rollback gs://bucketpath/table_ commits 20220705165415314
       at org.apache.hudi.client.BaseHoodieWriteClient.rollback(BaseHoodieWriteClient.java:779)
       at org.apache.hudi.client.BaseHoodieWriteClient.rollbackFailedWrites(BaseHoodieWriteClient.java:1189)
       at org.apache.hudi.client.BaseHoodieWriteClient.rollbackFailedWrites(BaseHoodieWriteClient.java:1172)
       at org.apache.hudi.client.BaseHoodieWriteClient.rollbackFailedWrites(BaseHoodieWriteClient.java:1160)
       at org.apache.hudi.client.BaseHoodieWriteClient.lambda$startCommit$afea71c0$1(BaseHoodieWriteClient.java:932)
       at org.apache.hudi.common.util.CleanerUtils.rollbackFailedWrites(CleanerUtils.java:151)
       at org.apache.hudi.client.BaseHoodieWriteClient.startCommit(BaseHoodieWriteClient.java:931)
       at org.apache.hudi.sink.StreamWriteOperatorCoordinator.startInstant(StreamWriteOperatorCoordinator.java:375)
       at org.apache.hudi.sink.StreamWriteOperatorCoordinator.lambda$initInstant$6(StreamWriteOperatorCoordinator.java:403)
       at org.apache.hudi.sink.utils.NonThrownExecutor.lambda$execute$0(NonThrownExecutor.java:93)
       ... 3 more
   Caused by: java.lang.NullPointerException
       at org.apache.hudi.metadata.HoodieBackedTableMetadataWriter.update(HoodieBackedTableMetadataWriter.java:910)
       at org.apache.hudi.table.action.BaseActionExecutor.lambda$writeTableMetadata$2(BaseActionExecutor.java:77)
       at org.apache.hudi.common.util.Option.ifPresent(Option.java:97)
       at org.apache.hudi.table.action.BaseActionExecutor.writeTableMetadata(BaseActionExecutor.java:77)
       at org.apache.hudi.table.action.rollback.BaseRollbackActionExecutor.finishRollback(BaseRollbackActionExecutor.java:255)
       at org.apache.hudi.table.action.rollback.BaseRollbackActionExecutor.runRollback(BaseRollbackActionExecutor.java:124)
       at org.apache.hudi.table.action.rollback.BaseRollbackActionExecutor.execute(BaseRollbackActionExecutor.java:145)
       at org.apache.hudi.table.HoodieFlinkCopyOnWriteTable.rollback(HoodieFlinkCopyOnWriteTable.java:333)
       at org.apache.hudi.client.BaseHoodieWriteClient.rollback(BaseHoodieWriteClient.java:762)
       ... 12 more`


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] danny0405 commented on issue #6052: [SUPPORT] HoodieRollbackException when starting Flink Job on existing Hudi Table

Posted by GitBox <gi...@apache.org>.

danny0405 commented on issue #6052:
URL: https://github.com/apache/hudi/issues/6052#issuecomment-1176037219

   Did you use the flink-hudi-bundle jar , the hudi-aws expects to be packaged in.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] shqiprimbkodelabs commented on issue #6052: [SUPPORT] HoodieRollbackException when starting Flink Job on existing Hudi Table

Posted by GitBox <gi...@apache.org>.

shqiprimbkodelabs commented on issue #6052:
URL: https://github.com/apache/hudi/issues/6052#issuecomment-1176067478

   Yes, also tried to include aws bundle but didn’t work
   
   On Wed, Jul 6, 2022 at 12:08 PM Danny Chan ***@***.***> wrote:
   
   > Did you use the flink-hudi-bundle jar , the hudi-aws expects to be
   > packaged in.
   >
   > —
   > Reply to this email directly, view it on GitHub
   > <https://github.com/apache/hudi/issues/6052#issuecomment-1176037219>, or
   > unsubscribe
   > <https://github.com/notifications/unsubscribe-auth/AR7AE5V7TY3E4TKMMX37P23VSVLJBANCNFSM52YQO5EA>
   > .
   > You are receiving this because you authored the thread.Message ID:
   > ***@***.***>
   >
   -- 
   
   Shqiprim Bunjaku
   
   *KODE Labs*
   
   m:
   
   383 44 709 267
   
   w:
   
   *kodelabs.com <http://kodelabs.com/>*  e: ***@***.***
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] danny0405 commented on issue #6052: [SUPPORT] HoodieRollbackException when starting Flink Job on existing Hudi Table

Posted by GitBox <gi...@apache.org>.

danny0405 commented on issue #6052:
URL: https://github.com/apache/hudi/issues/6052#issuecomment-1176012747

   oops, this is another bug ...


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] danny0405 commented on issue #6052: [SUPPORT] HoodieRollbackException when starting Flink Job on existing Hudi Table

Posted by GitBox <gi...@apache.org>.

danny0405 commented on issue #6052:
URL: https://github.com/apache/hudi/issues/6052#issuecomment-1306539970

   Close because of prolonged inactivity.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] shqiprimbkodelabs commented on issue #6052: [SUPPORT] HoodieRollbackException when starting Flink Job on existing Hudi Table

Posted by GitBox <gi...@apache.org>.

shqiprimbkodelabs commented on issue #6052:
URL: https://github.com/apache/hudi/issues/6052#issuecomment-1175999158

   Still not working, it NoClassDefFoundError  AWSGlueCatalogSyncTool even though I am using Hive as catalog 
   
   `Caused by: java.lang.NoClassDefFoundError: org/apache/hudi/aws/sync/AWSGlueCatalogSyncTool
   	at org.apache.hudi.sink.StreamWriteOperatorCoordinator.initHiveSync(StreamWriteOperatorCoordinator.java:332) `


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] danny0405 closed issue #6052: [SUPPORT] HoodieRollbackException when starting Flink Job on existing Hudi Table

Posted by GitBox <gi...@apache.org>.

danny0405 closed issue #6052: [SUPPORT] HoodieRollbackException when starting Flink Job on existing Hudi Table
URL: https://github.com/apache/hudi/issues/6052


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] danny0405 commented on issue #6052: [SUPPORT] HoodieRollbackException when starting Flink Job on existing Hudi Table

Posted by GitBox <gi...@apache.org>.

danny0405 commented on issue #6052:
URL: https://github.com/apache/hudi/issues/6052#issuecomment-1302933977

   Did you try the release 0.12.1 then ? It expects to work correctly now.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] nsivabalan commented on issue #6052: [SUPPORT] HoodieRollbackException when starting Flink Job on existing Hudi Table

Posted by GitBox <gi...@apache.org>.

nsivabalan commented on issue #6052:
URL: https://github.com/apache/hudi/issues/6052#issuecomment-1302872944

   @shqiprimbkodelabs @danny0405 : are we good to close this one or is there anything pending still ? 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] danny0405 commented on issue #6052: [SUPPORT] HoodieRollbackException when starting Flink Job on existing Hudi Table

Posted by GitBox <gi...@apache.org>.

danny0405 commented on issue #6052:
URL: https://github.com/apache/hudi/issues/6052#issuecomment-1175888646

   The flink metadata table functionality for release 0.11.x has some bugs, it should have been fixed in latest master.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org