You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/08/22 23:39:44 UTC

[GitHub] [hudi] gudladona opened a new issue, #6474: [SUPPORT] Hudi Deltastreamer fails to acquire lock with DynamoDB Lock Provider.

gudladona opened a new issue, #6474:
URL: https://github.com/apache/hudi/issues/6474

   **Describe the problem you faced**
   
   Hudi Delta streamer (continuous mode) when when restarted after a failure fails to ACQUIRE lock. 
   
   Steps to reproduce the behavior:
   
   1. A timeline in the following sequence of operations seems to reproduce this behavior
   2. 
   <img width="1456" alt="image" src="https://user-images.githubusercontent.com/7864088/186037285-ff85d82b-4cb9-4212-b4b5-cc8ff239dab0.png">
   
   **Expected behavior**
   
   No lock contention with the lock provider expected.
   
   **Environment Description**
   
   * Hudi version : 0.11.1
   
   * Spark version : 3.1.2
   
   * Storage (HDFS/S3/GCS..) : S3
   
   * Running on Docker? (yes/no) : no
   
   * Async Operations? : CLEAN Auto Clean and incremental cleaning enabled(default). 
   
   * Compaction: Disabled (workloads is INSERT only) 
   
   
   **Additional context**
   
   Add any other context about the problem here.
   
   **Stacktrace**
   
   contents of the rollback 
   
   ```
   ❯ java -jar avro-tools-1.7.4.jar tojson 20220822020416059.rollback | jq
   22/08/22 09:34:03 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
   {
     "startRollbackTime": "20220822020416059",
     "timeTakenInMillis": 2,
     "totalFilesDeleted": 0,
     "commitsRollback": [
       "20220822020204383"
     ],
     "partitionMetadata": {},
     "version": {
       "int": 1
     },
     "instantsRollback": [
       {
         "commitTime": "20220822020204383",
         "action": "deltacommit"
       }
     ]
   }```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] nsivabalan commented on issue #6474: [SUPPORT] Hudi Deltastreamer fails to acquire lock with DynamoDB Lock Provider.

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on issue #6474:
URL: https://github.com/apache/hudi/issues/6474#issuecomment-1237644352

   closing the issue for now. I don't see any obvious issues. If you could able to reproduce, do share w/ us. and if you can upgrade to use latest master, would be awesome ! the fix that I have put up, could potentially help avoid a diff owner unlocking. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] nsivabalan commented on issue #6474: [SUPPORT] Hudi Deltastreamer fails to acquire lock with DynamoDB Lock Provider.

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on issue #6474:
URL: https://github.com/apache/hudi/issues/6474#issuecomment-1223377849

   Note to self:
   
   excerpt from the logs which of interest to us
   ```
   22/08/22 02:06:31 INFO org.apache.hudi.client.transaction.TransactionManager: Transaction starting for Option{val=[==>20220822020402958__deltacommit__INFLIGHT]} with latest completed transaction instant Option{val=[20220822015627468__deltacommit__COMPLETED]}
   22/08/22 02:06:31 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: ACQUIRING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:06:31 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: ACQUIRED lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:06:31 INFO org.apache.hudi.client.transaction.TransactionManager: Transaction started for Option{val=[==>20220822020402958__deltacommit__INFLIGHT]} with latest completed transaction instant Option{val=[20220822015627468__deltacommit__COMPLETED]}
   22/08/22 02:06:48 INFO org.apache.hudi.client.transaction.TransactionManager: Transaction starting for Optional.empty with latest completed transaction instant Optional.empty
   22/08/22 02:06:48 INFO org.apache.hudi.client.transaction.lock.LockManager: LockProvider org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider
   22/08/22 02:06:48 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: ACQUIRING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:08:59 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: ACQUIRING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:11:10 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: ACQUIRING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:13:21 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: ACQUIRING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:15:32 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: ACQUIRING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:17:43 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: ACQUIRING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:19:53 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: ACQUIRING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:22:04 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: ACQUIRING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:24:15 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: ACQUIRING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:26:25 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: ACQUIRING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:28:36 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: ACQUIRING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:30:47 INFO org.apache.hudi.client.transaction.TransactionManager: Transaction ending with transaction owner Optional.empty
   22/08/22 02:30:47 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: RELEASING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:30:47 INFO org.apache.hudi.client.transaction.TransactionManager: Transaction ended with transaction owner Optional.empty
   	at org.apache.hudi.client.transaction.TransactionManager.beginTransaction(TransactionManager.java:53)
   22/08/22 02:31:00 INFO org.apache.hudi.client.transaction.TransactionManager: Transaction ending with transaction owner Option{val=[==>20220822020402958__deltacommit__INFLIGHT]}
   22/08/22 02:31:00 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: RELEASING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:31:00 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: RELEASED lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:31:00 INFO org.apache.hudi.client.transaction.TransactionManager: Transaction ended with transaction owner Option{val=[==>20220822020402958__deltacommit__INFLIGHT]}
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] nsivabalan closed issue #6474: [SUPPORT] Hudi Deltastreamer fails to acquire lock with DynamoDB Lock Provider.

Posted by GitBox <gi...@apache.org>.
nsivabalan closed issue #6474: [SUPPORT] Hudi Deltastreamer fails to acquire lock with DynamoDB Lock Provider.
URL: https://github.com/apache/hudi/issues/6474


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] gudladona commented on issue #6474: [SUPPORT] Hudi Deltastreamer fails to acquire lock with DynamoDB Lock Provider.

Posted by GitBox <gi...@apache.org>.
gudladona commented on issue #6474:
URL: https://github.com/apache/hudi/issues/6474#issuecomment-1223354816

   Metadata timeline during this timeframe
   
   <img width="1455" alt="image" src="https://user-images.githubusercontent.com/7864088/186041319-a3d4f621-5e8c-4cbc-9e43-9537dcc99112.png">
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] nsivabalan commented on issue #6474: [SUPPORT] Hudi Deltastreamer fails to acquire lock with DynamoDB Lock Provider.

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on issue #6474:
URL: https://github.com/apache/hudi/issues/6474#issuecomment-1224816176

   yeah. From what I see, the cleaner waits for the lock (which was acquired to apply `20220822020402958` to metadata table", but after retrying, before giving up, looks like the cleaner unlocks which should not happen. We did made a fix in 0.11.1 to avoid non owner releasing the lock [here](https://github.com/apache/hudi/pull/5255), but looks like there could be more to be looked into. 
   
   
   ```
   
   02:06:31 : acquiring lock by 20220822020402958__deltacommit__INFLIGHT in MDT. 
   
   02:06:46 : clean is attempted in data table. (async cleaner)
   02:06:48: clean tries to acquire lock. 
   
   22/08/22 02:06:48 INFO org.apache.hudi.client.transaction.TransactionManager: Transaction starting for Optional.empty with latest completed transaction instant Optional.empty
   22/08/22 02:06:48 INFO org.apache.hudi.client.transaction.lock.LockManager: LockProvider org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider
   
   02:07:47: after checking for compaction, new delta commit started in MDT.
   
   02:07:50: we see the deltacommit state is moved to completed. 
   
   02:08:22 : new delta commit starts. regular writer. 
   
   02:08:59: tries to acquire lock. 
   02:11:10: tries to acquire lock. 
   02:13:21: tries to acquire lock. 
   02:15:32:tries to acquire lock. 
   02:17:43:tries to acquire lock. 
   02:19:53:tries to acquire lock. 
   02:22:04:tries to acquire lock. 
   02:24:15:tries to acquire lock. 
   02:26:25:tries to acquire lock. 
   02:28:36:tries to acquire lock. 
   
   02:30:47: INFO org.apache.hudi.client.transaction.TransactionManager: Transaction ending with transaction owner Optional.empty
   22/08/22 02:30:47 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: RELEASING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:30:47 INFO org.apache.hudi.client.transaction.TransactionManager: Transaction ended with transaction owner Optional.empty
   
   25 mins so far from the time clean tried to acquire lock.
   
   clean fails since it could not acquire the lock. 
   
   22/08/22 02:31:00 : original owner who acquired the lock is releasing it now. 
   
   22/08/22 02:31:00 INFO org.apache.hudi.client.transaction.TransactionManager: Transaction ending with transaction owner Option{val=[==>20220822020402958__deltacommit__INFLIGHT]}
   22/08/22 02:31:00 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: RELEASING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:31:00 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: RELEASED lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:31:00 INFO org.apache.hudi.client.transaction.TransactionManager: Transaction ended with transaction owner Option{val=[==>20220822020402958__deltacommit__INFLIGHT]}
   ```
   
   I might need to spend some more time to put in a fix for this. 
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] gudladona commented on issue #6474: [SUPPORT] Hudi Deltastreamer fails to acquire lock with DynamoDB Lock Provider.

Posted by GitBox <gi...@apache.org>.
gudladona commented on issue #6474:
URL: https://github.com/apache/hudi/issues/6474#issuecomment-1223380423

   Yes, it seems like the transaction that started at @ 02:06:31 20220822020402958__deltacommit__INFLIGHT is on the metadata table. Also, it appears like this was held for 25 minutes, until @ 02:31:00


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] nsivabalan commented on issue #6474: [SUPPORT] Hudi Deltastreamer fails to acquire lock with DynamoDB Lock Provider.

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on issue #6474:
URL: https://github.com/apache/hudi/issues/6474#issuecomment-1232360891

   hey @gudladona : I could not replicate the scenario where a diff thread unlocks by mistake. the unlocking will not go through. But I have added some more enhancement https://github.com/apache/hudi/pull/6549 to ensure we set the right txn owner and so we will ensure the right owner of the lock only can unlock. 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] gudladona commented on issue #6474: [SUPPORT] Hudi Deltastreamer fails to acquire lock with DynamoDB Lock Provider.

Posted by GitBox <gi...@apache.org>.
gudladona commented on issue #6474:
URL: https://github.com/apache/hudi/issues/6474#issuecomment-1223333447

   Logs attached
   
   [hudi-logs.txt](https://github.com/apache/hudi/files/9398269/hudi-logs.txt)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] gudladona commented on issue #6474: [SUPPORT] Hudi Deltastreamer fails to acquire lock with DynamoDB Lock Provider.

Posted by GitBox <gi...@apache.org>.
gudladona commented on issue #6474:
URL: https://github.com/apache/hudi/issues/6474#issuecomment-1223386268

   This seems to be more comprehensive sequence than the above
   
   ```
   cat hudi-logs.txt | grep -E 'TransactionManager|DynamoDBBasedLockProvider'                                                                              08:55:38 PM
   hoodie.write.lock.provider: org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider
   22/08/22 02:04:05 INFO org.apache.hudi.client.transaction.TransactionManager: Transaction starting for Option{val=[==>20220822020402958__deltacommit__INFLIGHT]} with latest completed transaction instant Optional.empty
   22/08/22 02:04:05 INFO org.apache.hudi.client.transaction.lock.LockManager: LockProvider org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider
   22/08/22 02:04:07 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: ACQUIRING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:04:07 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: ACQUIRED lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:04:07 INFO org.apache.hudi.client.transaction.TransactionManager: Transaction started for Option{val=[==>20220822020402958__deltacommit__INFLIGHT]} with latest completed transaction instant Optional.empty
   22/08/22 02:04:14 INFO org.apache.hudi.client.transaction.TransactionManager: Transaction ending with transaction owner Option{val=[==>20220822020402958__deltacommit__INFLIGHT]}
   22/08/22 02:04:14 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: RELEASING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:04:14 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: RELEASED lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:04:14 INFO org.apache.hudi.client.transaction.TransactionManager: Transaction ended with transaction owner Option{val=[==>20220822020402958__deltacommit__INFLIGHT]}
   22/08/22 02:04:20 INFO org.apache.hudi.client.transaction.TransactionManager: Transaction starting for Optional.empty with latest completed transaction instant Optional.empty
   22/08/22 02:04:20 INFO org.apache.hudi.client.transaction.lock.LockManager: LockProvider org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider
   22/08/22 02:04:20 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: ACQUIRING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:04:20 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: ACQUIRED lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:04:20 INFO org.apache.hudi.client.transaction.TransactionManager: Transaction started for Optional.empty with latest completed transaction instant Optional.empty
   22/08/22 02:05:36 INFO org.apache.hudi.client.transaction.TransactionManager: Transaction ending with transaction owner Optional.empty
   22/08/22 02:05:36 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: RELEASING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:05:36 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: RELEASED lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:05:36 INFO org.apache.hudi.client.transaction.TransactionManager: Transaction ended with transaction owner Optional.empty
   22/08/22 02:06:31 INFO org.apache.hudi.client.transaction.TransactionManager: Transaction starting for Option{val=[==>20220822020402958__deltacommit__INFLIGHT]} with latest completed transaction instant Option{val=[20220822015627468__deltacommit__COMPLETED]}
   22/08/22 02:06:31 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: ACQUIRING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:06:31 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: ACQUIRED lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:06:31 INFO org.apache.hudi.client.transaction.TransactionManager: Transaction started for Option{val=[==>20220822020402958__deltacommit__INFLIGHT]} with latest completed transaction instant Option{val=[20220822015627468__deltacommit__COMPLETED]}
   22/08/22 02:06:48 INFO org.apache.hudi.client.transaction.TransactionManager: Transaction starting for Optional.empty with latest completed transaction instant Optional.empty
   22/08/22 02:06:48 INFO org.apache.hudi.client.transaction.lock.LockManager: LockProvider org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider
   22/08/22 02:06:48 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: ACQUIRING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:08:59 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: ACQUIRING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:11:10 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: ACQUIRING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:13:21 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: ACQUIRING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:15:32 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: ACQUIRING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:17:43 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: ACQUIRING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:19:53 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: ACQUIRING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:22:04 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: ACQUIRING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:24:15 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: ACQUIRING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:26:25 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: ACQUIRING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:28:36 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: ACQUIRING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:30:47 INFO org.apache.hudi.client.transaction.TransactionManager: Transaction ending with transaction owner Optional.empty
   22/08/22 02:30:47 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: RELEASING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:30:47 INFO org.apache.hudi.client.transaction.TransactionManager: Transaction ended with transaction owner Optional.empty
   	at org.apache.hudi.client.transaction.TransactionManager.beginTransaction(TransactionManager.java:53)
   22/08/22 02:31:00 INFO org.apache.hudi.client.transaction.TransactionManager: Transaction ending with transaction owner Option{val=[==>20220822020402958__deltacommit__INFLIGHT]}
   22/08/22 02:31:00 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: RELEASING lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:31:00 INFO org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider: RELEASED lock at DynamoDb table = HudiLocker, partition key = process
   22/08/22 02:31:00 INFO org.apache.hudi.client.transaction.TransactionManager: Transaction ended with transaction owner Option{val=[==>20220822020402958__deltacommit__INFLIGHT]}
   ~/Downloads ❯
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] nsivabalan commented on issue #6474: [SUPPORT] Hudi Deltastreamer fails to acquire lock with DynamoDB Lock Provider.

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on issue #6474:
URL: https://github.com/apache/hudi/issues/6474#issuecomment-1223375398

   are you sure you have attached the right logs.
   
   ```
   grep "DynamoDBBasedLockProvider" ~/Downloads/logs.txt | wc -l
          0
   nsb$ grep "TransactionManager" ~/Downloads/logs.txt | wc -l
          0
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org