You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2019/08/08 18:19:52 UTC
[GitHub] [incubator-iceberg] rdsr opened a new issue #366: Concurrent
appends to the same table using HiveCatalog lead to deadlock
rdsr opened a new issue #366: Concurrent appends to the same table using HiveCatalog lead to deadlock
URL: https://github.com/apache/incubator-iceberg/issues/366
I've noticed that, appending files the the same table from multiple threads takes a very large amount of time. The problem is more evident if the number of threads are more. From the logs it seems there's deadlock in the Metastore.
Below is the log I'm pasting from the test case.
> [main] INFO org.apache.iceberg.BaseMetastoreTableOperations - Refreshing table metadata from new version: file:/var/folders/dg/xnsw71ls347dkft4qr284zr4000bt7/T/hive3179686150067127808/hivedb.db/tbl/metadata/00000-5001916d-81a9-408c-ad9e-9cdec89090e1.metadata.json
> [main] INFO org.apache.iceberg.BaseMetastoreTableOperations - Refreshing table metadata from new version: file:/var/folders/dg/xnsw71ls347dkft4qr284zr4000bt7/T/hive3179686150067127808/hivedb.db/tbl/metadata/00000-5001916d-81a9-408c-ad9e-9cdec89090e1.metadata.json
> Starting append 0
> Starting append 1
> Starting append 2
> Starting append 3
> Starting append 4
> Starting append 5
> Starting append 6
> Starting append 7
> Starting append 8
> Starting append 9
> 2019-08-08 11:08:59,302 WARN [pool-3-thread-2] txn.TxnHandler (TxnHandler.java:checkRetryable(982)) - Deadlock detected in checkLock(CheckLockRequest(lockid:7) ). Will wait 200ms try again up to 10 times.
> 2019-08-08 11:09:19,518 WARN [pool-3-thread-3] txn.TxnHandler (TxnHandler.java:checkRetryable(982)) - Deadlock detected in checkLock(CheckLockRequest(lockid:6) ). Will wait 200ms try again up to 10 times.
> 2019-08-08 11:09:39,743 WARN [pool-3-thread-3] txn.TxnHandler (TxnHandler.java:checkRetryable(982)) - Deadlock detected in checkLock(CheckLockRequest(lockid:6) ). Will wait 400ms try again up to 9 times.
> [pool-6-thread-7] INFO org.apache.iceberg.SnapshotProducer - Committed snapshot 3707713582032677660 (MergeAppend)
The testcase is published here: https://github.com/apache/incubator-iceberg/compare/master...rdsr:hivecatalog_deadlock?expand=1
Most likely not a bug in Iceberg, but creating ticket for tracking purposes
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org