[jira] [Created] (HIVE-29496) when source is an iceberg table, materialized view rebuild failed with "SemanticException: Another process is rebuilding the materialized view mydb.ice_mv1" OR "SemanticException: Exception acquiring lock for rebuilding the materialized view"

["Venugopal Reddy K (Jira)" <ji...@apache.org>]

Venugopal Reddy K created HIVE-29496:
----------------------------------------

             Summary: when source is an iceberg table, materialized view rebuild failed with "SemanticException: Another process is rebuilding the materialized view mydb.ice_mv1" OR "SemanticException: Exception acquiring lock for rebuilding the materialized view" 
                 Key: HIVE-29496
                 URL: https://issues.apache.org/jira/browse/HIVE-29496
             Project: Hive
          Issue Type: Bug
          Components: Hive
            Reporter: Venugopal Reddy K


*[Description]*

when source is an iceberg table, materialized view rebuild succeeds for the first time.  But subsequent materialized view rebuild fail with one of these exceptions.

"SemanticException org.apache.hadoop.hive.ql.parse.SemanticException: Another process is rebuilding the materialized view mydb.ice_mv1;" +when rebuild is tried with same materialized view as first succeeded one.+

*OR*

"SemanticException org.apache.hadoop.hive.ql.parse.SemanticException: Exception acquiring lock for rebuilding the materialized view;" +when rebuild is tried with different materialized view.+

Happens because lock is acquired with txn id as 0 and not released after rebuild. And MRL_TXN_ID is PRIMARY KEY for MATERIALIZATION_REBUILD_LOCKS table.
||MATERIALIZATION_REBUILD_LOCKS||
||MRL_TXN_ID||MRL_DB_NAME||MRL_TBL_NAME||MRL_LAST_HEARTBEAT||
|{color:#FF0000}0{color}|mydb|ice_mv1|1,773,117,466,400|

 

*[Steps to reproduce]*
 # Create an iceberg table, insert some data to it.
 # Create a materialized view(either in Hive ACID or Iceberg format) with source as above created iceberg table.
 # Insert some data into iceberg table again so that mv becomes outdated for rewriting.
 # Alter materialized view rebuild so that it can be used in rewriting.
 # Repeat step-3 and step-4 again. This time materialized view rebuild throws *Error: Error while compiling statement: FAILED: SemanticException org.apache.hadoop.hive.ql.parse.SemanticException: Another process is rebuilding the materialized view mydb.ice_mv1;*

 # Here after, none of the other materialized views(created with any iceberg source table) rebuild works. All of them fail with below exception. Can verify with below steps.
 ## Try creating another iceberg table, insert some data and another materialized view.
 ## Insert some more data to the iceberg table and rebuild the mv created on step-6. Materialized view Rebuild throws - {*}Error: Error while compiling statement: FAILED: SemanticException org.apache.hadoop.hive.ql.parse.SemanticException: Exception acquiring lock for rebuilding the materialized view;{*}{*}{*}

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)