You are viewing a plain text version of this content. The canonical link for it is here.
Posted to gitbox@hive.apache.org by "Aggarwal-Raghav (via GitHub)" <gi...@apache.org> on 2026/06/17 14:30:48 UTC

[PR] HIVE-29670: Avoid overwriting read-only DB_NOTIFICATION_EVENT_ID_KEY_NAME in DbNotificationListener when processing batched partition events [hive]

Aggarwal-Raghav opened a new pull request, #6548:
URL: https://github.com/apache/hive/pull/6548

   ### What changes were proposed in this pull request?
   Check JIRA [HIVE-29670](https://issues.apache.org/jira/browse/HIVE-29670) for stacktrace.
   
   
   ### Why are the changes needed?
   Alter partitions fails to update stats for more than 1 batch (metastore.jdbc.max.batch.size) of partitions.  [local-setup-hs2.log](https://github.com/user-attachments/files/29052418/local-setup-hs2.log)
   
   
   ### Does this PR introduce _any_ user-facing change?
   No
   
   ### How was this patch tested?
   Using q file and local hive setup testing
   ```
   mvn clean test -Dtest=TestMiniLlapLocalCliDriver -Dqfile=db_notification_batch_insert.q -Drat.skip -Pitests -pl itests/qtest
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org


Re: [PR] HIVE-29670: Avoid overwriting read-only DB_NOTIFICATION_EVENT_ID_KEY_NAME in DbNotificationListener when processing batched partition events [hive]

Posted by "Aggarwal-Raghav (via GitHub)" <gi...@apache.org>.
Aggarwal-Raghav commented on PR #6548:
URL: https://github.com/apache/hive/pull/6548#issuecomment-4738076984

   Thanks for the review @dengzhhu653 .
   
   More context, this was reported by the user, where they were performing _CTAS_ and dynamically created more than 1000 partitions (more than default value of `metastore.jdbc.max.batch.size`) and the _WARN_ log was observed on the beeline as well during stats gathering (`hive.stats.autogather`)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org


Re: [PR] HIVE-29670: Avoid overwriting read-only DB_NOTIFICATION_EVENT_ID_KEY_NAME in DbNotificationListener when processing batched partition events [hive]

Posted by "dengzhhu653 (via GitHub)" <gi...@apache.org>.
dengzhhu653 merged PR #6548:
URL: https://github.com/apache/hive/pull/6548


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org


Re: [PR] HIVE-29670: Avoid overwriting read-only DB_NOTIFICATION_EVENT_ID_KEY_NAME in DbNotificationListener when processing batched partition events [hive]

Posted by "Aggarwal-Raghav (via GitHub)" <gi...@apache.org>.
Aggarwal-Raghav commented on PR #6548:
URL: https://github.com/apache/hive/pull/6548#issuecomment-4731533045

   CC @dengzhhu653 , can you please help with the feedback here! Related to [HIVE-27746](https://issues.apache.org/jira/browse/HIVE-27746)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org


Re: [PR] HIVE-29670: Avoid overwriting read-only DB_NOTIFICATION_EVENT_ID_KEY_NAME in DbNotificationListener when processing batched partition events [hive]

Posted by "sonarqubecloud[bot] (via GitHub)" <gi...@apache.org>.
sonarqubecloud[bot] commented on PR #6548:
URL: https://github.com/apache/hive/pull/6548#issuecomment-4732536355

   ## [![Quality Gate Passed](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/checks/QualityGateBadge/qg-passed-20px.png 'Quality Gate Passed')](https://sonarcloud.io/dashboard?id=apache_hive&pullRequest=6548) **Quality Gate passed**  
   Issues  
   ![](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/passed-16px.png '') [0 New issues](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=6548&issueStatuses=OPEN,CONFIRMED&sinceLeakPeriod=true)  
   ![](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/accepted-16px.png '') [0 Accepted issues](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=6548&issueStatuses=ACCEPTED)
   
   Measures  
   ![](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/passed-16px.png '') [0 Security Hotspots](https://sonarcloud.io/project/security_hotspots?id=apache_hive&pullRequest=6548&issueStatuses=OPEN,CONFIRMED&sinceLeakPeriod=true)  
   ![](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/passed-16px.png '') [0.0% Coverage on New Code](https://sonarcloud.io/component_measures?id=apache_hive&pullRequest=6548&metric=new_coverage&view=list)  
   ![](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/passed-16px.png '') [0.0% Duplication on New Code](https://sonarcloud.io/component_measures?id=apache_hive&pullRequest=6548&metric=new_duplicated_lines_density&view=list)  
     
   <!-- sqra-placement-anchor -->
   [See analysis details on SonarQube Cloud](https://sonarcloud.io/dashboard?id=apache_hive&pullRequest=6548)
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org