You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@impala.apache.org by "VenuReddy2103 (via GitHub)" <gi...@apache.org> on 2023/08/25 12:01:11 UTC
[GitHub] [impala] VenuReddy2103 opened a new pull request, #58: IMPALA-12399: Pass eventTypeSkipList with OPEN_TXN in NotificationEventRequest to avoid receiving OPEN_TXN events from hive metastore
VenuReddy2103 opened a new pull request, #58:
URL: https://github.com/apache/impala/pull/58
Notification events like OPEN_TXN are ignored on catalogd MetastoreEventsProcessor. So, we can pass eventTypeSkipList with OPEN_TXN in NotificationEventRequest while invoking get_next_notification() to avoid reading such notification messages from metastore and then ignoring on catalogd. OPEN_TXN event being more frequent(received even upon describe table operation from beeline), we can significantly reduce unwanted processing on both hive metastore and catalogd. Catalogd reads events in batches of EVENTS_BATCH_SIZE_PER_RPC, skipping such unnecessary events can help catchup the events faster.
Testing:
- Manually tested
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@impala.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [impala] VenuReddy2103 closed pull request #58: IMPALA-12399: Pass eventTypeSkipList with OPEN_TXN in NotificationEventRequest to avoid receiving OPEN_TXN events from hive metastore
Posted by "VenuReddy2103 (via GitHub)" <gi...@apache.org>.
VenuReddy2103 closed pull request #58: IMPALA-12399: Pass eventTypeSkipList with OPEN_TXN in NotificationEventRequest to avoid receiving OPEN_TXN events from hive metastore
URL: https://github.com/apache/impala/pull/58
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@impala.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org