[jira] [Commented] (IMPALA-8661) Create randomized tests for stressing the event processor

["Todd Lipcon (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/IMPALA-8661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16863411#comment-16863411 ] 

Todd Lipcon commented on IMPALA-8661:
-------------------------------------

I think I would lean towards actually issuing Hive queries to try to stress these paths as a full end-to-end. Despite being slower than creating our own batches manually, will help us catch any breakages on the Hive side, and also give us a variety of different interleavings between the notifications arriving and the actual underlying HMS changes happening.

> Create randomized tests for stressing the event processor
> ---------------------------------------------------------
>
>                 Key: IMPALA-8661
>                 URL: https://issues.apache.org/jira/browse/IMPALA-8661
>             Project: IMPALA
>          Issue Type: Sub-task
>            Reporter: Vihang Karajgaonkar
>            Assignee: Vihang Karajgaonkar
>            Priority: Major
>
> We should create pseudo-randomized batches of events to stress event processor so that we can flush out any bugs. The tests could be a junit test which generates a random sized batch with the supported event types. Once the random batch of events are processed, we should validate if the table matches with what is present in HMS



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org