[GitHub] [incubator-pinot] npawar commented on pull request #7016: Add integration test for Kinesis realtime connector

[GitBox <gi...@apache.org>]

npawar commented on pull request #7016:
URL: https://github.com/apache/incubator-pinot/pull/7016#issuecomment-854924298


   > ## Description
   > The PR addresses the issue #6992.
   > It adds integration test for new Kinesis plugin. The input data file has been kept small deliberately as local kinesis by localstack doesn't support large rows. The number of rows will be increased to approx. 1000 in the next commit.
   > 
   > The code starts a local kinesis instance. Then a a stream is created on top of it and data is pushed into that stream.
   > The data is also stored in H2 local database.
   > 
   > Once all the data has been pushed, we compared the total number of rows as well as the value of each row in Pinot with the data present in H2 to validate.
   
   Update the description accordingly since you've now increased the records


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org