[GitHub] [incubator-hudi] yanghua commented on issue #1115: [HUDI-392] Introduce DIstributedTestDataSource to generate test data

[GitBox <gi...@apache.org>]

yanghua commented on issue #1115: [HUDI-392] Introduce DIstributedTestDataSource to generate test data
URL: https://github.com/apache/incubator-hudi/pull/1115#issuecomment-570743819
 
 
   > @yanghua I was on a holiday break, apologies for the late response. Have you tried to run the test-suite ? If the current data generation methodology meets our needs, we might not require the DistributedTestDataSource. If not, we can tweek the current implementation or bring in the DistributedSource, wdyt ?
   
   Hi @n3nash No need to say apology, happy holiday. Yes, I have run the test suite several times. It works fine.
   
   IMO, the `DistributedTestDataSource` will not block the test suite. Actually, I think the test payload generation is a little confused currently. I was thinking about how to refactor it. However, the work was broken by other things about integrating with Azure pipeline and designing how to integrate Hudi with Flink.
   
   The more details about integrating with Azure can be found here:
    - https://github.com/apachehudi-ci/incubator-hudi/blob/master/azure-pipelines.yml
    - https://dev.azure.com/vinoyang/Hudi/_build?definitionId=2
   
   It has not be done.
   
   cc @vinothchandar 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services