[GitHub] [incubator-pinot] amarnathkarthik edited a comment on issue #6349: Standalone ingestion jobs do not clean up output files after completing loading

[GitBox <gi...@apache.org>]

amarnathkarthik edited a comment on issue #6349:
URL: https://github.com/apache/incubator-pinot/issues/6349#issuecomment-749460499


   @fx19880617 Thanks for the clarification and suggestion.
   
   Shouldn't we just delete the files instead of deleting the output directory for both Tar and Uri push? Also, instead of merging the segment generation and push task, maybe add the cleanUp to remove the tar files from the output directory once push finishes similar to `SegmentMetadataPush`, this will eliminate removing incorrect segment file(s) generated by another job(s).


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org