[GitHub] [incubator-druid] surekhasaharan opened a new issue #7439: API to drop and reload data by interval

[GitBox <gi...@apache.org>]

surekhasaharan opened a new issue #7439: API to drop and reload data by interval
URL: https://github.com/apache/incubator-druid/issues/7439
 
 
   ### Motivation
   
   The process to delete data (mark segments unused) is not simple currently, look at the steps in tutorial : http://druid.io/docs/latest/tutorials/tutorial-delete-data.html.
   It would be useful to provide coordinator APIs which can be used to delete(mark unused) or reload(mark used) segments for a datasource by interval. The API to reload data should mark any non-overshadowed segments as used.
   
   ### Proposed changes
   
   Propose to add two new API's to `DataSourcesResource.java`
   
   `PUT /druid/coordinator/v1/datasources/{dataSourceName}/markUnused`
   `PUT /druid/coordinator/v1/datasources/{dataSourceName}/markUsed`
   
   The payload would contain the intervals or segments which needs to be marked used/unused. Either intervals or segment ids should be provided, if both are provided in the payload , the API would throw an error.
   
   ### Rationale
   
   Considered `DELETE /druid/coordinator/v1/datasources/{dataSourceName}/intervals/{interval}` and `POST /druid/coordinator/v1/datasources/{dataSourceName}/intervals/{interval}`, but the former is already being used to kill segments. So decided to use PUT with the `datasource` and action, with the payload.
   
   ### Operational impact
   
   New api, so no operational impact.
   
   ### Future work
   
   `DELETE /druid/coordinator/v1/datasources/{dataSourceName}/intervals/{interval}` kills the segments, but `DELETE /druid/coordinator/v1/datasources/{dataSourceName}/segments/{segmentId}` disables segments. It would be useful to make the behavior of these two APIs coherent or change the URL to make it more intuitive.
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org