You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@druid.apache.org by Jihoon Son <ji...@apache.org> on 2019/01/30 00:48:39 UTC

Regarding the proposal for Consolidated segment metadata management

Hi all,

I wrote a proposal for consolidated segment metadata management a few weeks
ago. Since it's also a huge and incompatible change, I would like to get
more attention from others.

As described in the proposal, Druid currently stores segment metadata in
two places: metadata store and deep storage. This design has some drawbacks
like not easy to keep them synced.

To solve this problem, the proposal proposes to store the segment metadata
in only metadata store. As a result, insert-segment-to-db tool should be
removed together because it depends on the segment metadata in deep storage.

Please take a look and let me know what you think.

Thanks,
Jihoon