Reaching out to Apache Druid?

[Christofer Dutz <ch...@c-ware.de>]

Hi all,

While reviewing the board report of Apache Druid, I noticed this:

Druid has an extensive web of connections with other Apache projects: Calcite
for SQL planning, Curator and ZooKeeper for coordination, Kafka, Hadoop and
Iceberg as
data sources, Avro, ORC, or Parquet as supported data input formats, and
DataSketches for scalable approximate algorithms. Druid can also be used as a
data source by Superset.

However, it seems to be missing TSfile, which should probably also be a good thing to support.

Possibly worth reaching out to them? (Or did I already recommend that?)

Chris

Re:Re:Reaching out to Apache Druid?

[ColinLee <sh...@163.com>]

Hi Chris and all,


Just to follow up on this previous discussion.


I have reached out to the Apache Druid community with a concrete proposal for adding Apache TsFile input format support to Druid:


https://lists.apache.org/thread/qmrkhobp7p07wkmcf4y4myq36k866zz0


The initial feedback from the Druid community is positive. The suggested direction is to start with a Druid community extension under `extensions-contrib`, implemented through a TsFile `InputFormat` and `InputEntityReader`. The Druid side also mentioned that the TsFile community should take responsibility for maintenance and compatibility testing of the extension.


They also suggested that, once a small prototype is ready, it should include sample data, usage examples, dependency/license information, and a basic test plan so that the extension can be reviewed properly.


I think this is a useful opportunity to expand TsFile's integration with the broader Apache analytics ecosystem. It is also aligned with the direction discussed earlier in this thread.


I would like to hear any thoughts or concerns from the TsFile community, especially around the initial scope, compatibility testing, and long-term maintenance of such an extension.


If there are no major concerns, I plan to continue with a small prototype and share updates with both the TsFile and Druid communities.


Best regards,
Colin











At 2026-07-16 11:55:24, "ColinLee" <sh...@163.com> wrote:
>
>Hi Chris,
>
>Thanks for pointing this out. 
>I agree that Apache Druid would be a good project for TsFile to reach out to, especially since Druid already supports several columnar and analytical data formats.
>
>From the TsFile side, I believe this integration should be feasible. A natural starting point would be to support TsFile as an input format or ingestion source in Druid. 
>We can take a closer look at Druid's existing format and extension mechanisms, and then reach out to the Druid community with a concrete integration proposal.
>
>I would be happy to participate in this from the TsFile community side.
>
>Best,
>Colin
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>At 2026-07-16 03:23:51, "Christofer Dutz" <ch...@c-ware.de> wrote:
>>Hi all,
>>
>>While reviewing the board report of Apache Druid, I noticed this:
>>
>>Druid has an extensive web of connections with other Apache projects: Calcite
>>for SQL planning, Curator and ZooKeeper for coordination, Kafka, Hadoop and
>>Iceberg as
>>data sources, Avro, ORC, or Parquet as supported data input formats, and
>>DataSketches for scalable approximate algorithms. Druid can also be used as a
>>data source by Superset.
>>
>>However, it seems to be missing TSfile, which should probably also be a good thing to support.
>>
>>Possibly worth reaching out to them? (Or did I already recommend that?)
>>
>>Chris
>>

Re:Reaching out to Apache Druid?

[ColinLee <sh...@163.com>]

Hi Chris,

Thanks for pointing this out. 
I agree that Apache Druid would be a good project for TsFile to reach out to, especially since Druid already supports several columnar and analytical data formats.

From the TsFile side, I believe this integration should be feasible. A natural starting point would be to support TsFile as an input format or ingestion source in Druid. 
We can take a closer look at Druid's existing format and extension mechanisms, and then reach out to the Druid community with a concrete integration proposal.

I would be happy to participate in this from the TsFile community side.

Best,
Colin















At 2026-07-16 03:23:51, "Christofer Dutz" <ch...@c-ware.de> wrote:
>Hi all,
>
>While reviewing the board report of Apache Druid, I noticed this:
>
>Druid has an extensive web of connections with other Apache projects: Calcite
>for SQL planning, Curator and ZooKeeper for coordination, Kafka, Hadoop and
>Iceberg as
>data sources, Avro, ORC, or Parquet as supported data input formats, and
>DataSketches for scalable approximate algorithms. Druid can also be used as a
>data source by Superset.
>
>However, it seems to be missing TSfile, which should probably also be a good thing to support.
>
>Possibly worth reaching out to them? (Or did I already recommend that?)
>
>Chris
>