You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@datafusion.apache.org by Andy Grove <an...@gmail.com> on 2026/02/19 14:39:51 UTC
[DISCUSS] Archiving datafusion-benchmarks repo
The datafusion-benchmarks repo has not had much activity and seems to be
causing some confusion in the community due to overlap with benchmarks in
other DataFusion repos.
At one time it was useful for central instructions on generating TPC-*
data, but with the new tpchgen-cli, which seems close to also supporting
TPC-DS, the data generation scripts are no longer useful.
I would like to propose archiving this repo. Let me know what you think.
Thanks,
Andy.
Re: [DISCUSS] Archiving datafusion-benchmarks repo
Posted by Matt Butrovich <mb...@apache.org>.
I agree that we should probably archive it. It's confusing with Comet
scripts there and in the Comet repo, and we should stick to an
authoritative source for reproducibility.
On Thu, Feb 19, 2026 at 1:15 PM Andy Grove <an...@gmail.com> wrote:
> Thanks for the feedback so far.
>
> The tracking issue for tpcds support in tpchgen-cli is
> https://github.com/clflushopt/tpchgen-rs/issues/218
>
> On Thu, Feb 19, 2026 at 9:47 AM Kevin Liu <ke...@apache.org> wrote:
>
> > +1 to archiving, I dont see much activity in the repo's issue and pull
> > request. https://github.com/apache/datafusion-benchmarks
> > Excited for the tpcds support in tpchgen-cli, is there a tracking issue
> > thread to see how I can help?
> >
> > On Thu, Feb 19, 2026 at 7:38 AM Andrew Lamb <al...@influxdata.com>
> wrote:
> >
> > > I think it sounds good to me.
> > >
> > > It would be great also to get some more help completing tpchgen-cli
> > >
> > > On Thu, Feb 19, 2026 at 9:40 AM Andy Grove <an...@gmail.com>
> > wrote:
> > >
> > > > The datafusion-benchmarks repo has not had much activity and seems to
> > be
> > > > causing some confusion in the community due to overlap with
> benchmarks
> > in
> > > > other DataFusion repos.
> > > >
> > > > At one time it was useful for central instructions on generating
> TPC-*
> > > > data, but with the new tpchgen-cli, which seems close to also
> > supporting
> > > > TPC-DS, the data generation scripts are no longer useful.
> > > >
> > > > I would like to propose archiving this repo. Let me know what you
> > think.
> > > >
> > > > Thanks,
> > > >
> > > > Andy.
> > > >
> > >
> >
>
Re: [DISCUSS] Archiving datafusion-benchmarks repo
Posted by Andy Grove <an...@gmail.com>.
Thanks for the feedback so far.
The tracking issue for tpcds support in tpchgen-cli is
https://github.com/clflushopt/tpchgen-rs/issues/218
On Thu, Feb 19, 2026 at 9:47 AM Kevin Liu <ke...@apache.org> wrote:
> +1 to archiving, I dont see much activity in the repo's issue and pull
> request. https://github.com/apache/datafusion-benchmarks
> Excited for the tpcds support in tpchgen-cli, is there a tracking issue
> thread to see how I can help?
>
> On Thu, Feb 19, 2026 at 7:38 AM Andrew Lamb <al...@influxdata.com> wrote:
>
> > I think it sounds good to me.
> >
> > It would be great also to get some more help completing tpchgen-cli
> >
> > On Thu, Feb 19, 2026 at 9:40 AM Andy Grove <an...@gmail.com>
> wrote:
> >
> > > The datafusion-benchmarks repo has not had much activity and seems to
> be
> > > causing some confusion in the community due to overlap with benchmarks
> in
> > > other DataFusion repos.
> > >
> > > At one time it was useful for central instructions on generating TPC-*
> > > data, but with the new tpchgen-cli, which seems close to also
> supporting
> > > TPC-DS, the data generation scripts are no longer useful.
> > >
> > > I would like to propose archiving this repo. Let me know what you
> think.
> > >
> > > Thanks,
> > >
> > > Andy.
> > >
> >
>
Re: [DISCUSS] Archiving datafusion-benchmarks repo
Posted by Kevin Liu <ke...@apache.org>.
+1 to archiving, I dont see much activity in the repo's issue and pull
request. https://github.com/apache/datafusion-benchmarks
Excited for the tpcds support in tpchgen-cli, is there a tracking issue
thread to see how I can help?
On Thu, Feb 19, 2026 at 7:38 AM Andrew Lamb <al...@influxdata.com> wrote:
> I think it sounds good to me.
>
> It would be great also to get some more help completing tpchgen-cli
>
> On Thu, Feb 19, 2026 at 9:40 AM Andy Grove <an...@gmail.com> wrote:
>
> > The datafusion-benchmarks repo has not had much activity and seems to be
> > causing some confusion in the community due to overlap with benchmarks in
> > other DataFusion repos.
> >
> > At one time it was useful for central instructions on generating TPC-*
> > data, but with the new tpchgen-cli, which seems close to also supporting
> > TPC-DS, the data generation scripts are no longer useful.
> >
> > I would like to propose archiving this repo. Let me know what you think.
> >
> > Thanks,
> >
> > Andy.
> >
>
Re: [DISCUSS] Archiving datafusion-benchmarks repo
Posted by Andrew Lamb <al...@influxdata.com>.
I think it sounds good to me.
It would be great also to get some more help completing tpchgen-cli
On Thu, Feb 19, 2026 at 9:40 AM Andy Grove <an...@gmail.com> wrote:
> The datafusion-benchmarks repo has not had much activity and seems to be
> causing some confusion in the community due to overlap with benchmarks in
> other DataFusion repos.
>
> At one time it was useful for central instructions on generating TPC-*
> data, but with the new tpchgen-cli, which seems close to also supporting
> TPC-DS, the data generation scripts are no longer useful.
>
> I would like to propose archiving this repo. Let me know what you think.
>
> Thanks,
>
> Andy.
>