You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/01/02 11:18:49 UTC
[GitHub] [arrow-datafusion] alamb opened a new issue #1515: high level roadmap for Arrow / Datafusion
alamb opened a new issue #1515:
URL: https://github.com/apache/arrow-datafusion/issues/1515
@matthewmturner and I we think it would be valuable to try making a high level roadmap for Arrow / Datafusion. Specifically, and how this differs from the existing roadmap, we are looking for a rough idea of what people plan on working on with a best efforts guess when they hope to finish. Of course nothing is binding, the goal is to make visible peoples plans so that the developers as a whole can better organize / plan efforts and users have a rough idea of feature roadmap.
Assuming we get enough feedback, we can merge everything in a unified plan.
started a doc here: https://docs.google.com/document/d/1t64vZwZnXm9MyFj2qz3xcAkSxK3Wu12giS3KrS4nDE0/edit
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] houqp commented on issue #1515: high level roadmap for Arrow / Datafusion
Posted by GitBox <gi...@apache.org>.
houqp commented on issue #1515:
URL: https://github.com/apache/arrow-datafusion/issues/1515#issuecomment-1009509430
@liukun4515 see https://github.com/apache/arrow-datafusion/issues/440
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] matthewmturner commented on issue #1515: high level roadmap for Arrow / Datafusion
Posted by GitBox <gi...@apache.org>.
matthewmturner commented on issue #1515:
URL: https://github.com/apache/arrow-datafusion/issues/1515#issuecomment-1012742145
@yahoNanJing no pressure, but ive seen you on multiple ballista related topics and was wondering if you perhaps had any ballista related goals that you would like to add to our 2022 Q1 roadmap. doc is here in case you wanted to see what was already there https://docs.google.com/document/d/1t64vZwZnXm9MyFj2qz3xcAkSxK3Wu12giS3KrS4nDE0/edit.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] liukun4515 commented on issue #1515: high level roadmap for Arrow / Datafusion
Posted by GitBox <gi...@apache.org>.
liukun4515 commented on issue #1515:
URL: https://github.com/apache/arrow-datafusion/issues/1515#issuecomment-1009517973
> @liukun4515 see #440
thanks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] matthewmturner commented on issue #1515: high level roadmap for Arrow / Datafusion
Posted by GitBox <gi...@apache.org>.
matthewmturner commented on issue #1515:
URL: https://github.com/apache/arrow-datafusion/issues/1515#issuecomment-1010040666
@hntd187 @xudong963 let me know if you think worth adding streaming to the roadmap (https://docs.google.com/document/d/1t64vZwZnXm9MyFj2qz3xcAkSxK3Wu12giS3KrS4nDE0/edit).
If so, and you both think its reasonable, I could add to Q1 something like "Begin prototyping a stream provider"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] xudong963 commented on issue #1515: high level roadmap for Arrow / Datafusion
Posted by GitBox <gi...@apache.org>.
xudong963 commented on issue #1515:
URL: https://github.com/apache/arrow-datafusion/issues/1515#issuecomment-1003712427
Make sense to me.
BTW, I don't have edit permission in https://docs.google.com/document/d/1t64vZwZnXm9MyFj2qz3xcAkSxK3Wu12giS3KrS4nDE0/edit
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] alamb commented on issue #1515: high level roadmap for Arrow / Datafusion
Posted by GitBox <gi...@apache.org>.
alamb commented on issue #1515:
URL: https://github.com/apache/arrow-datafusion/issues/1515#issuecomment-1004324004
I plan to add my content tomorrow, FWIW -- thank you for organizing this @matthewmturner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] xudong963 commented on issue #1515: high level roadmap for Arrow / Datafusion
Posted by GitBox <gi...@apache.org>.
xudong963 commented on issue #1515:
URL: https://github.com/apache/arrow-datafusion/issues/1515#issuecomment-1004485790
I want a detailed evaluation of my time and what I want to do, which is expected to be completed this week. BTW, I'm at Oncall this week, so there's not a lot of time to get involved with Datafusion.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] liukun4515 commented on issue #1515: high level roadmap for Arrow / Datafusion
Posted by GitBox <gi...@apache.org>.
liukun4515 commented on issue #1515:
URL: https://github.com/apache/arrow-datafusion/issues/1515#issuecomment-1004474429
> I plan to add my content tomorrow, FWIW -- thank you for organizing this @matthewmturner
I give some suggestions on your plan. @alamb
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] hntd187 commented on issue #1515: high level roadmap for Arrow / Datafusion
Posted by GitBox <gi...@apache.org>.
hntd187 commented on issue #1515:
URL: https://github.com/apache/arrow-datafusion/issues/1515#issuecomment-1010063636
@matthewmturner I'm fine with it, I know design discussions can take time through this venue so if a prototype is working and we can at least have a general idea of the direction/design we want then I’d consider that a very successful Q1.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] liukun4515 commented on issue #1515: high level roadmap for Arrow / Datafusion
Posted by GitBox <gi...@apache.org>.
liukun4515 commented on issue #1515:
URL: https://github.com/apache/arrow-datafusion/issues/1515#issuecomment-1009489044
> @Dandandan @pjmore do you think the work on tokomak optimizer could be added to roadmap?
is there a related issue or pull request？
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] matthewmturner commented on issue #1515: high level roadmap for Arrow / Datafusion
Posted by GitBox <gi...@apache.org>.
matthewmturner commented on issue #1515:
URL: https://github.com/apache/arrow-datafusion/issues/1515#issuecomment-1003717106
> Make sense to me.
>
> BTW, I don't have edit permission in https://docs.google.com/document/d/1t64vZwZnXm9MyFj2qz3xcAkSxK3Wu12giS3KrS4nDE0/edit
Can you try now?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] alamb commented on issue #1515: high level roadmap for Arrow / Datafusion
Posted by GitBox <gi...@apache.org>.
alamb commented on issue #1515:
URL: https://github.com/apache/arrow-datafusion/issues/1515#issuecomment-1003700035
Previous attempt at the same type of exercise from a year ago:
https://docs.google.com/document/d/1qspsOM_dknOxJKdGvKbC1aoVoO0M3i6x1CIo58mmN2Y
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] xudong963 commented on issue #1515: high level roadmap for Arrow / Datafusion
Posted by GitBox <gi...@apache.org>.
xudong963 commented on issue #1515:
URL: https://github.com/apache/arrow-datafusion/issues/1515#issuecomment-1003966933
> > Make sense to me.
> > BTW, I don't have edit permission in https://docs.google.com/document/d/1t64vZwZnXm9MyFj2qz3xcAkSxK3Wu12giS3KrS4nDE0/edit
>
> @xudong963 can you try now?
all right
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] matthewmturner commented on issue #1515: high level roadmap for Arrow / Datafusion
Posted by GitBox <gi...@apache.org>.
matthewmturner commented on issue #1515:
URL: https://github.com/apache/arrow-datafusion/issues/1515#issuecomment-1014179874
As an update on this, I'm currently away but I plan on submitting PR to include roadmap in README later this week.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] matthewmturner edited a comment on issue #1515: high level roadmap for Arrow / Datafusion
Posted by GitBox <gi...@apache.org>.
matthewmturner edited a comment on issue #1515:
URL: https://github.com/apache/arrow-datafusion/issues/1515#issuecomment-1003717106
> Make sense to me.
>
> BTW, I don't have edit permission in https://docs.google.com/document/d/1t64vZwZnXm9MyFj2qz3xcAkSxK3Wu12giS3KrS4nDE0/edit
@xudong963 can you try now?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] matthewmturner commented on issue #1515: high level roadmap for Arrow / Datafusion
Posted by GitBox <gi...@apache.org>.
matthewmturner commented on issue #1515:
URL: https://github.com/apache/arrow-datafusion/issues/1515#issuecomment-1008363268
@Dandandan @pjmore do you think the work on tokomak optimizer could be added to roadmap?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] matthewmturner commented on issue #1515: high level roadmap for Arrow / Datafusion
Posted by GitBox <gi...@apache.org>.
matthewmturner commented on issue #1515:
URL: https://github.com/apache/arrow-datafusion/issues/1515#issuecomment-1016587520
Working on PR for this now.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] alamb closed issue #1515: high level roadmap for Arrow / Datafusion
Posted by GitBox <gi...@apache.org>.
alamb closed issue #1515:
URL: https://github.com/apache/arrow-datafusion/issues/1515
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] pjmore commented on issue #1515: high level roadmap for Arrow / Datafusion
Posted by GitBox <gi...@apache.org>.
pjmore commented on issue #1515:
URL: https://github.com/apache/arrow-datafusion/issues/1515#issuecomment-1010523335
@matthewmturner I've added a little blurb to the roadmap about the optimizer. I'm not entirely sure if the optimizer as it exists is useful so I made it clear that it is in an experimental context.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org