You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by GitBox <gi...@apache.org> on 2022/01/07 09:39:20 UTC
[GitHub] [drill] ashishmittal13 opened a new issue #2423: Apache Drill vs Apache Calcite
ashishmittal13 opened a new issue #2423:
URL: https://github.com/apache/drill/issues/2423
I have been exploring about apache drill and apache calcite. I know apache drill uses calcite internally for sql parsing and creating query plan, I wanted to know what is the major difference between the two. I see apache calcite is also able to make sql queries to multiple datasource.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@drill.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [drill] jnturton closed issue #2423: Apache Drill vs Apache Calcite
Posted by GitBox <gi...@apache.org>.
jnturton closed issue #2423:
URL: https://github.com/apache/drill/issues/2423
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@drill.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [drill] ashishmittal13 edited a comment on issue #2423: Apache Drill vs Apache Calcite
Posted by GitBox <gi...@apache.org>.
ashishmittal13 edited a comment on issue #2423:
URL: https://github.com/apache/drill/issues/2423#issuecomment-1007464143
Got it, Thanks for the detailed explanation. I would join slack channel, I have some more things which I want to discuss.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@drill.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [drill] ashishmittal13 commented on issue #2423: Apache Drill vs Apache Calcite
Posted by GitBox <gi...@apache.org>.
ashishmittal13 commented on issue #2423:
URL: https://github.com/apache/drill/issues/2423#issuecomment-1007301161
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@drill.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [drill] jnturton commented on issue #2423: Apache Drill vs Apache Calcite
Posted by GitBox <gi...@apache.org>.
jnturton commented on issue #2423:
URL: https://github.com/apache/drill/issues/2423#issuecomment-1007335381
It doesn't, you're looking at a tutorial based on a demo adapter.
> Calcite-example-CSV is a fully functional adapter for Calcite that reads text files in CSV (comma-separated values) format.
It's a worked example to show you how you can add your own execution engine to Calcite, not production code that they ship.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@drill.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [drill] paul-rogers commented on issue #2423: Apache Drill vs Apache Calcite
Posted by GitBox <gi...@apache.org>.
paul-rogers commented on issue #2423:
URL: https://github.com/apache/drill/issues/2423#issuecomment-1008149366
Here's another way to look at it. Many engines use Calcite: Drill, Druid, Hive, ... Calcite handles the parsing and planning part. Each of those tools has their own way to run a query, as needed by the environment in which they run.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@drill.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [drill] ashishmittal13 commented on issue #2423: Apache Drill vs Apache Calcite
Posted by GitBox <gi...@apache.org>.
ashishmittal13 commented on issue #2423:
URL: https://github.com/apache/drill/issues/2423#issuecomment-1007464143
Got it, Thanks for the detailed explanation. I would join slack channel, I have something which I want to discuss.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@drill.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [drill] jnturton commented on issue #2423: Apache Drill vs Apache Calcite
Posted by GitBox <gi...@apache.org>.
jnturton commented on issue #2423:
URL: https://github.com/apache/drill/issues/2423#issuecomment-1007365206
P.S. please feel welcome to visit to our Slack channels or mailing lists if you'd like to chat more.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@drill.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [drill] ashishmittal13 commented on issue #2423: Apache Drill vs Apache Calcite
Posted by GitBox <gi...@apache.org>.
ashishmittal13 commented on issue #2423:
URL: https://github.com/apache/drill/issues/2423#issuecomment-1007301161
That`s what I thought will be the difference, But here in the calcite documentation
https://calcite.apache.org/docs/tutorial.html
I see , it allows to even execute queries.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@drill.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [drill] jnturton closed issue #2423: Apache Drill vs Apache Calcite
Posted by GitBox <gi...@apache.org>.
jnturton closed issue #2423:
URL: https://github.com/apache/drill/issues/2423
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@drill.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [drill] jnturton commented on issue #2423: Apache Drill vs Apache Calcite
Posted by GitBox <gi...@apache.org>.
jnturton commented on issue #2423:
URL: https://github.com/apache/drill/issues/2423#issuecomment-1007298902
Calcite plans queries but cannot execute those plans. Drill adds this piece, a query execution engine.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@drill.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [drill] jnturton commented on issue #2423: Apache Drill vs Apache Calcite
Posted by GitBox <gi...@apache.org>.
jnturton commented on issue #2423:
URL: https://github.com/apache/drill/issues/2423#issuecomment-1007298902
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@drill.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [drill] ashishmittal13 edited a comment on issue #2423: Apache Drill vs Apache Calcite
Posted by GitBox <gi...@apache.org>.
ashishmittal13 edited a comment on issue #2423:
URL: https://github.com/apache/drill/issues/2423#issuecomment-1007464143
Got it, Thanks for the detailed explanation. I would join slack channel, I have some more things which I want to discuss.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@drill.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [drill] cgivre commented on issue #2423: Apache Drill vs Apache Calcite
Posted by GitBox <gi...@apache.org>.
cgivre commented on issue #2423:
URL: https://github.com/apache/drill/issues/2423#issuecomment-1007406418
I'd add that Drill is a massively parallel processing (MPP) query layer which can interact with MANY different file formats and storage systems. As @jnturton said, Calcite is a query planner and lacks that execution engine. Drill in fact does use Calcite for it's query planning, but if you're looking to actually query data out of the box, you'll need Drill or some other tool.
Drill can also parallelize queries so it can query data at scale. Bottom line, to actually query data, you'll need a query engine, not just the planner.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@drill.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [drill] cgivre commented on issue #2423: Apache Drill vs Apache Calcite
Posted by GitBox <gi...@apache.org>.
cgivre commented on issue #2423:
URL: https://github.com/apache/drill/issues/2423#issuecomment-1007406418
I'd add that Drill is a massively parallel processing (MPP) query layer which can interact with MANY different file formats and storage systems. As @jnturton said, Calcite is a query planner and lacks that execution engine. Drill in fact does use Calcite for it's query planning, but if you're looking to actually query data out of the box, you'll need Drill or some other tool.
Drill can also parallelize queries so it can query data at scale. Bottom line, to actually query data, you'll need a query engine, not just the planner.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@drill.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [drill] cgivre closed issue #2423: Apache Drill vs Apache Calcite
Posted by GitBox <gi...@apache.org>.
cgivre closed issue #2423:
URL: https://github.com/apache/drill/issues/2423
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@drill.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org