You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by "tfold (via GitHub)" <gi...@apache.org> on 2023/09/20 17:26:56 UTC
[I] "supportsAggregatePushdown": does not work correctly on sharded Mongo Cluster (drill)
tfold opened a new issue, #2831:
URL: https://github.com/apache/drill/issues/2831
Drill 1.2.1
Mongo 4.4
Mongodb Config: 2 shards/3 replicas
Mongos on port 27017
DrillBit:
{
"type": "DB",
"connection": "mongodb://mongo01:27017,mongo02:27017/?readPreference=secondaryPreferred",
"pluginOptimizations": {
"supportsProjectPushdown": true,
"supportsFilterPushdown": true,
"supportsAggregatePushdown": true,
"supportsSortPushdown": true,
"supportsUnionPushdown": true,
"supportsLimitPushdown": true
},
"batchSize": 100,
"enabled": true,
"authMode": "SHARED_USER"
Running a count(*) on the above drill only returns the # of records on one shard. Changing "supportsAggregatePushdown": to false reports the correct count from both shards.
Same query from mongo shell reports total across both shards.
Since we are querying mongos from drill, the count should include records from both shards, but for some reason it only reports a count on the shard that it is talking to.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@drill.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org