You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Dobes Vandermeer (JIRA)" <ji...@apache.org> on 2018/10/09 20:02:00 UTC
[jira] [Updated] (DRILL-6786) Work with servers where you do not
have full privileges
[ https://issues.apache.org/jira/browse/DRILL-6786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dobes Vandermeer updated DRILL-6786:
------------------------------------
Description:
We have a mongo database hosted with mLab. When trying to connect to this database, a couple of issues show up due to the lack of admin privileges on that database.
Assuming I specify the full connection URL including the name of a database, the connection fails with this in the logs:
{code:java}
2018-10-09 19:42:52,788 [2442fb44-f73b-1344-0359-125fcc386645:foreman] WARN o.a.d.e.s.m.s.MongoSchemaFactory - Failure while loading databases in Mongo. Command failed with error 13: 'not authorized on admin to execute command { listDatabases: 1, $db: "admin" }' on server ds063555-a1.vvn97.fleet.mlab.com:63555. The full response is { "operationTime" : { "$timestamp" :
{ "t" : 1539114172, "i" : 230 }
}, "ok" : 0.0, "errmsg" : "not authorized on admin to execute command { listDatabases: 1, $db: \"admin\" }", "code" : 13, "codeName" : "Unauthorized", "$clusterTime" : { "clusterTime" : { "$timestamp" :
{ "t" : 1539114172, "i" : 230 }
}, "signature" : { "hash" :
{ "$binary" : "r3SzOhbP8Zgu9BSyWvGPBlPmrt8=", "$type" : "0" }
, "keyId" : { "$numberLong" : "6608592120234115184" } } } }
{code}
If I don't specify the database name on the connection string, I get:
{code:java}
2018-10-09 19:22:26,144 [2443000d-43b5-7cf3-e914-c27a7349fbf7:foreman] INFO o.a.drill.exec.work.foreman.Foreman - Query text for query id 2443000d-43b5-7cf3-e914-c27a7349fbf7: SHOW DATABASES 2018-10-09 19:22:56,147 [2443000d-43b5-7cf3-e914-c27a7349fbf7:foreman] WARN o.a.d.e.s.m.s.MongoSchemaFactory - Failure while loading databases in Mongo. Timed out after 30000 ms while waiting for a server that matches ReadPreferenceServerSelector{readPreference=primary}. Client view of cluster state is {type=REPLICA_SET, servers=[{address=ds063555-a0.vvn97.fleet.mlab.com:63555, type=UNKNOWN, state=CONNECTING, exception={com.mongodb.MongoSecurityException: Exception authenticating MongoCredential{mechanism=null, userName='dobes', source='admin', password=<hidden>, mechanismProperties={}}}, caused by {com.mongodb.MongoCommandException: Command failed with error 18: 'Authentication failed.' on server ds063555-a0.vvn97.fleet.mlab.com:63555. The full response is { "ok" : 0.0, "errmsg" : "Authentication failed.", "code" : 18, "codeName" : "AuthenticationFailed", "operationTime" : { "$timestamp" :
{ "t" : 1539112946, "i" : 166 }
}, "$clusterTime" : { "clusterTime" : { "$timestamp" :
{ "t" : 1539112946, "i" : 166 }
}, "signature" : { "hash" :
{ "$binary" : "fSW8oqdPrR41ffVTL/Lv9/uZz6M=", "$type" : "0" }
, "keyId" : { "$numberLong" : "6608592120234115184" } } } }}}, {address=ds063555-a1.vvn97.fleet.mlab.com:63555, type=UNKNOWN, state=CONNECTING, exception={com.mongodb.MongoSecurityException: Exception authenticating MongoCredential{mechanism=null, userName='dobes', source='admin', password=<hidden>, mechanismProperties={}}}, caused by {com.mongodb.MongoCommandException: Command failed with error 18: 'Authentication failed.' on server ds063555-a1.vvn97.fleet.mlab.com:63555. The full response is { "ok" : 0.0, "errmsg" : "Authentication failed.", "code" : 18, "codeName" : "AuthenticationFailed", "operationTime" : { "$timestamp" :
{ "t" : 1539112946, "i" : 166 }
}, "$clusterTime" : { "clusterTime" : { "$timestamp" :
{ "t" : 1539112946, "i" : 166 }
}, "signature" : { "hash" :
{ "$binary" : "fSW8oqdPrR41ffVTL/Lv9/uZz6M=", "$type" : "0" }
, "keyId" : { "$numberLong" : "6608592120234115184" } } } }}}] 2018-10-09 19:23:26,149 [2443000d-43b5-7cf3-e914-c27a7349fbf7:foreman] WARN o.a.d.e.s.m.s.MongoSchemaFactory - Failure while getting collection names from 'formative'. Timed out after 30000 ms while waiting for a server that matches ReadPreferenceServerSelector{readPreference=primary}. Client view of cluster state is {type=REPLICA_SET, servers=[{address=ds063555-a0.vvn97.fleet.mlab.com:63555, type=UNKNOWN, state=CONNECTING, exception={com.mongodb.MongoSecurityException: Exception authenticating MongoCredential{mechanism=null, userName='dobes', source='admin', password=<hidden>, mechanismProperties={}}}, caused by {com.mongodb.MongoCommandException: Command failed with error 18: 'Authentication failed.' on server ds063555-a0.vvn97.fleet.mlab.com:63555. The full response is { "ok" : 0.0, "errmsg" : "Authentication failed.", "code" : 18, "codeName" : "AuthenticationFailed", "operationTime" : { "$timestamp" :
{ "t" : 1539112946, "i" : 166 }
}, "$clusterTime" : { "clusterTime" : { "$timestamp" :
{ "t" : 1539112946, "i" : 166 }
}, "signature" : { "hash" :
{ "$binary" : "fSW8oqdPrR41ffVTL/Lv9/uZz6M=", "$type" : "0" }
, "keyId" : { "$numberLong" : "6608592120234115184" } } } }}}, {address=ds063555-a1.vvn97.fleet.mlab.com:63555, type=UNKNOWN, state=CONNECTING, exception={com.mongodb.MongoSecurityException: Exception authenticating MongoCredential{mechanism=null, userName='dobes', source='admin', password=<hidden>, mechanismProperties={}}}, caused by {com.mongodb.MongoCommandException: Command failed with error 18: 'Authentication failed.' on server ds063555-a1.vvn97.fleet.mlab.com:63555. The full response is { "ok" : 0.0, "errmsg" : "Authentication failed.", "code" : 18, "codeName" : "AuthenticationFailed", "operationTime" : { "$timestamp" :
{ "t" : 1539112946, "i" : 166 }
}, "$clusterTime" : { "clusterTime" : { "$timestamp" :
{ "t" : 1539112946, "i" : 166 }
}, "signature" : { "hash" :
{ "$binary" : "fSW8oqdPrR41ffVTL/Lv9/uZz6M=", "$type" : "0" }
, "keyId" : { "$numberLong" : "6608592120234115184" } } } }}}]
{code}
mLab itself logs a message about the auth being rejected because the user cannot access the "admin" database or somesuch.
I suggest that if the connection string specifies a database, the drill client should forego listing off databases and expose only the database provided on the URL.
was:
We have a mongo database hosted with mLab. When trying to connect to this database, a couple of issues show up due to the lack of admin privileges on that database.
Assuming I specify the full connection URL including the name of a database, the connection fails with this in the logs:
2018-10-09 19:42:52,788 [2442fb44-f73b-1344-0359-125fcc386645:foreman] WARN o.a.d.e.s.m.s.MongoSchemaFactory - Failure while loading databases in Mongo. Command failed with error 13: 'not authorized on admin to execute command \{ listDatabases: 1, $db: "admin" }' on server ds063555-a1.vvn97.fleet.mlab.com:63555. The full response is \{ "operationTime" : { "$timestamp" : { "t" : 1539114172, "i" : 230 } }, "ok" : 0.0, "errmsg" : "not authorized on admin to execute command \{ listDatabases: 1, $db: \"admin\" }", "code" : 13, "codeName" : "Unauthorized", "$clusterTime" : \{ "clusterTime" : { "$timestamp" : { "t" : 1539114172, "i" : 230 } }, "signature" : \{ "hash" : { "$binary" : "r3SzOhbP8Zgu9BSyWvGPBlPmrt8=", "$type" : "0" }, "keyId" : \{ "$numberLong" : "6608592120234115184" } } } }
If I don't specify the database name on the connection string, I get:
2018-10-09 19:22:26,144 [2443000d-43b5-7cf3-e914-c27a7349fbf7:foreman] INFO o.a.drill.exec.work.foreman.Foreman - Query text for query id 2443000d-43b5-7cf3-e914-c27a7349fbf7: SHOW DATABASES 2018-10-09 19:22:56,147 [2443000d-43b5-7cf3-e914-c27a7349fbf7:foreman] WARN o.a.d.e.s.m.s.MongoSchemaFactory - Failure while loading databases in Mongo. Timed out after 30000 ms while waiting for a server that matches ReadPreferenceServerSelector\{readPreference=primary}. Client view of cluster state is \{type=REPLICA_SET, servers=[{address=ds063555-a0.vvn97.fleet.mlab.com:63555, type=UNKNOWN, state=CONNECTING, exception={com.mongodb.MongoSecurityException: Exception authenticating MongoCredential{mechanism=null, userName='dobes', source='admin', password=<hidden>, mechanismProperties={}}}, caused by \{com.mongodb.MongoCommandException: Command failed with error 18: 'Authentication failed.' on server ds063555-a0.vvn97.fleet.mlab.com:63555. The full response is { "ok" : 0.0, "errmsg" : "Authentication failed.", "code" : 18, "codeName" : "AuthenticationFailed", "operationTime" : { "$timestamp" : { "t" : 1539112946, "i" : 166 } }, "$clusterTime" : \{ "clusterTime" : { "$timestamp" : { "t" : 1539112946, "i" : 166 } }, "signature" : \{ "hash" : { "$binary" : "fSW8oqdPrR41ffVTL/Lv9/uZz6M=", "$type" : "0" }, "keyId" : \{ "$numberLong" : "6608592120234115184" } } } }}}, \{address=ds063555-a1.vvn97.fleet.mlab.com:63555, type=UNKNOWN, state=CONNECTING, exception={com.mongodb.MongoSecurityException: Exception authenticating MongoCredential{mechanism=null, userName='dobes', source='admin', password=<hidden>, mechanismProperties={}}}, caused by \{com.mongodb.MongoCommandException: Command failed with error 18: 'Authentication failed.' on server ds063555-a1.vvn97.fleet.mlab.com:63555. The full response is { "ok" : 0.0, "errmsg" : "Authentication failed.", "code" : 18, "codeName" : "AuthenticationFailed", "operationTime" : { "$timestamp" : { "t" : 1539112946, "i" : 166 } }, "$clusterTime" : \{ "clusterTime" : { "$timestamp" : { "t" : 1539112946, "i" : 166 } }, "signature" : \{ "hash" : { "$binary" : "fSW8oqdPrR41ffVTL/Lv9/uZz6M=", "$type" : "0" }, "keyId" : \{ "$numberLong" : "6608592120234115184" } } } }}}] 2018-10-09 19:23:26,149 [2443000d-43b5-7cf3-e914-c27a7349fbf7:foreman] WARN o.a.d.e.s.m.s.MongoSchemaFactory - Failure while getting collection names from 'formative'. Timed out after 30000 ms while waiting for a server that matches ReadPreferenceServerSelector\{readPreference=primary}. Client view of cluster state is \{type=REPLICA_SET, servers=[{address=ds063555-a0.vvn97.fleet.mlab.com:63555, type=UNKNOWN, state=CONNECTING, exception={com.mongodb.MongoSecurityException: Exception authenticating MongoCredential{mechanism=null, userName='dobes', source='admin', password=<hidden>, mechanismProperties={}}}, caused by \{com.mongodb.MongoCommandException: Command failed with error 18: 'Authentication failed.' on server ds063555-a0.vvn97.fleet.mlab.com:63555. The full response is { "ok" : 0.0, "errmsg" : "Authentication failed.", "code" : 18, "codeName" : "AuthenticationFailed", "operationTime" : { "$timestamp" : { "t" : 1539112946, "i" : 166 } }, "$clusterTime" : \{ "clusterTime" : { "$timestamp" : { "t" : 1539112946, "i" : 166 } }, "signature" : \{ "hash" : { "$binary" : "fSW8oqdPrR41ffVTL/Lv9/uZz6M=", "$type" : "0" }, "keyId" : \{ "$numberLong" : "6608592120234115184" } } } }}}, \{address=ds063555-a1.vvn97.fleet.mlab.com:63555, type=UNKNOWN, state=CONNECTING, exception={com.mongodb.MongoSecurityException: Exception authenticating MongoCredential{mechanism=null, userName='dobes', source='admin', password=<hidden>, mechanismProperties={}}}, caused by \{com.mongodb.MongoCommandException: Command failed with error 18: 'Authentication failed.' on server ds063555-a1.vvn97.fleet.mlab.com:63555. The full response is { "ok" : 0.0, "errmsg" : "Authentication failed.", "code" : 18, "codeName" : "AuthenticationFailed", "operationTime" : { "$timestamp" : { "t" : 1539112946, "i" : 166 } }, "$clusterTime" : \{ "clusterTime" : { "$timestamp" : { "t" : 1539112946, "i" : 166 } }, "signature" : \{ "hash" : { "$binary" : "fSW8oqdPrR41ffVTL/Lv9/uZz6M=", "$type" : "0" }, "keyId" : \{ "$numberLong" : "6608592120234115184" } } } }}}]
mLab itself logs a message about the auth being rejected because the user cannot access the "admin" database or somesuch.
I suggest that if the connection string specifies a database, the drill client should forego listing off databases and expose only the database provided on the URL.
> Work with servers where you do not have full privileges
> -------------------------------------------------------
>
> Key: DRILL-6786
> URL: https://issues.apache.org/jira/browse/DRILL-6786
> Project: Apache Drill
> Issue Type: Improvement
> Components: Storage - MongoDB
> Affects Versions: 1.14.0
> Reporter: Dobes Vandermeer
> Priority: Major
>
> We have a mongo database hosted with mLab. When trying to connect to this database, a couple of issues show up due to the lack of admin privileges on that database.
> Assuming I specify the full connection URL including the name of a database, the connection fails with this in the logs:
>
> {code:java}
> 2018-10-09 19:42:52,788 [2442fb44-f73b-1344-0359-125fcc386645:foreman] WARN o.a.d.e.s.m.s.MongoSchemaFactory - Failure while loading databases in Mongo. Command failed with error 13: 'not authorized on admin to execute command { listDatabases: 1, $db: "admin" }' on server ds063555-a1.vvn97.fleet.mlab.com:63555. The full response is { "operationTime" : { "$timestamp" :
> { "t" : 1539114172, "i" : 230 }
> }, "ok" : 0.0, "errmsg" : "not authorized on admin to execute command { listDatabases: 1, $db: \"admin\" }", "code" : 13, "codeName" : "Unauthorized", "$clusterTime" : { "clusterTime" : { "$timestamp" :
> { "t" : 1539114172, "i" : 230 }
> }, "signature" : { "hash" :
> { "$binary" : "r3SzOhbP8Zgu9BSyWvGPBlPmrt8=", "$type" : "0" }
> , "keyId" : { "$numberLong" : "6608592120234115184" } } } }
>
> {code}
>
> If I don't specify the database name on the connection string, I get:
>
> {code:java}
> 2018-10-09 19:22:26,144 [2443000d-43b5-7cf3-e914-c27a7349fbf7:foreman] INFO o.a.drill.exec.work.foreman.Foreman - Query text for query id 2443000d-43b5-7cf3-e914-c27a7349fbf7: SHOW DATABASES 2018-10-09 19:22:56,147 [2443000d-43b5-7cf3-e914-c27a7349fbf7:foreman] WARN o.a.d.e.s.m.s.MongoSchemaFactory - Failure while loading databases in Mongo. Timed out after 30000 ms while waiting for a server that matches ReadPreferenceServerSelector{readPreference=primary}. Client view of cluster state is {type=REPLICA_SET, servers=[{address=ds063555-a0.vvn97.fleet.mlab.com:63555, type=UNKNOWN, state=CONNECTING, exception={com.mongodb.MongoSecurityException: Exception authenticating MongoCredential{mechanism=null, userName='dobes', source='admin', password=<hidden>, mechanismProperties={}}}, caused by {com.mongodb.MongoCommandException: Command failed with error 18: 'Authentication failed.' on server ds063555-a0.vvn97.fleet.mlab.com:63555. The full response is { "ok" : 0.0, "errmsg" : "Authentication failed.", "code" : 18, "codeName" : "AuthenticationFailed", "operationTime" : { "$timestamp" :
> { "t" : 1539112946, "i" : 166 }
> }, "$clusterTime" : { "clusterTime" : { "$timestamp" :
> { "t" : 1539112946, "i" : 166 }
> }, "signature" : { "hash" :
> { "$binary" : "fSW8oqdPrR41ffVTL/Lv9/uZz6M=", "$type" : "0" }
> , "keyId" : { "$numberLong" : "6608592120234115184" } } } }}}, {address=ds063555-a1.vvn97.fleet.mlab.com:63555, type=UNKNOWN, state=CONNECTING, exception={com.mongodb.MongoSecurityException: Exception authenticating MongoCredential{mechanism=null, userName='dobes', source='admin', password=<hidden>, mechanismProperties={}}}, caused by {com.mongodb.MongoCommandException: Command failed with error 18: 'Authentication failed.' on server ds063555-a1.vvn97.fleet.mlab.com:63555. The full response is { "ok" : 0.0, "errmsg" : "Authentication failed.", "code" : 18, "codeName" : "AuthenticationFailed", "operationTime" : { "$timestamp" :
> { "t" : 1539112946, "i" : 166 }
> }, "$clusterTime" : { "clusterTime" : { "$timestamp" :
> { "t" : 1539112946, "i" : 166 }
> }, "signature" : { "hash" :
> { "$binary" : "fSW8oqdPrR41ffVTL/Lv9/uZz6M=", "$type" : "0" }
> , "keyId" : { "$numberLong" : "6608592120234115184" } } } }}}] 2018-10-09 19:23:26,149 [2443000d-43b5-7cf3-e914-c27a7349fbf7:foreman] WARN o.a.d.e.s.m.s.MongoSchemaFactory - Failure while getting collection names from 'formative'. Timed out after 30000 ms while waiting for a server that matches ReadPreferenceServerSelector{readPreference=primary}. Client view of cluster state is {type=REPLICA_SET, servers=[{address=ds063555-a0.vvn97.fleet.mlab.com:63555, type=UNKNOWN, state=CONNECTING, exception={com.mongodb.MongoSecurityException: Exception authenticating MongoCredential{mechanism=null, userName='dobes', source='admin', password=<hidden>, mechanismProperties={}}}, caused by {com.mongodb.MongoCommandException: Command failed with error 18: 'Authentication failed.' on server ds063555-a0.vvn97.fleet.mlab.com:63555. The full response is { "ok" : 0.0, "errmsg" : "Authentication failed.", "code" : 18, "codeName" : "AuthenticationFailed", "operationTime" : { "$timestamp" :
> { "t" : 1539112946, "i" : 166 }
> }, "$clusterTime" : { "clusterTime" : { "$timestamp" :
> { "t" : 1539112946, "i" : 166 }
> }, "signature" : { "hash" :
> { "$binary" : "fSW8oqdPrR41ffVTL/Lv9/uZz6M=", "$type" : "0" }
> , "keyId" : { "$numberLong" : "6608592120234115184" } } } }}}, {address=ds063555-a1.vvn97.fleet.mlab.com:63555, type=UNKNOWN, state=CONNECTING, exception={com.mongodb.MongoSecurityException: Exception authenticating MongoCredential{mechanism=null, userName='dobes', source='admin', password=<hidden>, mechanismProperties={}}}, caused by {com.mongodb.MongoCommandException: Command failed with error 18: 'Authentication failed.' on server ds063555-a1.vvn97.fleet.mlab.com:63555. The full response is { "ok" : 0.0, "errmsg" : "Authentication failed.", "code" : 18, "codeName" : "AuthenticationFailed", "operationTime" : { "$timestamp" :
> { "t" : 1539112946, "i" : 166 }
> }, "$clusterTime" : { "clusterTime" : { "$timestamp" :
> { "t" : 1539112946, "i" : 166 }
> }, "signature" : { "hash" :
> { "$binary" : "fSW8oqdPrR41ffVTL/Lv9/uZz6M=", "$type" : "0" }
> , "keyId" : { "$numberLong" : "6608592120234115184" } } } }}}]
> {code}
>
> mLab itself logs a message about the auth being rejected because the user cannot access the "admin" database or somesuch.
> I suggest that if the connection string specifies a database, the drill client should forego listing off databases and expose only the database provided on the URL.
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)