You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by "Paul Rogers (JIRA)" <ji...@apache.org> on 2016/11/27 20:11:58 UTC
[jira] [Created] (DRILL-5074) Excessive logging for permission
denied error in CTAS
Paul Rogers created DRILL-5074:
----------------------------------
Summary: Excessive logging for permission denied error in CTAS
Key: DRILL-5074
URL: https://issues.apache.org/jira/browse/DRILL-5074
Project: Apache Drill
Issue Type: Bug
Affects Versions: 1.8.0
Reporter: Paul Rogers
Priority: Minor
Consider the test TestImpersonationMetadata.testCreateTableInWSWithNoPermissionsForQueryUser. This test attempts to do a CTAS in a workspace without proper permissions. A perfectly fine test for perfectly normal scenario. However, the test displays the following very long log message for what is, in essence, a very simple condition.
Expected that Drill would expect permission problems, would log a single message ("User fred attempted to access Table foo without proper permissions"), and omit the gory details of the stack trace. Since this is a normal operating problem, and not a code fault, the stack trace simply clutters the log (and test output.)
Note: the test is being modified to suppress the logging. If you attempt to reproduce the problem using the test after that modification, comment out the call to {{disableWriterLogging()}}.
{code}
22:01:29.890 [27c58945-c8c1-5c3d-6ebc-9926c33ced48:frag:0:0] ERROR o.a.d.e.p.impl.WriterRecordBatch - Failure during query
org.apache.hadoop.security.AccessControlException: Permission denied: user=drillTestUser2, access=WRITE, inode="/drillTestGrp0_755/table1/0_0_0.parquet":fred:drillTestGrp0:drwxr-xr-x
at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:320)
at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:292)
at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:213)
at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190)
...
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_102]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_102]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_102]
Caused by: org.apache.hadoop.ipc.RemoteException: Permission denied: user=drillTestUser2, access=WRITE, inode="/drillTestGrp0_755/table1/0_0_0.parquet":fred:drillTestGrp0:drwxr-xr-x
at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:320)
at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:292)
...
at com.sun.proxy.$Proxy67.create(Unknown Source) ~[na:na]
at org.apache.hadoop.hdfs.DFSOutputStream.newStreamForCreate(DFSOutputStream.java:1623) ~[hadoop-hdfs-2.7.1.jar:na]
... 35 common frames omitted
22:01:29.987 [27c58945-c8c1-5c3d-6ebc-9926c33ced48:frag:0:0] ERROR o.a.d.e.w.fragment.FragmentExecutor - SYSTEM ERROR: RemoteException: Permission denied: user=drillTestUser2, access=WRITE, inode="/drillTestGrp0_755/table1/0_0_0.parquet":fred:drillTestGrp0:drwxr-xr-x
at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:320)
at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:292)
...
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2045)
Fragment 0:0
[Error Id: fff615a2-006d-4a33-a87c-f0d1c25d246f on 172.30.1.66:31013]
org.apache.drill.common.exceptions.UserException: SYSTEM ERROR: RemoteException: Permission denied: user=drillTestUser2, access=WRITE, inode="/drillTestGrp0_755/table1/0_0_0.parquet":fred:drillTestGrp0:drwxr-xr-x
at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:320)
...
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2045)
Fragment 0:0
[Error Id: fff615a2-006d-4a33-a87c-f0d1c25d246f on 172.30.1.66:31013]
at org.apache.drill.common.exceptions.UserException$Builder.build(UserException.java:543) ~[drill-common-1.9.0-SNAPSHOT.jar:1.9.0-SNAPSHOT]
...
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_102]
Caused by: org.apache.hadoop.security.AccessControlException: Permission denied: user=drillTestUser2, access=WRITE, inode="/drillTestGrp0_755/table1/0_0_0.parquet":fred:drillTestGrp0:drwxr-xr-x
at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:320)
at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:292)
...
at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:226) [classes/:na]
... 4 common frames omitted
Caused by: org.apache.hadoop.ipc.RemoteException: Permission denied: user=drillTestUser2, access=WRITE, inode="/drillTestGrp0_755/table1/0_0_0.parquet":fred:drillTestGrp0:drwxr-xr-x
at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:320)
...
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)