You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@drill.apache.org by Divya Gehlot <di...@gmail.com> on 2018/10/11 03:06:55 UTC
Failed to create schema tree when running Drill View Query
Hi ,
At times I get below error when running the View query which fetches the
whole data set
org.apache.drill.common.exceptions.UserRemoteException: RESOURCE ERROR:
Failed to create schema tree.
The Strange behaviour is if I wait for sometime for say 2-3 minutes and run
the query again it works perfectly .
Appreciate if anybody can help me to get me the root cause for it !
Thanks,
Divya
Re: Failed to create schema tree when running Drill View Query
Posted by Kunal Khatua <ku...@apache.org>.
There is another possible explanation of why this is happening.
The `createFullRootSchema` seems to be called as part of the initial schema creation required for a query, and that means initialization of the backend storage plugins for the new nodes.
You might need to disable some of the storage plugins to identify which one is taking time and causing `org.apache.drill.exec.store.SchemaFactory.registerSchemas(...)` [1] to take a long time.
I think, that should help resolve the issue.
[1] https://github.com/apache/drill/blob/master/exec/java-exec/src/main/java/org/apache/drill/exec/store/SchemaTreeProvider.java#L133.
On 10/11/2018 12:10:00 AM, Divya Gehlot <di...@gmail.com> wrote:
Hi Abhishek,
Thanks for the response with clarifications !
When I jumped into the logs ..
May be I should provide some additional information regarding the Drill
cluster before sharing more information what I found in the logs
I have 6 nodes cluster where the 3 nodes are old and 3 are newly added
nodes
Old Nodes - dn1,dn2 and dn3
New Nodes - dn4,dn5,dn6
Whenever the query foreman is newly added nodes the error occurs , I don't
find this error in any of the old nodes drillbit.log
Even the user is Drill admin user I do see the above mentioned error .
I verified that Drill admin has same UID and GID across all the nodes .
I did check the uid is being passed while running the query
> INFO o.a.d.exec.store.SchemaTreeProvider - User Error Occurred: Failed to
> create schema tree. (Error getting user info for current user, 992521597)
Above error I could see in the drillbit.log files of dn4, dn5 and dn6 only
I dont see any error like this on dn1,dn2 or dn3 nodes.
Any thoughts why is it happening despite the same uid across all the nodes .
Thanks,
Divya
On Thu, 11 Oct 2018 at 11:15, Abhishek Girish wrote:
> Hey Divha,
>
> That's usually seen when the underlying FS cannot recognize the session
> user when creating the schema tree. For example if impersonation is enabled
> and no user is passed, Drill tries to use an "anonymous" user. I've seen
> that in case of MapR-FS, that it cannot use such a user to proceed with
> accessing the filesystem.
>
> Can you try if (1) username is passed when launching your client such as
> Sqlline, (2), the user (with same UID) exists on all nodes on the cluster.
>
>
> On Wed, Oct 10, 2018 at 8:07 PM Divya Gehlot
> wrote:
>
> > Hi ,
> > At times I get below error when running the View query which fetches the
> > whole data set
> >
> > org.apache.drill.common.exceptions.UserRemoteException: RESOURCE ERROR:
> > Failed to create schema tree.
> >
> >
> > The Strange behaviour is if I wait for sometime for say 2-3 minutes and
> run
> > the query again it works perfectly .
> >
> >
> > Appreciate if anybody can help me to get me the root cause for it !
> >
> >
> > Thanks,
> >
> > Divya
> >
>
Re: Failed to create schema tree when running Drill View Query
Posted by Divya Gehlot <di...@gmail.com>.
Hi Abhishek,
Thanks for the response with clarifications !
When I jumped into the logs ..
May be I should provide some additional information regarding the Drill
cluster before sharing more information what I found in the logs
I have 6 nodes cluster where the 3 nodes are old and 3 are newly added
nodes
Old Nodes - dn1,dn2 and dn3
New Nodes - dn4,dn5,dn6
Whenever the query foreman is newly added nodes the error occurs , I don't
find this error in any of the old nodes drillbit.log
Even the user is Drill admin user I do see the above mentioned error .
I verified that Drill admin has same UID and GID across all the nodes .
I did check the uid is being passed while running the query
> INFO o.a.d.exec.store.SchemaTreeProvider - User Error Occurred: Failed to
> create schema tree. (Error getting user info for current user, 992521597)
Above error I could see in the drillbit.log files of dn4, dn5 and dn6 only
I dont see any error like this on dn1,dn2 or dn3 nodes.
Any thoughts why is it happening despite the same uid across all the nodes .
Thanks,
Divya
On Thu, 11 Oct 2018 at 11:15, Abhishek Girish <ag...@apache.org> wrote:
> Hey Divha,
>
> That's usually seen when the underlying FS cannot recognize the session
> user when creating the schema tree. For example if impersonation is enabled
> and no user is passed, Drill tries to use an "anonymous" user. I've seen
> that in case of MapR-FS, that it cannot use such a user to proceed with
> accessing the filesystem.
>
> Can you try if (1) username is passed when launching your client such as
> Sqlline, (2), the user (with same UID) exists on all nodes on the cluster.
>
>
> On Wed, Oct 10, 2018 at 8:07 PM Divya Gehlot <di...@gmail.com>
> wrote:
>
> > Hi ,
> > At times I get below error when running the View query which fetches the
> > whole data set
> >
> > org.apache.drill.common.exceptions.UserRemoteException: RESOURCE ERROR:
> > Failed to create schema tree.
> >
> >
> > The Strange behaviour is if I wait for sometime for say 2-3 minutes and
> run
> > the query again it works perfectly .
> >
> >
> > Appreciate if anybody can help me to get me the root cause for it !
> >
> >
> > Thanks,
> >
> > Divya
> >
>
Re: Failed to create schema tree when running Drill View Query
Posted by Abhishek Girish <ag...@apache.org>.
Hey Divha,
That's usually seen when the underlying FS cannot recognize the session
user when creating the schema tree. For example if impersonation is enabled
and no user is passed, Drill tries to use an "anonymous" user. I've seen
that in case of MapR-FS, that it cannot use such a user to proceed with
accessing the filesystem.
Can you try if (1) username is passed when launching your client such as
Sqlline, (2), the user (with same UID) exists on all nodes on the cluster.
On Wed, Oct 10, 2018 at 8:07 PM Divya Gehlot <di...@gmail.com>
wrote:
> Hi ,
> At times I get below error when running the View query which fetches the
> whole data set
>
> org.apache.drill.common.exceptions.UserRemoteException: RESOURCE ERROR:
> Failed to create schema tree.
>
>
> The Strange behaviour is if I wait for sometime for say 2-3 minutes and run
> the query again it works perfectly .
>
>
> Appreciate if anybody can help me to get me the root cause for it !
>
>
> Thanks,
>
> Divya
>