You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Timothy Farkas (JIRA)" <ji...@apache.org> on 2017/08/17 21:05:00 UTC
[jira] [Comment Edited] (DRILL-5507) Millions of "Failure finding
Drillbit running on host" info messages in foreman logs
[ https://issues.apache.org/jira/browse/DRILL-5507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16131289#comment-16131289 ]
Timothy Farkas edited comment on DRILL-5507 at 8/17/17 9:04 PM:
----------------------------------------------------------------
Many of these messages get produced because there can be many Blocks for each file. This message doesn't indicate an error and should be debug level instead of info.
was (Author: timothyfarkas):
Many of these messages get produced because there can be many Blocks for each file. This message doesn't indicate an error and should be debug level instead info.
> Millions of "Failure finding Drillbit running on host" info messages in foreman logs
> ------------------------------------------------------------------------------------
>
> Key: DRILL-5507
> URL: https://issues.apache.org/jira/browse/DRILL-5507
> Project: Apache Drill
> Issue Type: Bug
> Components: Query Planning & Optimization
> Affects Versions: 1.10.0
> Reporter: Veera Naranammalpuram
> Assignee: Timothy Farkas
>
> When foreman tries to execute a query with data files that reside on nodes other than the nodes that are running drillbits, there are millions of messages in the log files like this:
> 2017-05-10 13:22:10,916 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host hostlp0535.mydomain.com. Skipping affinity to that host.
> After 200 MB of these messages, 960K of them and 7 seconds of planning, it continues to execute this query. Is there a way to disable / suppress these messages? What's causing this? Should this be printed with INFO logging as we're seeing or only with DEBUG logging? Is there a way to turn off this check? Below is a snippet from foreman logs:
> 2017-05-10 13:22:10,916 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host hostlp0535.mydomain.com. Skipping affinity to that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host hostlp1402.mydomain.com. Skipping affinity to that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host hostlp0929.mydomain.com. Skipping affinity to that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host hostlp1098.mydomain.com. Skipping affinity to that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host hostlp1230.mydomain.com. Skipping affinity to that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host hostlp1388.mydomain.com. Skipping affinity to that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host hostlp0535.mydomain.com. Skipping affinity to that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host hostlp1291.mydomain.com. Skipping affinity to that host.
> The hostname and domain are scrubbed.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)