You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by GitBox <gi...@apache.org> on 2019/04/08 05:50:36 UTC
[GitHub] [incubator-druid] rae89 removed a comment on issue #6896: Add
docker container for druid
rae89 removed a comment on issue #6896: Add docker container for druid
URL: https://github.com/apache/incubator-druid/pull/6896#issuecomment-478870372
@donbowman After running the docker-compose up command to run druid, it seems to work fine. But the issue I am having now is running the Load Batch Data tutorial by running the following command:
`curl -X 'POST' -H 'Content-Type:application/json' -d @quickstart/tutorial/wikipedia-index.json http://localhost:8090/druid/indexer/v1/task` from my local repo while inside the examples directory. The ingestion task immediately fails after each time I try submitting the task.
And I changed the docker-compose services ports to match the same ports as the docker ports, so my overlord on my localhost is running on 8090.
Here is the output of the overlord gui console:
index_wikipedia_2019-04-02T02:43:17.912Z | index | 2019-04-02T02:43:17.923Z | 1970-01-01T00:00:00.000Z | FAILED | FAILED | NONE | 3356 | null | -1 | -1 | wikipedia | null
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
And here is the` docker logs overload | grep FAIL`:
> 2019-04-02T05:34:07,970 INFO [Curator-PathChildrenCache-1] org.apache.druid.indexing.overlord.RemoteTaskRunner - Worker[172.20.0.6:8091] wrote FAILED status for task [index_wikipedia_2019-04-02T05:34:04.235Z] on [TaskLocation{host='172.20.0.6', port=8100, tlsPort=-1}]
> 2019-04-02T05:34:07,970 INFO [Curator-PathChildrenCache-1] org.apache.druid.indexing.overlord.RemoteTaskRunner - Worker[172.20.0.6:8091] completed task[index_wikipedia_2019-04-02T05:34:04.235Z] with status[FAILED]
> 2019-04-02T05:34:07,971 INFO [Curator-PathChildrenCache-1] org.apache.druid.indexing.overlord.TaskQueue - Received FAILED status for task: index_wikipedia_2019-04-02T05:34:04.235Z
> 2019-04-02T05:34:07,995 INFO [Curator-PathChildrenCache-1] org.apache.druid.indexing.overlord.MetadataTaskStorage - Updating task index_wikipedia_2019-04-02T05:34:04.235Z to status: TaskStatus{id=index_wikipedia_2019-04-02T05:34:04.235Z, status=FAILED, duration=3474, errorMsg=null}
> 2019-04-02T05:34:07,998 ERROR [Curator-PathChildrenCache-1] org.apache.druid.java.util.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2019-04-02T05:34:07.998Z","service":"druid/overlord","host":"172.20.0.4:8090","version":"0.15.0-incubating-SNAPSHOT","metric":"task/run/time","value":3474,"dataSource":"wikipedia","taskId":"index_wikipedia_2019-04-02T05:34:04.235Z","taskStatus":"FAILED","taskType":"index"}]
> 2019-04-02T05:34:07,998 INFO [Curator-PathChildrenCache-1] org.apache.druid.indexing.overlord.TaskQueue - Task FAILED: AbstractTask{id='index_wikipedia_2019-04-02T05:34:04.235Z', groupId='index_wikipedia_2019-04-02T05:34:04.235Z', taskResource=TaskResource{availabilityGroup='index_wikipedia_2019-04-02T05:34:04.235Z', requiredCapacity=1}, dataSource='wikipedia', context={}} (3474 run duration)
> 2019-04-02T05:34:08,000 INFO [Curator-PathChildrenCache-1] org.apache.druid.indexing.overlord.TaskRunnerUtils - Task [index_wikipedia_2019-04-02T05:34:04.235Z] status changed to [FAILED].
> 2019-04-02T05:40:11,573 INFO [Curator-PathChildrenCache-1] org.apache.druid.indexing.overlord.RemoteTaskRunner - Worker[172.20.0.6:8091] wrote FAILED status for task [index_wikipedia_2019-04-02T05:40:08.259Z] on [TaskLocation{host='172.20.0.6', port=8100, tlsPort=-1}]
> 2019-04-02T05:40:11,573 INFO [Curator-PathChildrenCache-1] org.apache.druid.indexing.overlord.RemoteTaskRunner - Worker[172.20.0.6:8091] completed task[index_wikipedia_2019-04-02T05:40:08.259Z] with status[FAILED]
> 2019-04-02T05:40:11,573 INFO [Curator-PathChildrenCache-1] org.apache.druid.indexing.overlord.TaskQueue - Received FAILED status for task: index_wikipedia_2019-04-02T05:40:08.259Z
> 2019-04-02T05:40:11,584 INFO [Curator-PathChildrenCache-1] org.apache.druid.indexing.overlord.MetadataTaskStorage - Updating task index_wikipedia_2019-04-02T05:40:08.259Z to status: TaskStatus{id=index_wikipedia_2019-04-02T05:40:08.259Z, status=FAILED, duration=3285, errorMsg=null}
> 2019-04-02T05:40:11,588 ERROR [Curator-PathChildrenCache-1] org.apache.druid.java.util.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2019-04-02T05:40:11.588Z","service":"druid/overlord","host":"172.20.0.4:8090","version":"0.15.0-incubating-SNAPSHOT","metric":"task/run/time","value":3285,"dataSource":"wikipedia","taskId":"index_wikipedia_2019-04-02T05:40:08.259Z","taskStatus":"FAILED","taskType":"index"}]
> 2019-04-02T05:40:11,588 INFO [Curator-PathChildrenCache-1] org.apache.druid.indexing.overlord.TaskQueue - Task FAILED: AbstractTask{id='index_wikipedia_2019-04-02T05:40:08.259Z', groupId='index_wikipedia_2019-04-02T05:40:08.259Z', taskResource=TaskResource{availabilityGroup='index_wikipedia_2019-04-02T05:40:08.259Z', requiredCapacity=1}, dataSource='wikipedia', context={}} (3285 run duration)
> 2019-04-02T05:40:11,588 INFO [Curator-PathChildrenCache-1] org.apache.druid.indexing.overlord.TaskRunnerUtils - Task [index_wikipedia_2019-04-02T05:40:08.259Z] status changed to [FAILED].
> 2019-04-02T05:50:40,948 INFO [Curator-PathChildrenCache-1] org.apache.druid.indexing.overlord.RemoteTaskRunner - Worker[172.20.0.6:8091] wrote FAILED status for task [index_wikipedia_2019-04-02T05:50:37.645Z] on [TaskLocation{host='172.20.0.6', port=8100, tlsPort=-1}]
> 2019-04-02T05:50:40,948 INFO [Curator-PathChildrenCache-1] org.apache.druid.indexing.overlord.RemoteTaskRunner - Worker[172.20.0.6:8091] completed task[index_wikipedia_2019-04-02T05:50:37.645Z] with status[FAILED]
> 2019-04-02T05:50:40,949 INFO [Curator-PathChildrenCache-1] org.apache.druid.indexing.overlord.TaskQueue - Received FAILED status for task: index_wikipedia_2019-04-02T05:50:37.645Z
> 2019-04-02T05:50:40,959 INFO [Curator-PathChildrenCache-1] org.apache.druid.indexing.overlord.MetadataTaskStorage - Updating task index_wikipedia_2019-04-02T05:50:37.645Z to status: TaskStatus{id=index_wikipedia_2019-04-02T05:50:37.645Z, status=FAILED, duration=3277, errorMsg=null}
> 2019-04-02T05:50:40,961 ERROR [Curator-PathChildrenCache-1] org.apache.druid.java.util.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2019-04-02T05:50:40.961Z","service":"druid/overlord","host":"172.20.0.4:8090","version":"0.15.0-incubating-SNAPSHOT","metric":"task/run/time","value":3277,"dataSource":"wikipedia","taskId":"index_wikipedia_2019-04-02T05:50:37.645Z","taskStatus":"FAILED","taskType":"index"}]
> 2019-04-02T05:50:40,961 INFO [Curator-PathChildrenCache-1] org.apache.druid.indexing.overlord.TaskQueue - Task FAILED: AbstractTask{id='index_wikipedia_2019-04-02T05:50:37.645Z', groupId='index_wikipedia_2019-04-02T05:50:37.645Z', taskResource=TaskResource{availabilityGroup='index_wikipedia_2019-04-02T05:50:37.645Z', requiredCapacity=1}, dataSource='wikipedia', context={}} (3277 run duration)
> 2019-04-02T05:50:40,961 INFO [Curator-PathChildrenCache-1] org.apache.druid.indexing.overlord.TaskRunnerUtils - Task [index_wikipedia_2019-04-02T05:50:37.645Z] status changed to [FAILED].
> 2019-04-02T06:01:05,315 INFO [Curator-PathChildrenCache-1] org.apache.druid.indexing.overlord.RemoteTaskRunner - Worker[172.20.0.6:8091] wrote FAILED status for task [index_wikipedia_2019-04-02T06:01:01.993Z] on [TaskLocation{host='172.20.0.6', port=8100, tlsPort=-1}]
> 2019-04-02T06:01:05,315 INFO [Curator-PathChildrenCache-1] org.apache.druid.indexing.overlord.RemoteTaskRunner - Worker[172.20.0.6:8091] completed task[index_wikipedia_2019-04-02T06:01:01.993Z] with status[FAILED]
> 2019-04-02T06:01:05,316 INFO [Curator-PathChildrenCache-1] org.apache.druid.indexing.overlord.TaskQueue - Received FAILED status for task: index_wikipedia_2019-04-02T06:01:01.993Z
> 2019-04-02T06:01:05,327 INFO [Curator-PathChildrenCache-1] org.apache.druid.indexing.overlord.MetadataTaskStorage - Updating task index_wikipedia_2019-04-02T06:01:01.993Z to status: TaskStatus{id=index_wikipedia_2019-04-02T06:01:01.993Z, status=FAILED, duration=3291, errorMsg=null}
> 2019-04-02T06:01:05,329 ERROR [Curator-PathChildrenCache-1] org.apache.druid.java.util.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2019-04-02T06:01:05.329Z","service":"druid/overlord","host":"172.20.0.4:8090","version":"0.15.0-incubating-SNAPSHOT","metric":"task/run/time","value":3291,"dataSource":"wikipedia","taskId":"index_wikipedia_2019-04-02T06:01:01.993Z","taskStatus":"FAILED","taskType":"index"}]
> 2019-04-02T06:01:05,329 INFO [Curator-PathChildrenCache-1] org.apache.druid.indexing.overlord.TaskQueue - Task FAILED: AbstractTask{id='index_wikipedia_2019-04-02T06:01:01.993Z', groupId='index_wikipedia_2019-04-02T06:01:01.993Z', taskResource=TaskResource{availabilityGroup='index_wikipedia_2019-04-02T06:01:01.993Z', requiredCapacity=1}, dataSource='wikipedia', context={}} (3291 run duration)
> 2019-04-02T06:01:05,329 INFO [Curator-PathChildrenCache-1] org.apache.druid.indexing.overlord.TaskRunnerUtils - Task [index_wikipedia_2019-04-02T06:01:01.993Z] status changed to [FAILED].
> 2019-04-02T06:18:10,552 INFO [Curator-PathChildrenCache-1] org.apache.druid.indexing.overlord.RemoteTaskRunner - Worker[172.20.0.6:8091] wrote FAILED status for task [index_wikipedia_2019-04-02T06:18:07.137Z] on [TaskLocation{host='172.20.0.6', port=8100, tlsPort=-1}]
> 2019-04-02T06:18:10,552 INFO [Curator-PathChildrenCache-1] org.apache.druid.indexing.overlord.RemoteTaskRunner - Worker[172.20.0.6:8091] completed task[index_wikipedia_2019-04-02T06:18:07.137Z] with status[FAILED]
> 2019-04-02T06:18:10,552 INFO [Curator-PathChildrenCache-1] org.apache.druid.indexing.overlord.TaskQueue - Received FAILED status for task: index_wikipedia_2019-04-02T06:18:07.137Z
> 2019-04-02T06:18:10,563 INFO [Curator-PathChildrenCache-1] org.apache.druid.indexing.overlord.MetadataTaskStorage - Updating task index_wikipedia_2019-04-02T06:18:07.137Z to status: TaskStatus{id=index_wikipedia_2019-04-02T06:18:07.137Z, status=FAILED, duration=3387, errorMsg=null}
> 2019-04-02T06:18:10,565 ERROR [Curator-PathChildrenCache-1] org.apache.druid.java.util.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2019-04-02T06:18:10.565Z","service":"druid/overlord","host":"172.20.0.4:8090","version":"0.15.0-incubating-SNAPSHOT","metric":"task/run/time","value":3387,"dataSource":"wikipedia","taskId":"index_wikipedia_2019-04-02T06:18:07.137Z","taskStatus":"FAILED","taskType":"index"}]
> 2019-04-02T06:18:10,565 INFO [Curator-PathChildrenCache-1] org.apache.druid.indexing.overlord.TaskQueue - Task FAILED: AbstractTask{id='index_wikipedia_2019-04-02T06:18:07.137Z', groupId='index_wikipedia_2019-04-02T06:18:07.137Z', taskResource=TaskResource{availabilityGroup='index_wikipedia_2019-04-02T06:18:07.137Z', requiredCapacity=1}, dataSource='wikipedia', context={}} (3387 run duration)
> 2019-04-02T06:18:10,565 INFO [Curator-PathChildrenCache-1] org.apache.druid.indexing.overlord.TaskRunnerUtils - Task [index_wikipedia_2019-04-02T06:18:07.137Z] status changed to [FAILED].
And here is the `docker logs middlemanager | grep FAIL`:
> 2019-04-02T05:34:07,958 INFO [forking-task-runner-0] org.apache.druid.indexing.overlord.TaskRunnerUtils - Task [index_wikipedia_2019-04-02T05:34:04.235Z] status changed to [FAILED].
> 2019-04-02T05:34:07,968 INFO [WorkerTaskManager-NoticeHandler] org.apache.druid.indexing.worker.WorkerTaskManager - Job's finished. Completed [index_wikipedia_2019-04-02T05:34:04.235Z] with status [FAILED]
> 2019-04-02T05:34:55,113 INFO [WorkerTaskManager-CompletedTasksCleaner] org.apache.druid.indexing.worker.WorkerTaskManager - Deleting completed task[index_wikipedia_2019-04-02T05:34:04.235Z] information, overlord task status[FAILED].
> 2019-04-02T05:40:11,567 INFO [forking-task-runner-1] org.apache.druid.indexing.overlord.TaskRunnerUtils - Task [index_wikipedia_2019-04-02T05:40:08.259Z] status changed to [FAILED].
> 2019-04-02T05:40:11,571 INFO [WorkerTaskManager-NoticeHandler] org.apache.druid.indexing.worker.WorkerTaskManager - Job's finished. Completed [index_wikipedia_2019-04-02T05:40:08.259Z] with status [FAILED]
> 2019-04-02T05:44:54,999 INFO [WorkerTaskManager-CompletedTasksCleaner] org.apache.druid.indexing.worker.WorkerTaskManager - Deleting completed task[index_wikipedia_2019-04-02T05:40:08.259Z] information, overlord task status[FAILED].
> 2019-04-02T05:50:40,942 INFO [forking-task-runner-2] org.apache.druid.indexing.overlord.TaskRunnerUtils - Task [index_wikipedia_2019-04-02T05:50:37.645Z] status changed to [FAILED].
> 2019-04-02T05:50:40,947 INFO [WorkerTaskManager-NoticeHandler] org.apache.druid.indexing.worker.WorkerTaskManager - Job's finished. Completed [index_wikipedia_2019-04-02T05:50:37.645Z] with status [FAILED]
> 2019-04-02T05:54:54,999 INFO [WorkerTaskManager-CompletedTasksCleaner] org.apache.druid.indexing.worker.WorkerTaskManager - Deleting completed task[index_wikipedia_2019-04-02T05:50:37.645Z] information, overlord task status[FAILED].
> 2019-04-02T06:01:05,306 INFO [forking-task-runner-0] org.apache.druid.indexing.overlord.TaskRunnerUtils - Task [index_wikipedia_2019-04-02T06:01:01.993Z] status changed to [FAILED].
> 2019-04-02T06:01:05,313 INFO [WorkerTaskManager-NoticeHandler] org.apache.druid.indexing.worker.WorkerTaskManager - Job's finished. Completed [index_wikipedia_2019-04-02T06:01:01.993Z] with status [FAILED]
> 2019-04-02T06:04:54,997 INFO [WorkerTaskManager-CompletedTasksCleaner] org.apache.druid.indexing.worker.WorkerTaskManager - Deleting completed task[index_wikipedia_2019-04-02T06:01:01.993Z] information, overlord task status[FAILED].
> 2019-04-02T06:18:10,546 INFO [forking-task-runner-1] org.apache.druid.indexing.overlord.TaskRunnerUtils - Task [index_wikipedia_2019-04-02T06:18:07.137Z] status changed to [FAILED].
> 2019-04-02T06:18:10,550 INFO [WorkerTaskManager-NoticeHandler] org.apache.druid.indexing.worker.WorkerTaskManager - Job's finished. Completed [index_wikipedia_2019-04-02T06:18:07.137Z] with status [FAILED]
> 2019-04-02T06:19:54,996 INFO [WorkerTaskManager-CompletedTasksCleaner] org.apache.druid.indexing.worker.WorkerTaskManager - Deleting completed task[index_wikipedia_2019-04-02T06:18:07.137Z] information, overlord task status[FAILED].
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org