You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Rahul Challapalli (JIRA)" <ji...@apache.org> on 2015/04/29 17:14:06 UTC

[jira] [Closed] (DRILL-1758) Drill stops abrupt

     [ https://issues.apache.org/jira/browse/DRILL-1758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rahul Challapalli closed DRILL-1758.
------------------------------------

Closing as this cannot be reproduced

> Drill stops abrupt
> ------------------
>
>                 Key: DRILL-1758
>                 URL: https://issues.apache.org/jira/browse/DRILL-1758
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Functions - Drill
>    Affects Versions: 0.5.0
>         Environment: Hortonworks sandbox 2.1
>            Reporter: Laszlo Prohaszka
>            Assignee: Chun Chang
>            Priority: Critical
>              Labels: abrupt, crashed, drill, immediately, stop
>             Fix For: 0.9.0
>
>
> Hi, 
> My drill does the following problem, and it's quite disturbing, because it stops my job, and I have to wait for it for really long time. 
> Sometimes, if I create a table, or I'd like to query something, it stops without any answer. I have to restart drillbit, but also this is very slow. For example it takes about 15-20 minutes for.
> Last, when it stopped I gave it the command below:
> 0: jdbc:drill:zk=master:2181> create table nasadata(host, datetime, request, response1, response2) as select columns[0] AS `host`, columns[1] AS `datetime`, columns[2] AS `request`, columns[3] AS `response1`, columns[4] AS `response2` from dfs.`/drill/datafiles/log_Aug.csv`;
> My drillbit.out log (last 2000 lines):
>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "TxCleanupService,org.apache.drill.exec.proto.ExecProtos$FragmentHandle,sandbox-5107" daemon prio=10 tid=0x00007f7d49970800 nid=0x1371 waiting on condition [0x00007f7cea787000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000006f5a6bbc0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
>         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
>         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0" daemon prio=10 tid=0x00000000010bb800 nid=0x1366 waiting on condition [0x00007f7ceba8a000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000006f5127840> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>         at java.util.concurrent.ArrayBlockingQueue.put(ArrayBlockingQueue.java:324)
>         at de.huxhorn.lilith.sender.MultiplexSendBytesService.sendBytes(MultiplexSendBytesService.java:132)
>         at de.huxhorn.lilith.logback.appender.MultiplexSocketAppenderBase.sendBytes(MultiplexSocketAppenderBase.java:336)
>         at de.huxhorn.lilith.logback.appender.MultiplexSocketAppenderBase.append(MultiplexSocketAppenderBase.java:348)
>         at ch.qos.logback.core.UnsynchronizedAppenderBase.doAppend(UnsynchronizedAppenderBase.java:88)
>         at ch.qos.logback.core.spi.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:48)
>         at ch.qos.logback.classic.Logger.appendLoopOnAppenders(Logger.java:272)
>         at ch.qos.logback.classic.Logger.callAppenders(Logger.java:259)
>         at ch.qos.logback.classic.Logger.buildLoggingEventAndAppend(Logger.java:441)
>         at ch.qos.logback.classic.Logger.filterAndLog_1(Logger.java:413)
>         at ch.qos.logback.classic.Logger.debug(Logger.java:506)
>         at org.apache.drill.exec.physical.impl.WriterRecordBatch.innerNext(WriterRecordBatch.java:112)
>         at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:95)
>         at org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:116)
>         at org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:59)
>         at org.apache.drill.exec.physical.impl.SingleSenderCreator$SingleSenderRootExec.innerNext(SingleSenderCreator.java:92)
>         at org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:49)
>         at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:104)
>         at org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:250)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - <0x00000006f5fc9440> (a java.util.concurrent.ThreadPoolExecutor$Worker)
> "Timer-5,<CLUSTER>,<ADDR>" daemon prio=10 tid=0x00007f7d49128800 nid=0x1314 waiting on condition [0x00007f7cebc8d000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000006f59ec0e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "Timer-4,<CLUSTER>,<ADDR>" daemon prio=10 tid=0x00007f7d4935c800 nid=0x12e2 waiting on condition [0x00007f7cebd8e000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000006f59ec0e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "threadDeathWatcher-2-1" daemon prio=10 tid=0x00007f7cf8116800 nid=0x12d2 waiting on condition [0x00007f7cece90000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at io.netty.util.ThreadDeathWatcher$Watcher.run(ThreadDeathWatcher.java:113)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "Timer-3,<CLUSTER>,<ADDR>" daemon prio=10 tid=0x00007f7d49916800 nid=0x1262 waiting on condition [0x00007f7cecf91000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000006f59ec0e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "Scheduler-2070747378" prio=10 tid=0x00007f7cf81ef000 nid=0x1253 waiting on condition [0x00007f7ced092000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000006f4d4bea8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
>         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
>         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "Timer-2,<CLUSTER>,<ADDR>" daemon prio=10 tid=0x00007f7d48b2e800 nid=0x1247 waiting on condition [0x00007f7ced193000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000006f59ec0e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "DestroyJavaVM" prio=10 tid=0x00007f7d4800e000 nid=0x11ea waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>    Locked ownable synchronizers:
>         - None
> "qtp770569897-73" prio=10 tid=0x00007f7d49592000 nid=0x1232 waiting on condition [0x00007f7ced291000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000006f5127840> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>         at java.util.concurrent.ArrayBlockingQueue.put(ArrayBlockingQueue.java:324)
>         at de.huxhorn.lilith.sender.MultiplexSendBytesService.sendBytes(MultiplexSendBytesService.java:132)
>         at de.huxhorn.lilith.logback.appender.MultiplexSocketAppenderBase.sendBytes(MultiplexSocketAppenderBase.java:336)
>         at de.huxhorn.lilith.logback.appender.MultiplexSocketAppenderBase.append(MultiplexSocketAppenderBase.java:348)
>         at ch.qos.logback.core.UnsynchronizedAppenderBase.doAppend(UnsynchronizedAppenderBase.java:88)
>         at ch.qos.logback.core.spi.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:48)
>         at ch.qos.logback.classic.Logger.appendLoopOnAppenders(Logger.java:272)
>         at ch.qos.logback.classic.Logger.callAppenders(Logger.java:259)
>         at ch.qos.logback.classic.Logger.buildLoggingEventAndAppend(Logger.java:441)
>         at ch.qos.logback.classic.Logger.filterAndLog_2(Logger.java:432)
>         at ch.qos.logback.classic.Logger.debug(Logger.java:510)
>         at org.apache.drill.exec.store.hbase.HBaseStoragePluginConfig.<init>(HBaseStoragePluginConfig.java:52)
>         at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>         at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>         at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>         at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>         at com.fasterxml.jackson.databind.introspect.AnnotatedConstructor.call(AnnotatedConstructor.java:125)
>         at com.fasterxml.jackson.databind.deser.std.StdValueInstantiator.createFromObjectWith(StdValueInstantiator.java:240)
>         at com.fasterxml.jackson.databind.deser.impl.PropertyBasedCreator.build(PropertyBasedCreator.java:158)
>         at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeUsingPropertyBased(BeanDeserializer.java:352)
>         at com.fasterxml.jackson.databind.deser.BeanDeserializerBase.deserializeFromObjectUsingNonDefault(BeanDeserializerBase.java:976)
>         at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:276)
>         at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeOther(BeanDeserializer.java:157)
>         at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:123)
>         at com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer._deserializeTypedForId(AsPropertyTypeDeserializer.java:113)
>         at com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:82)
>         at com.fasterxml.jackson.databind.deser.AbstractDeserializer.deserializeWithType(AbstractDeserializer.java:106)
>         at com.fasterxml.jackson.databind.deser.impl.TypeWrappedDeserializer.deserialize(TypeWrappedDeserializer.java:36)
>         at com.fasterxml.jackson.databind.ObjectReader._bindAndClose(ObjectReader.java:1216)
>         at com.fasterxml.jackson.databind.ObjectReader.readValue(ObjectReader.java:846)
>         at org.apache.drill.exec.store.sys.serialize.JacksonSerializer.deserialize(JacksonSerializer.java:44)
>         at org.apache.drill.exec.store.sys.zk.ZkPStore.get(ZkPStore.java:79)
>         at org.apache.drill.exec.store.sys.zk.ZkPStore$Iter$DeferredEntry.getValue(ZkPStore.java:168)
>         at org.apache.drill.exec.server.rest.StorageResources.getStoragePluginsJSON(StorageResources.java:74)
>         at org.apache.drill.exec.server.rest.StorageResources.getStoragePlugins(StorageResources.java:87)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:606)
>         at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81)
>         at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:151)
>         at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:171)
>         at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:195)
>         at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:104)
>         at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:387)
>         at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:331)
>         at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:103)
>         at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:269)
>         at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271)
>         at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267)
>         at org.glassfish.jersey.internal.Errors.process(Errors.java:315)
>         at org.glassfish.jersey.internal.Errors.process(Errors.java:297)
>         at org.glassfish.jersey.internal.Errors.process(Errors.java:267)
>         at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:297)
>         at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:252)
>         at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1023)
>         at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:372)
>         at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:382)
>         at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:345)
>         at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:220)
>         at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:738)
>         at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:551)
>         at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1111)
>         at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:478)
>         at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1045)
>         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
>         at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
>         at org.eclipse.jetty.server.Server.handle(Server.java:462)
>         at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:279)
>         at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:232)
>         at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:534)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:607)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:536)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "qtp770569897-72" prio=10 tid=0x00007f7d49385800 nid=0x1231 waiting on condition [0x00007f7ced392000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000006f5127840> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>         at java.util.concurrent.ArrayBlockingQueue.put(ArrayBlockingQueue.java:324)
>         at de.huxhorn.lilith.sender.MultiplexSendBytesService.sendBytes(MultiplexSendBytesService.java:132)
>         at de.huxhorn.lilith.logback.appender.MultiplexSocketAppenderBase.sendBytes(MultiplexSocketAppenderBase.java:336)
>         at de.huxhorn.lilith.logback.appender.MultiplexSocketAppenderBase.append(MultiplexSocketAppenderBase.java:348)
>         at ch.qos.logback.core.UnsynchronizedAppenderBase.doAppend(UnsynchronizedAppenderBase.java:88)
>         at ch.qos.logback.core.spi.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:48)
>         at ch.qos.logback.classic.Logger.appendLoopOnAppenders(Logger.java:272)
>         at ch.qos.logback.classic.Logger.callAppenders(Logger.java:259)
>         at ch.qos.logback.classic.Logger.buildLoggingEventAndAppend(Logger.java:441)
>         at ch.qos.logback.classic.Logger.filterAndLog_2(Logger.java:432)
>         at ch.qos.logback.classic.Logger.debug(Logger.java:510)
>         at org.apache.drill.exec.store.hbase.HBaseStoragePluginConfig.<init>(HBaseStoragePluginConfig.java:52)
>         at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>         at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>         at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>         at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>         at com.fasterxml.jackson.databind.introspect.AnnotatedConstructor.call(AnnotatedConstructor.java:125)
>         at com.fasterxml.jackson.databind.deser.std.StdValueInstantiator.createFromObjectWith(StdValueInstantiator.java:240)
>         at com.fasterxml.jackson.databind.deser.impl.PropertyBasedCreator.build(PropertyBasedCreator.java:158)
>         at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeUsingPropertyBased(BeanDeserializer.java:352)
>         at com.fasterxml.jackson.databind.deser.BeanDeserializerBase.deserializeFromObjectUsingNonDefault(BeanDeserializerBase.java:976)
>         at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:276)
>         at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeOther(BeanDeserializer.java:157)
>         at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:123)
>         at com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer._deserializeTypedForId(AsPropertyTypeDeserializer.java:113)
>         at com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:82)
>         at com.fasterxml.jackson.databind.deser.AbstractDeserializer.deserializeWithType(AbstractDeserializer.java:106)
>         at com.fasterxml.jackson.databind.deser.impl.TypeWrappedDeserializer.deserialize(TypeWrappedDeserializer.java:36)
>         at com.fasterxml.jackson.databind.ObjectReader._bindAndClose(ObjectReader.java:1216)
>         at com.fasterxml.jackson.databind.ObjectReader.readValue(ObjectReader.java:846)
>         at org.apache.drill.exec.store.sys.serialize.JacksonSerializer.deserialize(JacksonSerializer.java:44)
>         at org.apache.drill.exec.store.sys.zk.ZkPStore.get(ZkPStore.java:79)
>         at org.apache.drill.exec.store.sys.zk.ZkPStore$Iter$DeferredEntry.getValue(ZkPStore.java:168)
>         at org.apache.drill.exec.server.rest.StorageResources.getStoragePluginsJSON(StorageResources.java:74)
>         at org.apache.drill.exec.server.rest.StorageResources.getStoragePlugins(StorageResources.java:87)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:606)
>         at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81)
>         at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:151)
>         at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:171)
>         at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:195)
>         at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:104)
>         at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:387)
>         at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:331)
>         at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:103)
>         at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:269)
>         at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271)
>         at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267)
>         at org.glassfish.jersey.internal.Errors.process(Errors.java:315)
>         at org.glassfish.jersey.internal.Errors.process(Errors.java:297)
>         at org.glassfish.jersey.internal.Errors.process(Errors.java:267)
>         at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:297)
>         at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:252)
>         at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1023)
>         at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:372)
>         at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:382)
>         at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:345)
>         at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:220)
>         at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:738)
>         at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:551)
>         at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1111)
>         at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:478)
>         at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1045)
>         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
>         at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
>         at org.eclipse.jetty.server.Server.handle(Server.java:462)
>         at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:279)
>         at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:232)
>         at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:534)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:607)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:536)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "qtp770569897-71" prio=10 tid=0x00007f7d49383800 nid=0x1230 waiting on condition [0x00007f7ced493000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000006f5127840> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>         at java.util.concurrent.ArrayBlockingQueue.put(ArrayBlockingQueue.java:324)
>         at de.huxhorn.lilith.sender.MultiplexSendBytesService.sendBytes(MultiplexSendBytesService.java:132)
>         at de.huxhorn.lilith.logback.appender.MultiplexSocketAppenderBase.sendBytes(MultiplexSocketAppenderBase.java:336)
>         at de.huxhorn.lilith.logback.appender.MultiplexSocketAppenderBase.append(MultiplexSocketAppenderBase.java:348)
>         at ch.qos.logback.core.UnsynchronizedAppenderBase.doAppend(UnsynchronizedAppenderBase.java:88)
>         at ch.qos.logback.core.spi.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:48)
>         at ch.qos.logback.classic.Logger.appendLoopOnAppenders(Logger.java:272)
>         at ch.qos.logback.classic.Logger.callAppenders(Logger.java:259)
>         at ch.qos.logback.classic.Logger.buildLoggingEventAndAppend(Logger.java:441)
>         at ch.qos.logback.classic.Logger.filterAndLog_2(Logger.java:432)
>         at ch.qos.logback.classic.Logger.debug(Logger.java:510)
>         at org.apache.drill.exec.store.hbase.HBaseStoragePluginConfig.<init>(HBaseStoragePluginConfig.java:52)
>         at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>         at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>         at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>         at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>         at com.fasterxml.jackson.databind.introspect.AnnotatedConstructor.call(AnnotatedConstructor.java:125)
>         at com.fasterxml.jackson.databind.deser.std.StdValueInstantiator.createFromObjectWith(StdValueInstantiator.java:240)
>         at com.fasterxml.jackson.databind.deser.impl.PropertyBasedCreator.build(PropertyBasedCreator.java:158)
>         at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeUsingPropertyBased(BeanDeserializer.java:352)
>         at com.fasterxml.jackson.databind.deser.BeanDeserializerBase.deserializeFromObjectUsingNonDefault(BeanDeserializerBase.java:976)
>         at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:276)
>         at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeOther(BeanDeserializer.java:157)
>         at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:123)
>         at com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer._deserializeTypedForId(AsPropertyTypeDeserializer.java:113)
>         at com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:82)
>         at com.fasterxml.jackson.databind.deser.AbstractDeserializer.deserializeWithType(AbstractDeserializer.java:106)
>         at com.fasterxml.jackson.databind.deser.impl.TypeWrappedDeserializer.deserialize(TypeWrappedDeserializer.java:36)
>         at com.fasterxml.jackson.databind.ObjectReader._bindAndClose(ObjectReader.java:1216)
>         at com.fasterxml.jackson.databind.ObjectReader.readValue(ObjectReader.java:846)
>         at org.apache.drill.exec.store.sys.serialize.JacksonSerializer.deserialize(JacksonSerializer.java:44)
>         at org.apache.drill.exec.store.sys.zk.ZkPStore.get(ZkPStore.java:79)
>         at org.apache.drill.exec.store.sys.zk.ZkPStore$Iter$DeferredEntry.getValue(ZkPStore.java:168)
>         at org.apache.drill.exec.server.rest.StorageResources.getStoragePluginsJSON(StorageResources.java:74)
>         at org.apache.drill.exec.server.rest.StorageResources.getStoragePlugins(StorageResources.java:87)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:606)
>         at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81)
>         at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:151)
>         at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:171)
>         at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:195)
>         at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:104)
>         at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:387)
>         at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:331)
>         at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:103)
>         at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:269)
>         at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271)
>         at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267)
>         at org.glassfish.jersey.internal.Errors.process(Errors.java:315)
>         at org.glassfish.jersey.internal.Errors.process(Errors.java:297)
>         at org.glassfish.jersey.internal.Errors.process(Errors.java:267)
>         at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:297)
>         at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:252)
>         at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1023)
>         at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:372)
>         at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:382)
>         at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:345)
>         at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:220)
>         at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:738)
>         at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:551)
>         at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1111)
>         at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:478)
>         at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1045)
>         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
>         at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
>         at org.eclipse.jetty.server.Server.handle(Server.java:462)
>         at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:279)
>         at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:232)
>         at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:534)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:607)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:536)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "qtp770569897-70-acceptor-0-ServerConnector@1e87130a{HTTP/1.1}{0.0.0.0:8047}" prio=10 tid=0x00007f7d49381800 nid=0x122f runnable [0x00007f7ced597000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:241)
>         - locked <0x00000006f4dc3800> (a java.lang.Object)
>         at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:336)
>         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:467)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:607)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:536)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "qtp770569897-69-selector-ServerConnectorManager@7640c83f/3" prio=10 tid=0x00007f7d49380000 nid=0x122e runnable [0x00007f7ced698000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
>         - locked <0x00000006f4dc78c0> (a sun.nio.ch.Util$2)
>         - locked <0x00000006f4dc78a8> (a java.util.Collections$UnmodifiableSet)
>         - locked <0x00000006f5c60570> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
>         at org.eclipse.jetty.io.SelectorManager$ManagedSelector.select(SelectorManager.java:532)
>         at org.eclipse.jetty.io.SelectorManager$ManagedSelector.run(SelectorManager.java:485)
>         at org.eclipse.jetty.util.thread.NonBlockingThread.run(NonBlockingThread.java:52)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:607)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:536)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "qtp770569897-68-selector-ServerConnectorManager@7640c83f/2" prio=10 tid=0x00007f7d4937e800 nid=0x122d runnable [0x00007f7ced799000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
>         - locked <0x00000006f4dd24c8> (a sun.nio.ch.Util$2)
>         - locked <0x00000006f4dd24b0> (a java.util.Collections$UnmodifiableSet)
>         - locked <0x00000006f5c604e0> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
>         at org.eclipse.jetty.io.SelectorManager$ManagedSelector.select(SelectorManager.java:532)
>         at org.eclipse.jetty.io.SelectorManager$ManagedSelector.run(SelectorManager.java:485)
>         at org.eclipse.jetty.util.thread.NonBlockingThread.run(NonBlockingThread.java:52)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:607)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:536)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "qtp770569897-67-selector-ServerConnectorManager@7640c83f/1" prio=10 tid=0x00007f7d4937a800 nid=0x122c runnable [0x00007f7ced89a000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
>         - locked <0x00000006f4ddb400> (a sun.nio.ch.Util$2)
>         - locked <0x00000006f4ddb3e8> (a java.util.Collections$UnmodifiableSet)
>         - locked <0x00000006f5c60450> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
>         at org.eclipse.jetty.io.SelectorManager$ManagedSelector.select(SelectorManager.java:532)
>         at org.eclipse.jetty.io.SelectorManager$ManagedSelector.run(SelectorManager.java:485)
>         at org.eclipse.jetty.util.thread.NonBlockingThread.run(NonBlockingThread.java:52)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:607)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:536)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "qtp770569897-66-selector-ServerConnectorManager@7640c83f/0" prio=10 tid=0x00007f7d49371800 nid=0x122b runnable [0x00007f7cedb9c000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
>         - locked <0x00000006f4ddfba0> (a sun.nio.ch.Util$2)
>         - locked <0x00000006f4ddfb88> (a java.util.Collections$UnmodifiableSet)
>         - locked <0x00000006f5c603c0> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
>         at org.eclipse.jetty.io.SelectorManager$ManagedSelector.select(SelectorManager.java:532)
>         at org.eclipse.jetty.io.SelectorManager$ManagedSelector.run(SelectorManager.java:485)
>         at org.eclipse.jetty.util.thread.NonBlockingThread.run(NonBlockingThread.java:52)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:607)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:536)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "WorkManager Event Thread" daemon prio=10 tid=0x00007f7d4945e800 nid=0x1224 waiting on condition [0x00007f7cedc9d000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000006f5612208> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>         at org.apache.drill.exec.work.WorkManager$EventThread.run(WorkManager.java:219)
>    Locked ownable synchronizers:
>         - None
> "BitServer-2" prio=10 tid=0x00007f7d4914c000 nid=0x1221 runnable [0x00007f7cedd9e000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
>         - locked <0x00000006f52376f8> (a io.netty.channel.nio.SelectedSelectionKeySet)
>         - locked <0x00000006f5391f08> (a java.util.Collections$UnmodifiableSet)
>         - locked <0x00000006f516d250> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
>         at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:618)
>         at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:306)
>         at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "BitServer-1" prio=10 tid=0x00007f7d49142000 nid=0x121f runnable [0x00007f7cede9f000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
>         - locked <0x00000006f51e1bd8> (a io.netty.channel.nio.SelectedSelectionKeySet)
>         - locked <0x00000006f5226cf8> (a java.util.Collections$UnmodifiableSet)
>         - locked <0x00000006f5232ae0> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
>         at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:618)
>         at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:306)
>         at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "UserServer-1" prio=10 tid=0x00007f7d49139000 nid=0x121e waiting on condition [0x00007f7cfc1ad000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000006f5127840> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>         at java.util.concurrent.ArrayBlockingQueue.put(ArrayBlockingQueue.java:324)
>         at de.huxhorn.lilith.sender.MultiplexSendBytesService.sendBytes(MultiplexSendBytesService.java:132)
>         at de.huxhorn.lilith.logback.appender.MultiplexSocketAppenderBase.sendBytes(MultiplexSocketAppenderBase.java:336)
>         at de.huxhorn.lilith.logback.appender.MultiplexSocketAppenderBase.append(MultiplexSocketAppenderBase.java:348)
>         at ch.qos.logback.core.UnsynchronizedAppenderBase.doAppend(UnsynchronizedAppenderBase.java:88)
>         at ch.qos.logback.core.spi.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:48)
>         at ch.qos.logback.classic.Logger.appendLoopOnAppenders(Logger.java:272)
>         at ch.qos.logback.classic.Logger.callAppenders(Logger.java:259)
>         at ch.qos.logback.classic.Logger.buildLoggingEventAndAppend(Logger.java:441)
>         at ch.qos.logback.classic.Logger.filterAndLog_0_Or3Plus(Logger.java:395)
>         at ch.qos.logback.classic.Logger.error(Logger.java:558)
>         at org.apache.drill.exec.rpc.RpcExceptionHandler.exceptionCaught(RpcExceptionHandler.java:37)
>         at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:270)
>         at io.netty.channel.AbstractChannelHandlerContext.fireExceptionCaught(AbstractChannelHandlerContext.java:248)
>         at io.netty.channel.ChannelInboundHandlerAdapter.exceptionCaught(ChannelInboundHandlerAdapter.java:131)
>         at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:270)
>         at io.netty.channel.AbstractChannelHandlerContext.fireExceptionCaught(AbstractChannelHandlerContext.java:248)
>         at io.netty.channel.ChannelInboundHandlerAdapter.exceptionCaught(ChannelInboundHandlerAdapter.java:131)
>         at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:270)
>         at io.netty.channel.AbstractChannelHandlerContext.fireExceptionCaught(AbstractChannelHandlerContext.java:248)
>         at io.netty.channel.ChannelHandlerAdapter.exceptionCaught(ChannelHandlerAdapter.java:88)
>         at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:270)
>         at io.netty.channel.AbstractChannelHandlerContext.fireExceptionCaught(AbstractChannelHandlerContext.java:248)
>         at io.netty.channel.ChannelInboundHandlerAdapter.exceptionCaught(ChannelInboundHandlerAdapter.java:131)
>         at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:270)
>         at io.netty.channel.AbstractChannelHandlerContext.notifyHandlerException(AbstractChannelHandlerContext.java:767)
>         at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:334)
>         at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:318)
>         at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:163)
>         at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:332)
>         at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:318)
>         at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
>         at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:332)
>         at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:318)
>         at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:787)
>         at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:125)
>         at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:507)
>         at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:464)
>         at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:378)
>         at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:350)
>         at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "ServiceCache-0" daemon prio=10 tid=0x00007f7d49123000 nid=0x121c waiting on condition [0x00007f7cfc2af000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000006f50a8aa8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "Timer runner-1,<CLUSTER>,<ADDR>" daemon prio=10 tid=0x00007f7d4911e000 nid=0x121a waiting on condition [0x00007f7cfc3b0000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000006f5835180> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
>         at java.util.concurrent.DelayQueue.take(DelayQueue.java:220)
>         at java.util.concurrent.DelayQueue.take(DelayQueue.java:68)
>         at org.jgroups.util.TimeScheduler3.run(TimeScheduler3.java:164)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "transport-thread-0" daemon prio=10 tid=0x00007f7d4911b000 nid=0x1219 waiting on condition [0x00007f7cfc4b1000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000006f57f82f8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "TxCleanupService,first,sandbox-5107" daemon prio=10 tid=0x00007f7d49114000 nid=0x1218 waiting on condition [0x00007f7cfc5b2000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000006f57f8340> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
>         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
>         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "Scheduled-eviction-thread-0" daemon prio=10 tid=0x00007f7d49113000 nid=0x1217 waiting on condition [0x00007f7cfc6b3000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000006f5857488> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
>         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
>         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "Timer-5,sandbox-5107" daemon prio=10 tid=0x00007f7d00006800 nid=0x1216 waiting on condition [0x00007f7cfc7b4000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000006f58351b0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "Timer-4,sandbox-5107" daemon prio=10 tid=0x00007f7d0000c800 nid=0x1215 waiting on condition [0x00007f7cfc8b5000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000006f58351b0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "INT-1,sandbox-5107" prio=10 tid=0x00007f7d49037800 nid=0x1214 waiting on condition [0x00007f7cfc9b6000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000006f58351f8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "FD_SOCK acceptor,sandbox-5107" daemon prio=10 tid=0x00007f7d4904f000 nid=0x1213 runnable [0x00007f7cfcab7000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.PlainSocketImpl.socketAccept(Native Method)
>         at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:398)
>         at java.net.ServerSocket.implAccept(ServerSocket.java:530)
>         at java.net.ServerSocket.accept(ServerSocket.java:498)
>         at org.jgroups.protocols.FD_SOCK$ServerSocketHandler.run(FD_SOCK.java:1052)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "multicast receiver,sandbox-5107" prio=10 tid=0x00007f7d4903d000 nid=0x1212 runnable [0x00007f7cfcbb8000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.PlainDatagramSocketImpl.receive0(Native Method)
>         - locked <0x00000006f57cf630> (a java.net.PlainDatagramSocketImpl)
>         at java.net.AbstractPlainDatagramSocketImpl.receive(AbstractPlainDatagramSocketImpl.java:145)
>         - locked <0x00000006f57cf630> (a java.net.PlainDatagramSocketImpl)
>         at java.net.DatagramSocket.receive(DatagramSocket.java:786)
>         - locked <0x00000006f4e7b340> (a java.net.DatagramPacket)
>         - locked <0x00000006f539a190> (a java.net.MulticastSocket)
>         at org.jgroups.protocols.UDP$PacketReceiver.run(UDP.java:683)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "unicast receiver,sandbox-5107" prio=10 tid=0x00007f7d4903b000 nid=0x1211 runnable [0x00007f7cfccb9000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.PlainDatagramSocketImpl.receive0(Native Method)
>         - locked <0x00000006f5805b98> (a java.net.PlainDatagramSocketImpl)
>         at java.net.AbstractPlainDatagramSocketImpl.receive(AbstractPlainDatagramSocketImpl.java:145)
>         - locked <0x00000006f5805b98> (a java.net.PlainDatagramSocketImpl)
>         at java.net.DatagramSocket.receive(DatagramSocket.java:786)
>         - locked <0x00000006f55fa830> (a java.net.DatagramPacket)
>         - locked <0x00000006f55fa858> (a java.net.DatagramSocket)
>         at org.jgroups.protocols.UDP$PacketReceiver.run(UDP.java:683)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "Timer-3,sandbox-5107" daemon prio=10 tid=0x00007f7d49038800 nid=0x1210 waiting on condition [0x00007f7cfcdba000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000006f58351b0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "Timer-2,sandbox-5107" daemon prio=10 tid=0x00007f7d49035000 nid=0x120f waiting on condition [0x00007f7cfcebb000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000006f58351b0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "TOA-Delivery-Thread-sandbox-5107" prio=10 tid=0x00007f7d49036800 nid=0x120e in Object.wait() [0x00007f7cfcfbc000]
>    java.lang.Thread.State: WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         - waiting on <0x00000006f57f83b8> (a java.util.TreeSet)
>         at java.lang.Object.wait(Object.java:503)
>         at org.jgroups.protocols.tom.DeliveryManagerImpl.getNextMessagesToDeliver(DeliveryManagerImpl.java:132)
>         - locked <0x00000006f57f83b8> (a java.util.TreeSet)
>         at org.jgroups.protocols.tom.DeliveryThread.run(DeliveryThread.java:52)
>    Locked ownable synchronizers:
>         - None
> "Timer runner-1,sandbox-5107" daemon prio=10 tid=0x00007f7d49033000 nid=0x120c runnable [0x00007f7cfd0bd000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000006f58574d0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
>         at java.util.concurrent.DelayQueue.take(DelayQueue.java:220)
>         at java.util.concurrent.DelayQueue.take(DelayQueue.java:68)
>         at org.jgroups.util.TimeScheduler3.run(TimeScheduler3.java:164)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "CuratorFramework-0" daemon prio=10 tid=0x00007f7d48d6e000 nid=0x1209 waiting on condition [0x00007f7cfd1be000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000006f5391f38> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>         at java.util.concurrent.DelayQueue.take(DelayQueue.java:209)
>         at java.util.concurrent.DelayQueue.take(DelayQueue.java:68)
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:781)
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.access$400(CuratorFrameworkImpl.java:57)
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:275)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - <0x00000006f4e2c148> (a java.util.concurrent.ThreadPoolExecutor$Worker)
> "main-EventThread" daemon prio=10 tid=0x00007f7d48d7d800 nid=0x1208 waiting on condition [0x00007f7cfd2bf000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000006f5226cc8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
>    Locked ownable synchronizers:
>         - None
> "main-SendThread(sandbox.hortonworks.com:2181)" daemon prio=10 tid=0x00007f7d48d95800 nid=0x1207 runnable [0x00007f7cfd3c0000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
>         - locked <0x00000006f522a290> (a sun.nio.ch.Util$2)
>         - locked <0x00000006f522a248> (a java.util.Collections$UnmodifiableSet)
>         - locked <0x00000006f5232a50> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
>         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
>         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    Locked ownable synchronizers:
>         - None
> "ConnectionStateManager-0" daemon prio=10 tid=0x00007f7d48d69000 nid=0x1206 waiting on condition [0x00007f7cfd4c1000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000006f4ed4da0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>         at java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:374)
>         at org.apache.curator.framework.state.ConnectionStateManager.processEvents(ConnectionStateManager.java:208)
>         at org.apache.curator.framework.state.ConnectionStateManager.access$000(ConnectionStateManager.java:42)
>         at org.apache.curator.framework.state.ConnectionStateManager$1.call(ConnectionStateManager.java:110)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - <0x00000006f4e2c1a8> (a java.util.concurrent.ThreadPoolExecutor$Worker)
> "TimeoutOutputStream Watchdog-Thread" daemon prio=10 tid=0x00007f7d00009800 nid=0x1200 waiting for monitor entry [0x00007f7cfd9db000]
>    java.lang.Thread.State: BLOCKED (on object monitor)
>         at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
>         - waiting to lock <0x00000006f51277b0> (a java.io.BufferedOutputStream)
>         at java.io.FilterOutputStream.close(FilterOutputStream.java:157)
>         at de.huxhorn.sulky.io.TimeoutOutputStream.internalClose(TimeoutOutputStream.java:185)
>         at de.huxhorn.sulky.io.TimeoutOutputStream.access$500(TimeoutOutputStream.java:42)
>         at de.huxhorn.sulky.io.TimeoutOutputStream$TimeoutRunnable.run(TimeoutOutputStream.java:226)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "SOCKET Heartbeat" daemon prio=10 tid=0x00007f7d48879800 nid=0x11fe waiting on condition [0x00007f7cfdadc000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000006f5127840> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>         at java.util.concurrent.ArrayBlockingQueue.put(ArrayBlockingQueue.java:324)
>         at de.huxhorn.lilith.sender.MultiplexSendBytesService.sendBytes(MultiplexSendBytesService.java:132)
>         at de.huxhorn.lilith.sender.HeartbeatRunnable.run(HeartbeatRunnable.java:68)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "SOCKET Dispatcher" daemon prio=10 tid=0x00007f7d48877800 nid=0x11fd waiting on condition [0x00007f7cfdbdd000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000006f4d06748> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>         at java.util.concurrent.ArrayBlockingQueue.put(ArrayBlockingQueue.java:324)
>         at de.huxhorn.lilith.sender.SimpleSendBytesService.sendBytes(SimpleSendBytesService.java:131)
>         at de.huxhorn.lilith.sender.MultiplexSendBytesService$DispatcherRunnable.run(MultiplexSendBytesService.java:152)
>         at java.lang.Thread.run(Thread.java:744)
>    Locked ownable synchronizers:
>         - None
> "Reconnection@SocketDataOutputStreamFactory[hostName=localhost, port=10000, connectionTimeout=10000, writeTimeout=5000]" daemon prio=10 tid=0x0000000000c1d800 nid=0x11fc in Object.wait() [0x00007f7cfdcde000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         - waiting on <0x00000006f4d03d58> (a java.lang.Object)
>         at de.huxhorn.lilith.sender.SimpleSendBytesService$SendBytesThread$ReconnectionThread.run(SimpleSendBytesService.java:350)
>         - locked <0x00000006f4d03d58> (a java.lang.Object)
>    Locked ownable synchronizers:
>         - None
> "SendBytes@SocketDataOutputStreamFactory[hostName=localhost, port=10000, connectionTimeout=10000, writeTimeout=5000]" daemon prio=10 tid=0x00007f7d48883000 nid=0x11fb runnable [0x00007f7cfdddf000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.SocketOutputStream.socketWrite0(Native Method)
>         at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:113)
>         at java.net.SocketOutputStream.write(SocketOutputStream.java:159)
>         at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
>         at java.io.BufferedOutputStream.write(BufferedOutputStream.java:126)
>         - locked <0x00000006f51277b0> (a java.io.BufferedOutputStream)
>         at de.huxhorn.sulky.io.TimeoutOutputStream.write(TimeoutOutputStream.java:109)
>         at java.io.DataOutputStream.write(DataOutputStream.java:107)
>         - locked <0x00000006f5127368> (a java.io.DataOutputStream)
>         at java.io.FilterOutputStream.write(FilterOutputStream.java:97)
>         at de.huxhorn.lilith.sender.MessageWriteByteStrategy.writeBytes(MessageWriteByteStrategy.java:56)
>         at de.huxhorn.lilith.sender.SimpleSendBytesService$SendBytesThread.run(SimpleSendBytesService.java:243)
>    Locked ownable synchronizers:
>         - None
> "Service Thread" daemon prio=10 tid=0x00007f7d48117000 nid=0x11f7 runnable [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>    Locked ownable synchronizers:
>         - None
> "C2 CompilerThread1" daemon prio=10 tid=0x00007f7d48114800 nid=0x11f6 waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>    Locked ownable synchronizers:
>         - None
> "C2 CompilerThread0" daemon prio=10 tid=0x00007f7d48112800 nid=0x11f5 waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>    Locked ownable synchronizers:
>         - None
> "Signal Dispatcher" daemon prio=10 tid=0x00007f7d48110000 nid=0x11f4 runnable [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>    Locked ownable synchronizers:
>         - None
> "Surrogate Locker Thread (Concurrent GC)" daemon prio=10 tid=0x00007f7d48106000 nid=0x11f3 waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>    Locked ownable synchronizers:
>         - None
> "Finalizer" daemon prio=10 tid=0x00007f7d480ef000 nid=0x11f2 in Object.wait() [0x00007f7cfef08000]
>    java.lang.Thread.State: WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         - waiting on <0x00000006f4ce5ca0> (a java.lang.ref.ReferenceQueue$Lock)
>         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)
>         - locked <0x00000006f4ce5ca0> (a java.lang.ref.ReferenceQueue$Lock)
>         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151)
>         at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:189)
>    Locked ownable synchronizers:
>         - None
> "Reference Handler" daemon prio=10 tid=0x00007f7d480eb000 nid=0x11f1 in Object.wait() [0x00007f7cff009000]
>    java.lang.Thread.State: WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         - waiting on <0x00000006f4ce5cb8> (a java.lang.ref.Reference$Lock)
>         at java.lang.Object.wait(Object.java:503)
>         at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133)
>         - locked <0x00000006f4ce5cb8> (a java.lang.ref.Reference$Lock)
>    Locked ownable synchronizers:
>         - None
> "VM Thread" prio=10 tid=0x00007f7d480e8800 nid=0x11f0 runnable
> "Gang worker#0 (Parallel GC Threads)" prio=10 tid=0x00007f7d4801f000 nid=0x11eb runnable
> "Gang worker#1 (Parallel GC Threads)" prio=10 tid=0x00007f7d48021000 nid=0x11ec runnable
> "Gang worker#2 (Parallel GC Threads)" prio=10 tid=0x00007f7d48023000 nid=0x11ed runnable
> "Gang worker#3 (Parallel GC Threads)" prio=10 tid=0x00007f7d48024800 nid=0x11ee runnable
> "Concurrent Mark-Sweep GC Thread" prio=10 tid=0x00007f7d480a5000 nid=0x11ef runnable
> "VM Periodic Task Thread" prio=10 tid=0x00007f7d48122800 nid=0x11f8 waiting on condition
> JNI global references: 356
> /opt/drill/bin/drillbit.sh: line 189:  4557 Killed                  nice -n $DRILL_NICENESS "$DRILL_HOME"/bin/runbit $command "$@" start >> "$logout" 2>&1
> log4j:WARN No appenders could be found for logger (org.jboss.logging).
> log4j:WARN Please initialize the log4j system properly.
> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
> Nov 19, 2014 9:23:44 AM org.glassfish.jersey.server.ApplicationHandler initialize
> INFO: Initiating Jersey application, version Jersey: 2.8 2014-04-29 01:25:26...
> 09:43:53.069 [aa4237ca-db2e-4fe4-b77e-5836a7189554:foreman] ERROR hive.log - Got exception: org.apache.thrift.transport.TTransportException java.net.SocketTimeoutException: Read timed out
> org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
>         at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129) ~[drill-hive-exec-shaded-0.5.0-incubating.jar:0.5.0-incubating]
>         at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84) ~[drill-hive-exec-shaded-0.5.0-incubating.jar:0.5.0-incubating]
>         at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:378) ~[drill-hive-exec-shaded-0.5.0-incubating.jar:0.5.0-incubating]
>         at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:297) ~[drill-hive-exec-shaded-0.5.0-incubating.jar:0.5.0-incubating]
>         at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:204) ~[drill-hive-exec-shaded-0.5.0-incubating.jar:0.5.0-incubating]
>         at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69) ~[drill-hive-exec-shaded-0.5.0-incubating.jar:0.5.0-incubating]
>         at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_get_all_databases(ThriftHiveMetastore.java:525) ~[hive-metastore-0.12.0.jar:0.12.0]
>         at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get_all_databases(ThriftHiveMetastore.java:513) ~[hive-metastore-0.12.0.jar:0.12.0]
>         at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getAllDatabases(HiveMetaStoreClient.java:732) ~[hive-metastore-0.12.0.jar:0.12.0]
>         at org.apache.drill.exec.store.hive.schema.HiveSchemaFactory$DatabaseLoader.load(HiveSchemaFactory.java:126) [drill-storage-hive-core-0.5.0-incubating.jar:0.5.0-incubating]
>         at org.apache.drill.exec.store.hive.schema.HiveSchemaFactory$DatabaseLoader.load(HiveSchemaFactory.java:119) [drill-storage-hive-core-0.5.0-incubating.jar:0.5.0-incubating]
>         at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3599) [guava-14.0.1.jar:na]
>         at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2379) [guava-14.0.1.jar:na]
>         at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2342) [guava-14.0.1.jar:na]
>         at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2257) [guava-14.0.1.jar:na]
>         at com.google.common.cache.LocalCache.get(LocalCache.java:4000) [guava-14.0.1.jar:na]
>         at com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4004) [guava-14.0.1.jar:na]
>         at com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4874) [guava-14.0.1.jar:na]
>         at org.apache.drill.exec.store.hive.schema.HiveSchemaFactory$HiveSchema.getSubSchema(HiveSchemaFactory.java:207) [drill-storage-hive-core-0.5.0-incubating.jar:0.5.0-incubating]
>         at org.apache.drill.exec.store.hive.schema.HiveSchemaFactory$HiveSchema.<init>(HiveSchemaFactory.java:200) [drill-storage-hive-core-0.5.0-incubating.jar:0.5.0-incubating]
>         at org.apache.drill.exec.store.hive.schema.HiveSchemaFactory.registerSchemas(HiveSchemaFactory.java:189) [drill-storage-hive-core-0.5.0-incubating.jar:0.5.0-incubating]
>         at org.apache.drill.exec.store.hive.HiveStoragePlugin.registerSchemas(HiveStoragePlugin.java:83) [drill-storage-hive-core-0.5.0-incubating.jar:0.5.0-incubating]
>         at org.apache.drill.exec.store.StoragePluginRegistry$DrillSchemaFactory.registerSchemas(StoragePluginRegistry.java:313) [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
>         at org.apache.drill.exec.ops.QueryContext.getRootSchema(QueryContext.java:90) [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
>         at org.apache.drill.exec.ops.QueryContext.getNewDefaultSchema(QueryContext.java:79) [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
>         at org.apache.drill.exec.planner.sql.DrillSqlWorker.<init>(DrillSqlWorker.java:70) [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
>         at org.apache.drill.exec.work.foreman.Foreman.runSQL(Foreman.java:420) [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
>         at org.apache.drill.exec.work.foreman.Foreman.run(Foreman.java:220) [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
>         at org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:250) [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_45]
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_45]
>         at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
> Caused by: java.net.SocketTimeoutException: Read timed out
>         at java.net.SocketInputStream.socketRead0(Native Method) ~[na:1.7.0_45]
>         at java.net.SocketInputStream.read(SocketInputStream.java:152) ~[na:1.7.0_45]
>         at java.net.SocketInputStream.read(SocketInputStream.java:122) ~[na:1.7.0_45]
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:235) ~[na:1.7.0_45]
>         at java.io.BufferedInputStream.read1(BufferedInputStream.java:275) ~[na:1.7.0_45]
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:334) ~[na:1.7.0_45]
>         at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127) ~[drill-hive-exec-shaded-0.5.0-incubating.jar:0.5.0-incubating]
>         ... 31 common frames omitted
> 09:43:53.096 [aa4237ca-db2e-4fe4-b77e-5836a7189554:foreman] ERROR hive.log - Converting exception to MetaException
> Nov 19, 2014 9:44:54 AM org.eigenbase.sql.validate.SqlValidatorException <init>
> SEVERE: org.eigenbase.sql.validate.SqlValidatorException: Table 'dfs.tmp./drill/datafiles/log_Aug.csv' not found
> Nov 19, 2014 9:44:54 AM org.eigenbase.util.EigenbaseException <init>
> SEVERE: org.eigenbase.util.EigenbaseContextException: From line 1, column 211 to line 1, column 213: Table 'dfs.tmp./drill/datafiles/log_Aug.csv' not found
> Nov 19, 2014 9:45:52 AM org.eigenbase.sql.validate.SqlValidatorException <init>
> SEVERE: org.eigenbase.sql.validate.SqlValidatorException: Table '/drill/datafiles/log_Aug.csv' not found
> Nov 19, 2014 9:45:52 AM org.eigenbase.util.EigenbaseException <init>
> SEVERE: org.eigenbase.util.EigenbaseContextException: From line 1, column 211 to line 1, column 240: Table '/drill/datafiles/log_Aug.csv' not found
> /opt/drill/bin/drillbit.sh: line 189:  5389 Killed                  nice -n $DRILL_NICENESS "$DRILL_HOME"/bin/runbit $command "$@" start >> "$logout" 2>&1
> log4j:WARN No appenders could be found for logger (org.jboss.logging).
> log4j:WARN Please initialize the log4j system properly.
> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
> Nov 19, 2014 9:57:45 AM org.glassfish.jersey.server.ApplicationHandler initialize
> INFO: Initiating Jersey application, version Jersey: 2.8 2014-04-29 01:25:26...
> 10:01:11.095 [7d1da985-3ac3-48e3-9253-8bb971a2a9c7:foreman] ERROR hive.log - Got exception: org.apache.thrift.transport.TTransportException java.net.SocketTimeoutException: Read timed out
> org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
>         at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129) ~[drill-hive-exec-shaded-0.5.0-incubating.jar:0.5.0-incubating]
>         at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84) ~[drill-hive-exec-shaded-0.5.0-incubating.jar:0.5.0-incubating]
>         at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:378) ~[drill-hive-exec-shaded-0.5.0-incubating.jar:0.5.0-incubating]
>         at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:297) ~[drill-hive-exec-shaded-0.5.0-incubating.jar:0.5.0-incubating]
>         at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:204) ~[drill-hive-exec-shaded-0.5.0-incubating.jar:0.5.0-incubating]
>         at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69) ~[drill-hive-exec-shaded-0.5.0-incubating.jar:0.5.0-incubating]
>         at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_get_all_databases(ThriftHiveMetastore.java:525) ~[hive-metastore-0.12.0.jar:0.12.0]
>         at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get_all_databases(ThriftHiveMetastore.java:513) ~[hive-metastore-0.12.0.jar:0.12.0]
>         at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getAllDatabases(HiveMetaStoreClient.java:732) ~[hive-metastore-0.12.0.jar:0.12.0]
>         at org.apache.drill.exec.store.hive.schema.HiveSchemaFactory$DatabaseLoader.load(HiveSchemaFactory.java:126) [drill-storage-hive-core-0.5.0-incubating.jar:0.5.0-incubating]
>         at org.apache.drill.exec.store.hive.schema.HiveSchemaFactory$DatabaseLoader.load(HiveSchemaFactory.java:119) [drill-storage-hive-core-0.5.0-incubating.jar:0.5.0-incubating]
>         at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3599) [guava-14.0.1.jar:na]
>         at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2379) [guava-14.0.1.jar:na]
>         at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2342) [guava-14.0.1.jar:na]
>         at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2257) [guava-14.0.1.jar:na]
>         at com.google.common.cache.LocalCache.get(LocalCache.java:4000) [guava-14.0.1.jar:na]
>         at com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4004) [guava-14.0.1.jar:na]
>         at com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4874) [guava-14.0.1.jar:na]
>         at org.apache.drill.exec.store.hive.schema.HiveSchemaFactory$HiveSchema.getSubSchema(HiveSchemaFactory.java:207) [drill-storage-hive-core-0.5.0-incubating.jar:0.5.0-incubating]
>         at org.apache.drill.exec.store.hive.schema.HiveSchemaFactory$HiveSchema.<init>(HiveSchemaFactory.java:200) [drill-storage-hive-core-0.5.0-incubating.jar:0.5.0-incubating]
>         at org.apache.drill.exec.store.hive.schema.HiveSchemaFactory.registerSchemas(HiveSchemaFactory.java:189) [drill-storage-hive-core-0.5.0-incubating.jar:0.5.0-incubating]
>         at org.apache.drill.exec.store.hive.HiveStoragePlugin.registerSchemas(HiveStoragePlugin.java:83) [drill-storage-hive-core-0.5.0-incubating.jar:0.5.0-incubating]
>         at org.apache.drill.exec.store.StoragePluginRegistry$DrillSchemaFactory.registerSchemas(StoragePluginRegistry.java:313) [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
>         at org.apache.drill.exec.ops.QueryContext.getRootSchema(QueryContext.java:90) [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
>         at org.apache.drill.exec.ops.QueryContext.getNewDefaultSchema(QueryContext.java:79) [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
>         at org.apache.drill.exec.planner.sql.DrillSqlWorker.<init>(DrillSqlWorker.java:70) [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
>         at org.apache.drill.exec.work.foreman.Foreman.runSQL(Foreman.java:420) [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
>         at org.apache.drill.exec.work.foreman.Foreman.run(Foreman.java:220) [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
>         at org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:250) [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_45]
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_45]
>         at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
> Caused by: java.net.SocketTimeoutException: Read timed out
>         at java.net.SocketInputStream.socketRead0(Native Method) ~[na:1.7.0_45]
>         at java.net.SocketInputStream.read(SocketInputStream.java:152) ~[na:1.7.0_45]
>         at java.net.SocketInputStream.read(SocketInputStream.java:122) ~[na:1.7.0_45]
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:235) ~[na:1.7.0_45]
>         at java.io.BufferedInputStream.read1(BufferedInputStream.java:275) ~[na:1.7.0_45]
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:334) ~[na:1.7.0_45]
>         at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127) ~[drill-hive-exec-shaded-0.5.0-incubating.jar:0.5.0-incubating]
>         ... 31 common frames omitted
> 10:01:11.110 [7d1da985-3ac3-48e3-9253-8bb971a2a9c7:foreman] ERROR hive.log - Converting exception to MetaException
> Nov 19, 2014 10:02:39 AM org.eigenbase.sql.validate.SqlValidatorException <init>
> SEVERE: org.eigenbase.sql.validate.SqlValidatorException: Table 'dfs.tmp./drill/datafiles/log_Aug.csv' not found
> Nov 19, 2014 10:02:39 AM org.eigenbase.util.EigenbaseException <init>
> SEVERE: org.eigenbase.util.EigenbaseContextException: From line 1, column 211 to line 1, column 213: Table 'dfs.tmp./drill/datafiles/log_Aug.csv' not found
> /opt/drill/bin/drillbit.sh: line 189:  6447 Killed                  nice -n $DRILL_NICENESS "$DRILL_HOME"/bin/runbit $command "$@" start >> "$logout" 2>&1
> log4j:WARN No appenders could be found for logger (org.jboss.logging).
> log4j:WARN Please initialize the log4j system properly.
> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
> Nov 19, 2014 10:21:09 AM org.glassfish.jersey.server.ApplicationHandler initialize
> INFO: Initiating Jersey application, version Jersey: 2.8 2014-04-29 01:25:26...
> 11:08:56.646 [CuratorFramework-0] ERROR org.apache.curator.ConnectionState - Connection timed out for connection string (master:2181) and timeout (5000) / elapsed (30973)
> org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss
>         at org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:198) [curator-client-2.5.0.jar:na]
>         at org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:88) [curator-client-2.5.0.jar:na]
>         at org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:115) [curator-client-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:807) [curator-framework-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:793) [curator-framework-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.access$400(CuratorFrameworkImpl.java:57) [curator-framework-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:275) [curator-framework-2.5.0.jar:na]
>         at java.util.concurrent.FutureTask.run(FutureTask.java:262) [na:1.7.0_45]
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_45]
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_45]
>         at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
> 11:08:58.001 [CuratorFramework-0] ERROR org.apache.curator.ConnectionState - Connection timed out for connection string (master:2181) and timeout (5000) / elapsed (33033)
> org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss
>         at org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:198) [curator-client-2.5.0.jar:na]
>         at org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:88) [curator-client-2.5.0.jar:na]
>         at org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:115) [curator-client-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:807) [curator-framework-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:793) [curator-framework-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.access$400(CuratorFrameworkImpl.java:57) [curator-framework-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:275) [curator-framework-2.5.0.jar:na]
>         at java.util.concurrent.FutureTask.run(FutureTask.java:262) [na:1.7.0_45]
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_45]
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_45]
>         at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
> 11:08:58.962 [CuratorFramework-0] ERROR org.apache.curator.ConnectionState - Connection timed out for connection string (master:2181) and timeout (5000) / elapsed (34015)
> org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss
>         at org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:198) [curator-client-2.5.0.jar:na]
>         at org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:88) [curator-client-2.5.0.jar:na]
>         at org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:115) [curator-client-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:807) [curator-framework-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:793) [curator-framework-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.access$400(CuratorFrameworkImpl.java:57) [curator-framework-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:275) [curator-framework-2.5.0.jar:na]
>         at java.util.concurrent.FutureTask.run(FutureTask.java:262) [na:1.7.0_45]
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_45]
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_45]
>         at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
> 11:09:00.296 [CuratorFramework-0] ERROR org.apache.curator.ConnectionState - Connection timed out for connection string (master:2181) and timeout (5000) / elapsed (35016)
> org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss
>         at org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:198) [curator-client-2.5.0.jar:na]
>         at org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:88) [curator-client-2.5.0.jar:na]
>         at org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:115) [curator-client-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:807) [curator-framework-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:793) [curator-framework-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.access$400(CuratorFrameworkImpl.java:57) [curator-framework-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:275) [curator-framework-2.5.0.jar:na]
>         at java.util.concurrent.FutureTask.run(FutureTask.java:262) [na:1.7.0_45]
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_45]
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_45]
>         at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
> 11:09:00.942 [CuratorFramework-0] ERROR org.apache.curator.ConnectionState - Connection timed out for connection string (master:2181) and timeout (5000) / elapsed (35872)
> org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss
>         at org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:198) [curator-client-2.5.0.jar:na]
>         at org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:88) [curator-client-2.5.0.jar:na]
>         at org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:115) [curator-client-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:807) [curator-framework-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:793) [curator-framework-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.access$400(CuratorFrameworkImpl.java:57) [curator-framework-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:275) [curator-framework-2.5.0.jar:na]
>         at java.util.concurrent.FutureTask.run(FutureTask.java:262) [na:1.7.0_45]
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_45]
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_45]
>         at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
> 11:09:01.487 [CuratorFramework-0] ERROR org.apache.curator.ConnectionState - Connection timed out for connection string (master:2181) and timeout (5000) / elapsed (36541)
> org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss
>         at org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:198) [curator-client-2.5.0.jar:na]
>         at org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:88) [curator-client-2.5.0.jar:na]
>         at org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:115) [curator-client-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:807) [curator-framework-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:793) [curator-framework-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.access$400(CuratorFrameworkImpl.java:57) [curator-framework-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:275) [curator-framework-2.5.0.jar:na]
>         at java.util.concurrent.FutureTask.run(FutureTask.java:262) [na:1.7.0_45]
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_45]
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_45]
>         at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
> 11:09:01.990 [CuratorFramework-0] ERROR org.apache.curator.ConnectionState - Connection timed out for connection string (master:2181) and timeout (5000) / elapsed (37043)
> org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss
>         at org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:198) [curator-client-2.5.0.jar:na]
>         at org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:88) [curator-client-2.5.0.jar:na]
>         at org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:115) [curator-client-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:807) [curator-framework-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:793) [curator-framework-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.access$400(CuratorFrameworkImpl.java:57) [curator-framework-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:275) [curator-framework-2.5.0.jar:na]
>         at java.util.concurrent.FutureTask.run(FutureTask.java:262) [na:1.7.0_45]
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_45]
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_45]
>         at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
> 11:09:02.493 [CuratorFramework-0] ERROR org.apache.curator.ConnectionState - Connection timed out for connection string (master:2181) and timeout (5000) / elapsed (37546)
> org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss
>         at org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:198) [curator-client-2.5.0.jar:na]
>         at org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:88) [curator-client-2.5.0.jar:na]
>         at org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:115) [curator-client-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:807) [curator-framework-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:793) [curator-framework-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.access$400(CuratorFrameworkImpl.java:57) [curator-framework-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:275) [curator-framework-2.5.0.jar:na]
>         at java.util.concurrent.FutureTask.run(FutureTask.java:262) [na:1.7.0_45]
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_45]
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_45]
>         at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
> 11:09:03.049 [CuratorFramework-0] ERROR org.apache.curator.ConnectionState - Connection timed out for connection string (master:2181) and timeout (5000) / elapsed (38101)
> org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss
>         at org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:198) [curator-client-2.5.0.jar:na]
>         at org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:88) [curator-client-2.5.0.jar:na]
>         at org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:115) [curator-client-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:807) [curator-framework-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:793) [curator-framework-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.access$400(CuratorFrameworkImpl.java:57) [curator-framework-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:275) [curator-framework-2.5.0.jar:na]
>         at java.util.concurrent.FutureTask.run(FutureTask.java:262) [na:1.7.0_45]
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_45]
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_45]
>         at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
> 11:09:03.611 [CuratorFramework-0] ERROR org.apache.curator.ConnectionState - Connection timed out for connection string (master:2181) and timeout (5000) / elapsed (38604)
> org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss
>         at org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:198) [curator-client-2.5.0.jar:na]
>         at org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:88) [curator-client-2.5.0.jar:na]
>         at org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:115) [curator-client-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:807) [curator-framework-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:793) [curator-framework-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.access$400(CuratorFrameworkImpl.java:57) [curator-framework-2.5.0.jar:na]
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:275) [curator-framework-2.5.0.jar:na]
>         at java.util.concurrent.FutureTask.run(FutureTask.java:262) [na:1.7.0_45]
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_45]
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_45]
>         at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
> 12:12:15.754 [Thread-4] ERROR org.apache.hadoop.hdfs.DFSClient - Failed to close file /tmp/nasadata/1_0_0.csv
> java.io.IOException: Failed to replace a bad datanode on the existing pipeline due to no more good datanodes being available to try. (Nodes: current=[192.168.152.143:50010], original=[192.168.152.143:50010]). The current failed datanode replacement policy is DEFAULT, and a client may configure this via 'dfs.client.block.write.replace-datanode-on-failure.policy' in its configuration.
>         at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.findNewDatanode(DFSOutputStream.java:960) ~[hadoop-hdfs-2.4.1.jar:na]
>         at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.addDatanode2ExistingPipeline(DFSOutputStream.java:1026) ~[hadoop-hdfs-2.4.1.jar:na]
>         at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1175) ~[hadoop-hdfs-2.4.1.jar:na]
>         at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.processDatanodeError(DFSOutputStream.java:924) ~[hadoop-hdfs-2.4.1.jar:na]
>         at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:486) ~[hadoop-hdfs-2.4.1.jar:na]
> /opt/drill/bin/drillbit.sh: line 189:  7265 Killed                  nice -n $DRILL_NICENESS "$DRILL_HOME"/bin/runbit $command "$@" start >> "$logout" 2>&1
> log4j:WARN No appenders could be found for logger (org.jboss.logging).
> log4j:WARN Please initialize the log4j system properly.
> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
> Nov 19, 2014 12:17:14 PM org.glassfish.jersey.server.ApplicationHandler initialize
> INFO: Initiating Jersey application, version Jersey: 2.8 2014-04-29 01:25:26...
> My drillbit.log log (last 100 lines) after I queried the CTAS command above:
> [root@sandbox /]# tail -n 100  /opt/drill/log/drillbit.log
> 2014-11-19 12:35:11,103 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200000
> 2014-11-19 12:35:11,123 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 777038
> 2014-11-19 12:35:11,130 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 777632
> 2014-11-19 12:35:11,135 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200065
> 2014-11-19 12:35:11,175 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 778997
> 2014-11-19 12:35:11,197 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 779560
> 2014-11-19 12:35:11,201 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200017
> 2014-11-19 12:35:11,214 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 780925
> 2014-11-19 12:35:11,232 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 781458
> 2014-11-19 12:35:11,237 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200075
> 2014-11-19 12:35:11,251 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 782823
> 2014-11-19 12:35:11,264 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 783413
> 2014-11-19 12:35:11,272 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200079
> 2014-11-19 12:35:11,287 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 784778
> 2014-11-19 12:35:11,292 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 785347
> 2014-11-19 12:35:11,297 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200038
> 2014-11-19 12:35:11,306 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 786705
> 2014-11-19 12:35:11,311 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 787310
> 2014-11-19 12:35:11,933 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200058
> 2014-11-19 12:35:12,020 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 788675
> 2014-11-19 12:35:12,026 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 789250
> 2014-11-19 12:35:12,032 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200117
> 2014-11-19 12:35:12,043 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 790615
> 2014-11-19 12:35:12,048 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 791202
> 2014-11-19 12:35:12,052 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200020
> 2014-11-19 12:35:12,060 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 792567
> 2014-11-19 12:35:12,065 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 793167
> 2014-11-19 12:35:12,069 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200089
> 2014-11-19 12:35:12,077 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 794532
> 2014-11-19 12:35:12,083 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 795117
> 2014-11-19 12:35:12,087 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200016
> 2014-11-19 12:35:12,096 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 796482
> 2014-11-19 12:35:12,100 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 797072
> 2014-11-19 12:35:12,684 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200070
> 2014-11-19 12:35:12,692 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 798437
> 2014-11-19 12:35:12,697 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 799021
> 2014-11-19 12:35:12,705 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200032
> 2014-11-19 12:35:12,713 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 800386
> 2014-11-19 12:35:12,718 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 800997
> 2014-11-19 12:35:12,723 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200007
> 2014-11-19 12:35:12,730 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 802362
> 2014-11-19 12:35:12,735 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 802970
> 2014-11-19 12:35:12,741 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200090
> 2014-11-19 12:35:12,749 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 804332
> 2014-11-19 12:35:12,754 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 804900
> 2014-11-19 12:35:12,758 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200043
> 2014-11-19 12:35:12,767 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 806265
> 2014-11-19 12:35:12,775 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 806821
> 2014-11-19 12:35:12,780 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200082
> 2014-11-19 12:35:12,791 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 808186
> 2014-11-19 12:35:12,796 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 808749
> 2014-11-19 12:35:12,802 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200042
> 2014-11-19 12:35:12,812 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 810114
> 2014-11-19 12:35:12,819 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 810708
> 2014-11-19 12:35:12,825 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200029
> 2014-11-19 12:35:12,836 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 812073
> 2014-11-19 12:35:12,842 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 812666
> 2014-11-19 12:35:12,863 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200018
> 2014-11-19 12:35:12,874 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 814031
> 2014-11-19 12:35:12,878 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 814614
> 2014-11-19 12:35:12,884 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200085
> 2014-11-19 12:35:12,923 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 815979
> 2014-11-19 12:35:13,022 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 816544
> 2014-11-19 12:35:13,027 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200083
> 2014-11-19 12:35:13,160 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 817909
> 2014-11-19 12:35:13,236 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 818504
> 2014-11-19 12:35:13,241 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200060
> 2014-11-19 12:35:13,299 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 819869
> 2014-11-19 12:35:18,355 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 820466
> 2014-11-19 12:35:18,360 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200022
> 2014-11-19 12:35:17,411 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:1] DEBUG o.a.d.e.s.text.DrillTextRecordWriter - closing file
> 2014-11-19 12:35:18,368 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 821831
> 2014-11-19 12:35:18,372 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 822478
> 2014-11-19 12:35:18,377 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200062
> 2014-11-19 12:35:18,436 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 823843
> 2014-11-19 12:35:18,699 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 824492
> 2014-11-19 12:35:18,703 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200047
> 2014-11-19 12:35:18,711 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 825857
> 2014-11-19 12:35:18,750 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 826504
> 2014-11-19 12:35:18,755 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200053
> 2014-11-19 12:35:18,774 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 827869
> 2014-11-19 12:35:18,783 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 828499
> 2014-11-19 12:35:18,789 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200022
> 2014-11-19 12:35:18,797 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 829864
> 2014-11-19 12:35:18,802 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 830518
> 2014-11-19 12:35:18,806 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200089
> 2014-11-19 12:35:18,814 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 831883
> 2014-11-19 12:35:18,819 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 832531
> 2014-11-19 12:35:18,824 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200042
> 2014-11-19 12:35:19,047 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 833896
> 2014-11-19 12:35:19,055 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 834513
> 2014-11-19 12:35:19,062 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200027
> 2014-11-19 12:35:19,077 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 835878
> 2014-11-19 12:35:19,084 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 836542
> 2014-11-19 12:35:19,089 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200039
> 2014-11-19 12:35:19,411 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 837907
> 2014-11-19 12:35:19,415 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 838568
> 2014-11-19 12:35:19,420 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200062
> 2014-11-19 12:35:20,241 [WorkManager Event Thread] DEBUG o.apache.drill.exec.work.WorkManager - Starting pending task org.apache.drill.exec.work.WorkManager$RunnableWrapper@1f95fd5a
> 2014-11-19 12:35:20,243 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:1] DEBUG o.a.drill.exec.ops.OperatorContext - Closing context for org.apache.drill.exec.physical.config.SingleSender
> The last 500 lines of sqlline.log
> [root@sandbox /]# tail -n 500  /opt/drill/log/sqlline.log
>       mode: OPTIONAL
>     }
>     name_part {
>       type: NAME
>       name: "summary"
>     }
>     value_count: 1
>     var_byte_length: 35
>     buffer_length: 44
>   }
>   carries_two_byte_selection_vector: false
> }
> , data=DrillBuf(ridx: 0, widx: 45, cap: 45/45, unwrapped: DrillBuf(ridx: 134, widx: 134, cap: 134/134, unwrapped: UnsafeDirectLittleEndian(PooledUnsafeDirectByteBuf(ridx: 0, widx: 0, cap: 134/134))))]
> 2014-11-19 09:44:13,492 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
>   part1: -6178314394398732316
>   part2: -5224641525948312236
> }
> is_last_chunk: true
> row_count: 0
> def {
> }
> , data=null]
> 2014-11-19 09:44:52,419 [Client-1] DEBUG o.a.d.e.rpc.user.QueryResultHandler - Received QueryId part1: 5305604006993543794
> part2: -4691027028283251311
>  succesfully.  Adding listener org.apache.drill.jdbc.DrillResultSet$Listener@1f84b826
> 2014-11-19 09:44:55,037 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
>   part1: 5305604006993543794
>   part2: -4691027028283251311
> }
> is_last_chunk: false
> row_count: 1
> def {
>   record_count: 1
>   field {
>     major_type {
>       minor_type: BIT
>       mode: REQUIRED
>     }
>     name_part {
>       type: NAME
>       name: "ok"
>     }
>     value_count: 1
>     buffer_length: 1
>   }
>   field {
>     major_type {
>       minor_type: VARCHAR
>       mode: OPTIONAL
>     }
>     name_part {
>       type: NAME
>       name: "summary"
>     }
>     value_count: 1
>     var_byte_length: 154
>     buffer_length: 163
>   }
>   carries_two_byte_selection_vector: false
> }
> , data=DrillBuf(ridx: 0, widx: 164, cap: 164/164, unwrapped: DrillBuf(ridx: 256, widx: 256, cap: 256/256, unwrapped: UnsafeDirectLittleEndian(PooledUnsafeDirectByteBuf(ridx: 0, widx: 0, cap: 256/256))))]
> 2014-11-19 09:44:55,182 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
>   part1: 5305604006993543794
>   part2: -4691027028283251311
> }
> is_last_chunk: true
> row_count: 0
> def {
> }
> , data=null]
> 2014-11-19 09:45:48,470 [Client-1] DEBUG o.a.d.e.rpc.user.QueryResultHandler - Received QueryId part1: -4704022649256656017
> part2: -6152847041478674731
>  succesfully.  Adding listener org.apache.drill.jdbc.DrillResultSet$Listener@397cec35
> 2014-11-19 09:45:53,020 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
>   part1: -4704022649256656017
>   part2: -6152847041478674731
> }
> is_last_chunk: false
> row_count: 1
> def {
>   record_count: 1
>   field {
>     major_type {
>       minor_type: BIT
>       mode: REQUIRED
>     }
>     name_part {
>       type: NAME
>       name: "ok"
>     }
>     value_count: 1
>     buffer_length: 1
>   }
>   field {
>     major_type {
>       minor_type: VARCHAR
>       mode: OPTIONAL
>     }
>     name_part {
>       type: NAME
>       name: "summary"
>     }
>     value_count: 1
>     var_byte_length: 146
>     buffer_length: 155
>   }
>   carries_two_byte_selection_vector: false
> }
> , data=DrillBuf(ridx: 0, widx: 156, cap: 156/156, unwrapped: DrillBuf(ridx: 248, widx: 248, cap: 248/248, unwrapped: UnsafeDirectLittleEndian(PooledUnsafeDirectByteBuf(ridx: 0, widx: 0, cap: 248/248))))]
> 2014-11-19 09:45:53,034 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
>   part1: -4704022649256656017
>   part2: -6152847041478674731
> }
> is_last_chunk: true
> row_count: 0
> def {
> }
> , data=null]
> 2014-11-19 09:46:09,718 [Client-1] DEBUG o.a.d.e.rpc.user.QueryResultHandler - Received QueryId part1: 5597752468244350252
> part2: -7052779758698764261
>  succesfully.  Adding listener org.apache.drill.jdbc.DrillResultSet$Listener@6c49743c
> 2014-11-19 09:58:57,569 [main] DEBUG o.a.drill.common.config.DrillConfig - Loading configs at the following URLs [jar:file:/opt/drill/jars/drill-storage-hbase-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-hive-exec-shaded-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-java-exec-0.5.0-incubating-rebuffed.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-storage-hive-core-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-common-0.5.0-incubating-rebuffed.jar!/drill-module.conf]
> 2014-11-19 09:59:03,441 [main] DEBUG o.a.drill.common.config.DrillConfig - Loading configs at the following URLs [jar:file:/opt/drill/jars/drill-storage-hbase-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-hive-exec-shaded-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-java-exec-0.5.0-incubating-rebuffed.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-storage-hive-core-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-common-0.5.0-incubating-rebuffed.jar!/drill-module.conf]
> 2014-11-19 09:59:20,409 [main] DEBUG o.a.d.c.l.data.LogicalOperatorBase - Adding Logical Operator sub types: [class org.apache.drill.common.logical.data.RunningAggregate, class org.apache.drill.common.logical.data.Filter, class org.apache.drill.common.logical.data.Constant, class org.apache.drill.common.logical.data.Join, class org.apache.drill.common.logical.data.Order, class org.apache.drill.common.logical.data.Limit, class org.apache.drill.common.logical.data.Union, class org.apache.drill.common.logical.data.GroupingAggregate, class org.apache.drill.common.logical.data.Project, class org.apache.drill.common.logical.data.Store, class org.apache.drill.common.logical.data.Sequence, class org.apache.drill.common.logical.data.Writer, class org.apache.drill.common.logical.data.Scan, class org.apache.drill.common.logical.data.Flatten, class org.apache.drill.common.logical.data.Transform, class org.apache.drill.common.logical.data.WindowFrame]
> 2014-11-19 09:59:20,728 [main] DEBUG o.a.d.c.l.StoragePluginConfigBase - Adding Storage Engine Configs including [class org.apache.drill.exec.store.dfs.FileSystemConfig, class org.apache.drill.exec.store.hive.HiveStoragePluginConfig, class org.apache.drill.exec.store.dfs.FileSystemFormatConfig, class org.apache.drill.exec.store.sys.SystemTablePluginConfig, class org.apache.drill.exec.store.hbase.HBaseStoragePluginConfig, class org.apache.drill.exec.store.NamedStoragePluginConfig, class org.apache.drill.exec.store.ischema.InfoSchemaConfig, class org.apache.drill.exec.store.mock.MockStorageEngineConfig]
> 2014-11-19 09:59:20,747 [main] DEBUG o.a.d.c.l.FormatPluginConfigBase - Adding Format Plugin Configs including [class org.apache.drill.exec.store.parquet.ParquetFormatConfig, class org.apache.drill.exec.store.dfs.NamedFormatPluginConfig, class org.apache.drill.exec.store.easy.json.JSONFormatPlugin$JSONFormatConfig, class org.apache.drill.exec.store.easy.text.TextFormatPlugin$TextFormatConfig]
> 2014-11-19 09:59:20,835 [main] DEBUG o.a.d.e.c.zk.ZKClusterCoordinator - Connect master:2181, zkRoot drill, clusterId: mydrillcluster_1
> 2014-11-19 09:59:23,068 [main] DEBUG o.a.d.e.c.zk.ZKClusterCoordinator - Starting ZKClusterCoordination.
> 2014-11-19 09:59:24,828 [main] DEBUG o.a.drill.exec.client.DrillClient - Connecting to server sandbox.hortonworks.com:31010
> 2014-11-19 10:00:38,173 [Client-1] DEBUG o.a.d.e.rpc.user.QueryResultHandler - Received QueryId part1: 9015548418747222243
> part2: -7902819292513392185
>  succesfully.  Adding listener org.apache.drill.jdbc.DrillResultSet$Listener@60cd886a
> 2014-11-19 10:01:34,121 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
>   part1: 9015548418747222243
>   part2: -7902819292513392185
> }
> is_last_chunk: false
> row_count: 1
> def {
>   record_count: 1
>   field {
>     major_type {
>       minor_type: BIT
>       mode: REQUIRED
>     }
>     name_part {
>       type: NAME
>       name: "ok"
>     }
>     value_count: 1
>     buffer_length: 1
>   }
>   field {
>     major_type {
>       minor_type: VARCHAR
>       mode: OPTIONAL
>     }
>     name_part {
>       type: NAME
>       name: "summary"
>     }
>     value_count: 1
>     var_byte_length: 111
>     buffer_length: 120
>   }
>   carries_two_byte_selection_vector: false
> }
> , data=DrillBuf(ridx: 0, widx: 121, cap: 121/121, unwrapped: DrillBuf(ridx: 210, widx: 210, cap: 210/210, unwrapped: UnsafeDirectLittleEndian(PooledUnsafeDirectByteBuf(ridx: 0, widx: 0, cap: 210/210))))]
> 2014-11-19 10:01:34,194 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
>   part1: 9015548418747222243
>   part2: -7902819292513392185
> }
> is_last_chunk: true
> row_count: 0
> def {
> }
> , data=null]
> 2014-11-19 10:02:37,473 [Client-1] DEBUG o.a.d.e.rpc.user.QueryResultHandler - Received QueryId part1: -4276429314455944130
> part2: -5105296223301485661
>  succesfully.  Adding listener org.apache.drill.jdbc.DrillResultSet$Listener@6ada317
> 2014-11-19 10:02:40,023 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
>   part1: -4276429314455944130
>   part2: -5105296223301485661
> }
> is_last_chunk: false
> row_count: 1
> def {
>   record_count: 1
>   field {
>     major_type {
>       minor_type: BIT
>       mode: REQUIRED
>     }
>     name_part {
>       type: NAME
>       name: "ok"
>     }
>     value_count: 1
>     buffer_length: 1
>   }
>   field {
>     major_type {
>       minor_type: VARCHAR
>       mode: OPTIONAL
>     }
>     name_part {
>       type: NAME
>       name: "summary"
>     }
>     value_count: 1
>     var_byte_length: 154
>     buffer_length: 163
>   }
>   carries_two_byte_selection_vector: false
> }
> , data=DrillBuf(ridx: 0, widx: 164, cap: 164/164, unwrapped: DrillBuf(ridx: 256, widx: 256, cap: 256/256, unwrapped: UnsafeDirectLittleEndian(PooledUnsafeDirectByteBuf(ridx: 0, widx: 0, cap: 256/256))))]
> 2014-11-19 10:02:40,065 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
>   part1: -4276429314455944130
>   part2: -5105296223301485661
> }
> is_last_chunk: true
> row_count: 0
> def {
> }
> , data=null]
> 2014-11-19 10:02:50,650 [Client-1] DEBUG o.a.d.e.rpc.user.QueryResultHandler - Received QueryId part1: 3008993818340312151
> part2: -6521594594521895198
>  succesfully.  Adding listener org.apache.drill.jdbc.DrillResultSet$Listener@7e82c636
> 2014-11-19 10:02:50,968 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
>   part1: 3008993818340312151
>   part2: -6521594594521895198
> }
> is_last_chunk: false
> row_count: 1
> def {
>   record_count: 1
>   field {
>     major_type {
>       minor_type: BIT
>       mode: REQUIRED
>     }
>     name_part {
>       type: NAME
>       name: "ok"
>     }
>     value_count: 1
>     buffer_length: 1
>   }
>   field {
>     major_type {
>       minor_type: VARCHAR
>       mode: OPTIONAL
>     }
>     name_part {
>       type: NAME
>       name: "summary"
>     }
>     value_count: 1
>     var_byte_length: 35
>     buffer_length: 44
>   }
>   carries_two_byte_selection_vector: false
> }
> , data=DrillBuf(ridx: 0, widx: 45, cap: 45/45, unwrapped: DrillBuf(ridx: 134, widx: 134, cap: 134/134, unwrapped: UnsafeDirectLittleEndian(PooledUnsafeDirectByteBuf(ridx: 0, widx: 0, cap: 134/134))))]
> 2014-11-19 10:02:50,978 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
>   part1: 3008993818340312151
>   part2: -6521594594521895198
> }
> is_last_chunk: true
> row_count: 0
> def {
> }
> , data=null]
> 2014-11-19 10:02:59,844 [Client-1] DEBUG o.a.d.e.rpc.user.QueryResultHandler - Received QueryId part1: 7398639825816144341
> part2: -6396148652452939646
>  succesfully.  Adding listener org.apache.drill.jdbc.DrillResultSet$Listener@16cde937
> 2014-11-19 10:03:07,895 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
>   part1: 7398639825816144341
>   part2: -6396148652452939646
> }
> is_last_chunk: false
> row_count: 1
> def {
>   record_count: 1
>   field {
>     major_type {
>       minor_type: BIT
>       mode: REQUIRED
>     }
>     name_part {
>       type: NAME
>       name: "ok"
>     }
>     value_count: 1
>     buffer_length: 1
>   }
>   field {
>     major_type {
>       minor_type: VARCHAR
>       mode: OPTIONAL
>     }
>     name_part {
>       type: NAME
>       name: "summary"
>     }
>     value_count: 1
>     var_byte_length: 32
>     buffer_length: 41
>   }
>   carries_two_byte_selection_vector: false
> }
> , data=DrillBuf(ridx: 0, widx: 42, cap: 42/42, unwrapped: DrillBuf(ridx: 131, widx: 131, cap: 131/131, unwrapped: UnsafeDirectLittleEndian(PooledUnsafeDirectByteBuf(ridx: 0, widx: 0, cap: 131/131))))]
> 2014-11-19 10:03:07,945 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
>   part1: 7398639825816144341
>   part2: -6396148652452939646
> }
> is_last_chunk: true
> row_count: 0
> def {
> }
> , data=null]
> 2014-11-19 10:04:45,239 [Client-1] DEBUG o.a.d.e.rpc.user.QueryResultHandler - Received QueryId part1: 5860477397739652325
> part2: -5393944332054804316
>  succesfully.  Adding listener org.apache.drill.jdbc.DrillResultSet$Listener@7c2ab5da
> 2014-11-19 10:22:06,144 [main] DEBUG o.a.drill.common.config.DrillConfig - Loading configs at the following URLs [jar:file:/opt/drill/jars/drill-storage-hbase-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-hive-exec-shaded-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-java-exec-0.5.0-incubating-rebuffed.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-storage-hive-core-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-common-0.5.0-incubating-rebuffed.jar!/drill-module.conf]
> 2014-11-19 10:22:13,182 [main] DEBUG o.a.drill.common.config.DrillConfig - Loading configs at the following URLs [jar:file:/opt/drill/jars/drill-storage-hbase-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-hive-exec-shaded-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-java-exec-0.5.0-incubating-rebuffed.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-storage-hive-core-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-common-0.5.0-incubating-rebuffed.jar!/drill-module.conf]
> 2014-11-19 10:22:54,222 [main] DEBUG o.a.d.c.l.data.LogicalOperatorBase - Adding Logical Operator sub types: [class org.apache.drill.common.logical.data.Join, class org.apache.drill.common.logical.data.Limit, class org.apache.drill.common.logical.data.Filter, class org.apache.drill.common.logical.data.Transform, class org.apache.drill.common.logical.data.Scan, class org.apache.drill.common.logical.data.Order, class org.apache.drill.common.logical.data.Writer, class org.apache.drill.common.logical.data.Sequence, class org.apache.drill.common.logical.data.Flatten, class org.apache.drill.common.logical.data.Union, class org.apache.drill.common.logical.data.GroupingAggregate, class org.apache.drill.common.logical.data.Project, class org.apache.drill.common.logical.data.RunningAggregate, class org.apache.drill.common.logical.data.WindowFrame, class org.apache.drill.common.logical.data.Store, class org.apache.drill.common.logical.data.Constant]
> 2014-11-19 10:22:54,349 [main] DEBUG o.a.d.c.l.StoragePluginConfigBase - Adding Storage Engine Configs including [class org.apache.drill.exec.store.mock.MockStorageEngineConfig, class org.apache.drill.exec.store.NamedStoragePluginConfig, class org.apache.drill.exec.store.hbase.HBaseStoragePluginConfig, class org.apache.drill.exec.store.dfs.FileSystemConfig, class org.apache.drill.exec.store.ischema.InfoSchemaConfig, class org.apache.drill.exec.store.dfs.FileSystemFormatConfig, class org.apache.drill.exec.store.hive.HiveStoragePluginConfig, class org.apache.drill.exec.store.sys.SystemTablePluginConfig]
> 2014-11-19 10:22:54,357 [main] DEBUG o.a.d.c.l.FormatPluginConfigBase - Adding Format Plugin Configs including [class org.apache.drill.exec.store.parquet.ParquetFormatConfig, class org.apache.drill.exec.store.dfs.NamedFormatPluginConfig, class org.apache.drill.exec.store.easy.json.JSONFormatPlugin$JSONFormatConfig, class org.apache.drill.exec.store.easy.text.TextFormatPlugin$TextFormatConfig]
> 2014-11-19 10:22:55,110 [main] DEBUG o.a.d.e.c.zk.ZKClusterCoordinator - Connect master:2181, zkRoot drill, clusterId: mydrillcluster_1
> 2014-11-19 10:23:03,543 [main] DEBUG o.a.d.e.c.zk.ZKClusterCoordinator - Starting ZKClusterCoordination.
> 2014-11-19 10:23:07,458 [main] DEBUG o.a.drill.exec.client.DrillClient - Connecting to server sandbox.hortonworks.com:31010
> 2014-11-19 10:23:41,462 [Client-1] DEBUG o.a.d.e.rpc.user.QueryResultHandler - Received QueryId part1: 3858814417780293762
> part2: -5472977680643858892
>  succesfully.  Adding listener org.apache.drill.jdbc.DrillResultSet$Listener@3c2b05bf
> 2014-11-19 10:23:46,393 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
>   part1: 3858814417780293762
>   part2: -5472977680643858892
> }
> is_last_chunk: false
> row_count: 1
> def {
>   record_count: 1
>   field {
>     major_type {
>       minor_type: BIT
>       mode: REQUIRED
>     }
>     name_part {
>       type: NAME
>       name: "ok"
>     }
>     value_count: 1
>     buffer_length: 1
>   }
>   field {
>     major_type {
>       minor_type: VARCHAR
>       mode: OPTIONAL
>     }
>     name_part {
>       type: NAME
>       name: "summary"
>     }
>     value_count: 1
>     var_byte_length: 35
>     buffer_length: 44
>   }
>   carries_two_byte_selection_vector: false
> }
> , data=DrillBuf(ridx: 0, widx: 45, cap: 45/45, unwrapped: DrillBuf(ridx: 134, widx: 134, cap: 134/134, unwrapped: UnsafeDirectLittleEndian(PooledUnsafeDirectByteBuf(ridx: 0, widx: 0, cap: 134/134))))]
> 2014-11-19 10:23:46,406 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
>   part1: 3858814417780293762
>   part2: -5472977680643858892
> }
> is_last_chunk: true
> row_count: 0
> def {
> }
> , data=null]
> 2014-11-19 10:23:52,412 [Client-1] DEBUG o.a.d.e.rpc.user.QueryResultHandler - Received QueryId part1: 2202511821636718132
> part2: -7017803918036951922
>  succesfully.  Adding listener org.apache.drill.jdbc.DrillResultSet$Listener@71268d7e
> 2014-11-19 10:51:23,211 [ServiceCache-0] DEBUG o.a.d.e.c.zk.ZKClusterCoordinator - Cache changed, updating.
> 2014-11-19 10:51:24,665 [ServiceCache-0] DEBUG o.a.d.e.c.zk.ZKClusterCoordinator - Cache changed, updating.
> 2014-11-19 11:57:02,571 [main] DEBUG o.a.drill.common.config.DrillConfig - Loading configs at the following URLs [jar:file:/opt/drill/jars/drill-storage-hbase-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-hive-exec-shaded-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-java-exec-0.5.0-incubating-rebuffed.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-storage-hive-core-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-common-0.5.0-incubating-rebuffed.jar!/drill-module.conf]
> 2014-11-19 11:57:14,838 [main] DEBUG o.a.drill.common.config.DrillConfig - Loading configs at the following URLs [jar:file:/opt/drill/jars/drill-storage-hbase-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-hive-exec-shaded-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-java-exec-0.5.0-incubating-rebuffed.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-storage-hive-core-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-common-0.5.0-incubating-rebuffed.jar!/drill-module.conf]
> 2014-11-19 11:57:46,477 [main] DEBUG o.a.d.c.l.data.LogicalOperatorBase - Adding Logical Operator sub types: [class org.apache.drill.common.logical.data.RunningAggregate, class org.apache.drill.common.logical.data.Join, class org.apache.drill.common.logical.data.Union, class org.apache.drill.common.logical.data.GroupingAggregate, class org.apache.drill.common.logical.data.Scan, class org.apache.drill.common.logical.data.Project, class org.apache.drill.common.logical.data.Store, class org.apache.drill.common.logical.data.Sequence, class org.apache.drill.common.logical.data.Filter, class org.apache.drill.common.logical.data.Flatten, class org.apache.drill.common.logical.data.Order, class org.apache.drill.common.logical.data.Writer, class org.apache.drill.common.logical.data.Limit, class org.apache.drill.common.logical.data.Constant, class org.apache.drill.common.logical.data.WindowFrame, class org.apache.drill.common.logical.data.Transform]
> 2014-11-19 11:57:46,488 [main] DEBUG o.a.d.c.l.StoragePluginConfigBase - Adding Storage Engine Configs including [class org.apache.drill.exec.store.sys.SystemTablePluginConfig, class org.apache.drill.exec.store.NamedStoragePluginConfig, class org.apache.drill.exec.store.ischema.InfoSchemaConfig, class org.apache.drill.exec.store.mock.MockStorageEngineConfig, class org.apache.drill.exec.store.dfs.FileSystemConfig, class org.apache.drill.exec.store.hbase.HBaseStoragePluginConfig, class org.apache.drill.exec.store.hive.HiveStoragePluginConfig, class org.apache.drill.exec.store.dfs.FileSystemFormatConfig]
> 2014-11-19 11:57:46,510 [main] DEBUG o.a.d.c.l.FormatPluginConfigBase - Adding Format Plugin Configs including [class org.apache.drill.exec.store.easy.text.TextFormatPlugin$TextFormatConfig, class org.apache.drill.exec.store.dfs.NamedFormatPluginConfig, class org.apache.drill.exec.store.easy.json.JSONFormatPlugin$JSONFormatConfig, class org.apache.drill.exec.store.parquet.ParquetFormatConfig]
> 2014-11-19 11:57:46,555 [main] DEBUG o.a.d.e.c.zk.ZKClusterCoordinator - Connect master:2181, zkRoot drill, clusterId: mydrillcluster_1
> 2014-11-19 11:57:50,810 [main] DEBUG o.a.d.e.c.zk.ZKClusterCoordinator - Starting ZKClusterCoordination.
> 2014-11-19 11:57:51,971 [main] DEBUG o.a.drill.exec.client.DrillClient - Connecting to server sandbox.hortonworks.com:31010
> 2014-11-19 12:29:41,958 [main] DEBUG o.a.drill.common.config.DrillConfig - Loading configs at the following URLs [jar:file:/opt/drill/jars/drill-storage-hbase-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-hive-exec-shaded-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-java-exec-0.5.0-incubating-rebuffed.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-storage-hive-core-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-common-0.5.0-incubating-rebuffed.jar!/drill-module.conf]
> 2014-11-19 12:29:51,819 [main] DEBUG o.a.drill.common.config.DrillConfig - Loading configs at the following URLs [jar:file:/opt/drill/jars/drill-storage-hbase-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-hive-exec-shaded-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-java-exec-0.5.0-incubating-rebuffed.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-storage-hive-core-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-common-0.5.0-incubating-rebuffed.jar!/drill-module.conf]
> 2014-11-19 12:30:25,381 [main] DEBUG o.a.d.c.l.data.LogicalOperatorBase - Adding Logical Operator sub types: [class org.apache.drill.common.logical.data.Limit, class org.apache.drill.common.logical.data.Transform, class org.apache.drill.common.logical.data.Order, class org.apache.drill.common.logical.data.Writer, class org.apache.drill.common.logical.data.GroupingAggregate, class org.apache.drill.common.logical.data.Flatten, class org.apache.drill.common.logical.data.Sequence, class org.apache.drill.common.logical.data.Scan, class org.apache.drill.common.logical.data.WindowFrame, class org.apache.drill.common.logical.data.Constant, class org.apache.drill.common.logical.data.Join, class org.apache.drill.common.logical.data.Store, class org.apache.drill.common.logical.data.Project, class org.apache.drill.common.logical.data.Filter, class org.apache.drill.common.logical.data.Union, class org.apache.drill.common.logical.data.RunningAggregate]
> 2014-11-19 12:30:25,740 [main] DEBUG o.a.d.c.l.StoragePluginConfigBase - Adding Storage Engine Configs including [class org.apache.drill.exec.store.sys.SystemTablePluginConfig, class org.apache.drill.exec.store.mock.MockStorageEngineConfig, class org.apache.drill.exec.store.hive.HiveStoragePluginConfig, class org.apache.drill.exec.store.dfs.FileSystemFormatConfig, class org.apache.drill.exec.store.dfs.FileSystemConfig, class org.apache.drill.exec.store.hbase.HBaseStoragePluginConfig, class org.apache.drill.exec.store.NamedStoragePluginConfig, class org.apache.drill.exec.store.ischema.InfoSchemaConfig]
> 2014-11-19 12:30:25,780 [main] DEBUG o.a.d.c.l.FormatPluginConfigBase - Adding Format Plugin Configs including [class org.apache.drill.exec.store.easy.text.TextFormatPlugin$TextFormatConfig, class org.apache.drill.exec.store.dfs.NamedFormatPluginConfig, class org.apache.drill.exec.store.easy.json.JSONFormatPlugin$JSONFormatConfig, class org.apache.drill.exec.store.parquet.ParquetFormatConfig]
> 2014-11-19 12:30:25,893 [main] DEBUG o.a.d.e.c.zk.ZKClusterCoordinator - Connect master:2181, zkRoot drill, clusterId: mydrillcluster_1
> 2014-11-19 12:30:32,206 [main] DEBUG o.a.d.e.c.zk.ZKClusterCoordinator - Starting ZKClusterCoordination.
> 2014-11-19 12:30:34,663 [main] DEBUG o.a.drill.exec.client.DrillClient - Connecting to server sandbox.hortonworks.com:31010
> 2014-11-19 12:30:52,215 [Client-1] DEBUG o.a.d.e.rpc.user.QueryResultHandler - Received QueryId part1: 7634595741619538955
> part2: -5887474601922138781
>  succesfully.  Adding listener org.apache.drill.jdbc.DrillResultSet$Listener@8def7d1
> 2014-11-19 12:30:57,832 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
>   part1: 7634595741619538955
>   part2: -5887474601922138781
> }
> is_last_chunk: false
> row_count: 1
> def {
>   record_count: 1
>   field {
>     major_type {
>       minor_type: BIT
>       mode: REQUIRED
>     }
>     name_part {
>       type: NAME
>       name: "ok"
>     }
>     value_count: 1
>     buffer_length: 1
>   }
>   field {
>     major_type {
>       minor_type: VARCHAR
>       mode: OPTIONAL
>     }
>     name_part {
>       type: NAME
>       name: "summary"
>     }
>     value_count: 1
>     var_byte_length: 35
>     buffer_length: 44
>   }
>   carries_two_byte_selection_vector: false
> }
> , data=DrillBuf(ridx: 0, widx: 45, cap: 45/45, unwrapped: DrillBuf(ridx: 134, widx: 134, cap: 134/134, unwrapped: UnsafeDirectLittleEndian(PooledUnsafeDirectByteBuf(ridx: 0, widx: 0, cap: 134/134))))]
> 2014-11-19 12:30:57,859 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
>   part1: 7634595741619538955
>   part2: -5887474601922138781
> }
> is_last_chunk: true
> row_count: 0
> def {
> }
> , data=null]
> 2014-11-19 12:31:15,115 [Client-1] DEBUG o.a.d.e.rpc.user.QueryResultHandler - Received QueryId part1: -6192947750506705109
> part2: -9120915659300383702
>  succesfully.  Adding listener org.apache.drill.jdbc.DrillResultSet$Listener@5a7c8e16
> 2014-11-19 12:31:34,433 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
>   part1: -6192947750506705109
>   part2: -9120915659300383702
> }
> is_last_chunk: false
> row_count: 1
> def {
>   record_count: 1
>   field {
>     major_type {
>       minor_type: BIT
>       mode: REQUIRED
>     }
>     name_part {
>       type: NAME
>       name: "ok"
>     }
>     value_count: 1
>     buffer_length: 1
>   }
>   field {
>     major_type {
>       minor_type: VARCHAR
>       mode: OPTIONAL
>     }
>     name_part {
>       type: NAME
>       name: "summary"
>     }
>     value_count: 1
>     var_byte_length: 32
>     buffer_length: 41
>   }
>   carries_two_byte_selection_vector: false
> }
> , data=DrillBuf(ridx: 0, widx: 42, cap: 42/42, unwrapped: DrillBuf(ridx: 131, widx: 131, cap: 131/131, unwrapped: UnsafeDirectLittleEndian(PooledUnsafeDirectByteBuf(ridx: 0, widx: 0, cap: 131/131))))]
> 2014-11-19 12:31:34,446 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
>   part1: -6192947750506705109
>   part2: -9120915659300383702
> }
> is_last_chunk: true
> row_count: 0
> def {
> }
> , data=null]
> 2014-11-19 12:32:41,665 [Client-1] DEBUG o.a.d.e.rpc.user.QueryResultHandler - Received QueryId part1: 8289276123845381119
> part2: -8951682992832168109
>  succesfully.  Adding listener org.apache.drill.jdbc.DrillResultSet$Listener@5bccea81
> During the whole process, while I copied out the log files, the query was stopped, crashed, and I didn't get any answer from it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)