You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@drill.apache.org by lapro1 <la...@gmail.com> on 2014/11/18 18:11:25 UTC
Drill stops immediately
Hi,
My drill does the following problem, and it's quite disturbing, because it
stops my job, and I have to wait for it for really long time.
Sometimes, if I create a table, or I'd like to query something, it stops
without any answer. I have to restart drillbit, but also this is very slow.
For example it takes about 15-20 minutes for.
[root@sandbox ~]# /opt/drill/bin/drillbit.sh stop
Drill log directory /var/log/drill does not exist, defaulting to
/opt/drill/log
stopping drillbit
.......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................force
stopping drillbit with kill -9 10790
[root@sandbox ~]#
I use drill over hadoop with only one datanode, because I'm a test user,
and my computer would be very slowly with more virtual machines. Is it
possible, that this couses the problem?
Last, when it stopped I gave it the command below:
0: jdbc:drill:zk=master:2181> create table nasadata(host, datetime,
request, response1, response2) as select columns[0] AS `host`, columns[1]
AS `datetime`, columns[2] AS `request`, columns[3] AS `response1`,
columns[4] AS `response2` from dfs.`/drill/datafiles/log_Aug.csv`;
Thanks the answer in advance.
Laszlo
Re: Drill stops immediately
Posted by lapro1 <la...@gmail.com>.
Hi,
I'm inserting the last 50 lines of sqlline.log too. Perhaps it will be also
useful.
[root@sandbox log]# tail -n 50 sqlline.log
part2: -8842558773217337207
succesfully. Adding listener
org.apache.drill.jdbc.DrillResultSet$Listener@65db3720
2014-11-19 07:51:14,541 [Client-1] DEBUG
org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch
[header=query_id {
part1: 8873970806716385765
part2: -8842558773217337207
}
is_last_chunk: false
row_count: 1
def {
record_count: 1
field {
major_type {
minor_type: BIT
mode: REQUIRED
}
name_part {
type: NAME
name: "ok"
}
value_count: 1
buffer_length: 1
}
field {
major_type {
minor_type: VARCHAR
mode: OPTIONAL
}
name_part {
type: NAME
name: "summary"
}
value_count: 1
var_byte_length: 35
buffer_length: 44
}
carries_two_byte_selection_vector: false
}
, data=DrillBuf(ridx: 0, widx: 45, cap: 45/45, unwrapped: DrillBuf(ridx:
134, widx: 134, cap: 134/134, unwrapped:
UnsafeDirectLittleEndian(PooledUnsafeDirectByteBuf(ridx: 0, widx: 0, cap:
134/134))))]
2014-11-19 07:51:14,561 [Client-1] DEBUG
org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch
[header=query_id {
part1: 8873970806716385765
part2: -8842558773217337207
}
is_last_chunk: true
row_count: 0
def {
}
, data=null]
2014-11-19 07:51:32,932 [Client-1] DEBUG
o.a.d.e.rpc.user.QueryResultHandler - Received QueryId part1:
6508139447934274830
part2: -6649699990212739558
succesfully. Adding listener
org.apache.drill.jdbc.DrillResultSet$Listener@5bccea81
Thanks, Laszlo
2014-11-19 17:02 GMT+01:00 lapro1 <la...@gmail.com>:
> Hi,
> I gave the table create command to it again, which was written in my prior
> letter.
> It stopped again.
> Here is the last 50 lines of drillbit.log, please help me to find the
> problem :)
>
> [root@sandbox log]# tail -n 50 drillbit.log
> 2014-11-19 07:52:07,538 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
> 852683
> 2014-11-19 07:52:07,543 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200047
> 2014-11-19 07:52:07,552 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
> 854048
> 2014-11-19 07:52:07,557 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
> 854680
> 2014-11-19 07:52:07,562 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200082
> 2014-11-19 07:52:07,572 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
> 856045
> 2014-11-19 07:52:07,577 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
> 856680
> 2014-11-19 07:52:07,583 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200000
> 2014-11-19 07:52:07,593 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
> 858045
> 2014-11-19 07:52:07,598 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
> 858666
> 2014-11-19 07:52:07,605 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200076
> 2014-11-19 07:52:07,614 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
> 860031
> 2014-11-19 07:52:07,621 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
> 860622
> 2014-11-19 07:52:07,626 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200085
> 2014-11-19 07:52:07,637 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
> 861987
> 2014-11-19 07:52:07,643 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
> 862588
> 2014-11-19 07:52:07,649 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200041
> 2014-11-19 07:52:07,657 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
> 863953
> 2014-11-19 07:52:07,662 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
> 864570
> 2014-11-19 07:52:08,411 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:0:0]
> DEBUG o.a.d.e.compile.JaninoClassCompiler - Compiling (source size=617 B):
> 1:
> 2: package org.apache.drill.exec.test.generated;
> 3:
> 4: import org.apache.drill.exec.exception.SchemaChangeException;
> 5: import org.apache.drill.exec.ops.FragmentContext;
> 6: import org.apache.drill.exec.record.RecordBatch;
> 7:
> 8: public class ProjectorGen2 {
> 9:
> 10:
> 11: public boolean doEval(int inIndex, int outIndex)
> 12: throws SchemaChangeException
> 13: {
> 14: {
> 15: return true;
> 16: }
> 17: }
> 18:
> 19: public void doSetup(FragmentContext context, RecordBatch
> incoming, RecordBatch outgoing)
> 20: throws SchemaChangeException
> 21: {
> 22: }
> 23:
> 24: public void __DRILL_INIT__()
> 25: throws SchemaChangeException
> 26: {
> 27: }
> 28:
> 29: }
>
>
> Thanks in advance,
> Laszlo
>
>
>
> 2014-11-18 20:44 GMT+01:00 Timothy Chen <tn...@gmail.com>:
>
>> What does the log says when the drillbit stops?
>>
>> Tim
>>
>> On Tue, Nov 18, 2014 at 9:11 AM, lapro1 <la...@gmail.com> wrote:
>> > Hi,
>> > My drill does the following problem, and it's quite disturbing, because
>> it
>> > stops my job, and I have to wait for it for really long time.
>> > Sometimes, if I create a table, or I'd like to query something, it stops
>> > without any answer. I have to restart drillbit, but also this is very
>> slow.
>> > For example it takes about 15-20 minutes for.
>> >
>> > [root@sandbox ~]# /opt/drill/bin/drillbit.sh stop
>> > Drill log directory /var/log/drill does not exist, defaulting to
>> > /opt/drill/log
>> > stopping drillbit
>> >
>> .......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................force
>> > stopping drillbit with kill -9 10790
>> > [root@sandbox ~]#
>> >
>> >
>> > I use drill over hadoop with only one datanode, because I'm a test user,
>> > and my computer would be very slowly with more virtual machines. Is it
>> > possible, that this couses the problem?
>> >
>> > Last, when it stopped I gave it the command below:
>> > 0: jdbc:drill:zk=master:2181> create table nasadata(host, datetime,
>> > request, response1, response2) as select columns[0] AS `host`,
>> columns[1]
>> > AS `datetime`, columns[2] AS `request`, columns[3] AS `response1`,
>> > columns[4] AS `response2` from dfs.`/drill/datafiles/log_Aug.csv`;
>> >
>> > Thanks the answer in advance.
>> > Laszlo
>>
>
>
Re: Drill stops immediately
Posted by lapro1 <la...@gmail.com>.
Hi,
I'm inserting the last 50 lines of sqlline.log too. Perhaps it will be also
useful.
[root@sandbox log]# tail -n 50 sqlline.log
part2: -8842558773217337207
succesfully. Adding listener
org.apache.drill.jdbc.DrillResultSet$Listener@65db3720
2014-11-19 07:51:14,541 [Client-1] DEBUG
org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch
[header=query_id {
part1: 8873970806716385765
part2: -8842558773217337207
}
is_last_chunk: false
row_count: 1
def {
record_count: 1
field {
major_type {
minor_type: BIT
mode: REQUIRED
}
name_part {
type: NAME
name: "ok"
}
value_count: 1
buffer_length: 1
}
field {
major_type {
minor_type: VARCHAR
mode: OPTIONAL
}
name_part {
type: NAME
name: "summary"
}
value_count: 1
var_byte_length: 35
buffer_length: 44
}
carries_two_byte_selection_vector: false
}
, data=DrillBuf(ridx: 0, widx: 45, cap: 45/45, unwrapped: DrillBuf(ridx:
134, widx: 134, cap: 134/134, unwrapped:
UnsafeDirectLittleEndian(PooledUnsafeDirectByteBuf(ridx: 0, widx: 0, cap:
134/134))))]
2014-11-19 07:51:14,561 [Client-1] DEBUG
org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch
[header=query_id {
part1: 8873970806716385765
part2: -8842558773217337207
}
is_last_chunk: true
row_count: 0
def {
}
, data=null]
2014-11-19 07:51:32,932 [Client-1] DEBUG
o.a.d.e.rpc.user.QueryResultHandler - Received QueryId part1:
6508139447934274830
part2: -6649699990212739558
succesfully. Adding listener
org.apache.drill.jdbc.DrillResultSet$Listener@5bccea81
Thanks, Laszlo
2014-11-19 17:02 GMT+01:00 lapro1 <la...@gmail.com>:
> Hi,
> I gave the table create command to it again, which was written in my prior
> letter.
> It stopped again.
> Here is the last 50 lines of drillbit.log, please help me to find the
> problem :)
>
> [root@sandbox log]# tail -n 50 drillbit.log
> 2014-11-19 07:52:07,538 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
> 852683
> 2014-11-19 07:52:07,543 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200047
> 2014-11-19 07:52:07,552 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
> 854048
> 2014-11-19 07:52:07,557 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
> 854680
> 2014-11-19 07:52:07,562 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200082
> 2014-11-19 07:52:07,572 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
> 856045
> 2014-11-19 07:52:07,577 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
> 856680
> 2014-11-19 07:52:07,583 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200000
> 2014-11-19 07:52:07,593 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
> 858045
> 2014-11-19 07:52:07,598 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
> 858666
> 2014-11-19 07:52:07,605 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200076
> 2014-11-19 07:52:07,614 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
> 860031
> 2014-11-19 07:52:07,621 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
> 860622
> 2014-11-19 07:52:07,626 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200085
> 2014-11-19 07:52:07,637 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
> 861987
> 2014-11-19 07:52:07,643 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
> 862588
> 2014-11-19 07:52:07,649 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200041
> 2014-11-19 07:52:07,657 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
> 863953
> 2014-11-19 07:52:07,662 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
> DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
> 864570
> 2014-11-19 07:52:08,411 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:0:0]
> DEBUG o.a.d.e.compile.JaninoClassCompiler - Compiling (source size=617 B):
> 1:
> 2: package org.apache.drill.exec.test.generated;
> 3:
> 4: import org.apache.drill.exec.exception.SchemaChangeException;
> 5: import org.apache.drill.exec.ops.FragmentContext;
> 6: import org.apache.drill.exec.record.RecordBatch;
> 7:
> 8: public class ProjectorGen2 {
> 9:
> 10:
> 11: public boolean doEval(int inIndex, int outIndex)
> 12: throws SchemaChangeException
> 13: {
> 14: {
> 15: return true;
> 16: }
> 17: }
> 18:
> 19: public void doSetup(FragmentContext context, RecordBatch
> incoming, RecordBatch outgoing)
> 20: throws SchemaChangeException
> 21: {
> 22: }
> 23:
> 24: public void __DRILL_INIT__()
> 25: throws SchemaChangeException
> 26: {
> 27: }
> 28:
> 29: }
>
>
> Thanks in advance,
> Laszlo
>
>
>
> 2014-11-18 20:44 GMT+01:00 Timothy Chen <tn...@gmail.com>:
>
>> What does the log says when the drillbit stops?
>>
>> Tim
>>
>> On Tue, Nov 18, 2014 at 9:11 AM, lapro1 <la...@gmail.com> wrote:
>> > Hi,
>> > My drill does the following problem, and it's quite disturbing, because
>> it
>> > stops my job, and I have to wait for it for really long time.
>> > Sometimes, if I create a table, or I'd like to query something, it stops
>> > without any answer. I have to restart drillbit, but also this is very
>> slow.
>> > For example it takes about 15-20 minutes for.
>> >
>> > [root@sandbox ~]# /opt/drill/bin/drillbit.sh stop
>> > Drill log directory /var/log/drill does not exist, defaulting to
>> > /opt/drill/log
>> > stopping drillbit
>> >
>> .......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................force
>> > stopping drillbit with kill -9 10790
>> > [root@sandbox ~]#
>> >
>> >
>> > I use drill over hadoop with only one datanode, because I'm a test user,
>> > and my computer would be very slowly with more virtual machines. Is it
>> > possible, that this couses the problem?
>> >
>> > Last, when it stopped I gave it the command below:
>> > 0: jdbc:drill:zk=master:2181> create table nasadata(host, datetime,
>> > request, response1, response2) as select columns[0] AS `host`,
>> columns[1]
>> > AS `datetime`, columns[2] AS `request`, columns[3] AS `response1`,
>> > columns[4] AS `response2` from dfs.`/drill/datafiles/log_Aug.csv`;
>> >
>> > Thanks the answer in advance.
>> > Laszlo
>>
>
>
Re: Drill stops immediately
Posted by lapro1 <la...@gmail.com>.
Hi,
I gave the table create command to it again, which was written in my prior
letter.
It stopped again.
Here is the last 50 lines of drillbit.log, please help me to find the
problem :)
[root@sandbox log]# tail -n 50 drillbit.log
2014-11-19 07:52:07,538 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
852683
2014-11-19 07:52:07,543 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200047
2014-11-19 07:52:07,552 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
854048
2014-11-19 07:52:07,557 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
854680
2014-11-19 07:52:07,562 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200082
2014-11-19 07:52:07,572 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
856045
2014-11-19 07:52:07,577 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
856680
2014-11-19 07:52:07,583 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200000
2014-11-19 07:52:07,593 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
858045
2014-11-19 07:52:07,598 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
858666
2014-11-19 07:52:07,605 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200076
2014-11-19 07:52:07,614 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
860031
2014-11-19 07:52:07,621 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
860622
2014-11-19 07:52:07,626 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200085
2014-11-19 07:52:07,637 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
861987
2014-11-19 07:52:07,643 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
862588
2014-11-19 07:52:07,649 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200041
2014-11-19 07:52:07,657 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
863953
2014-11-19 07:52:07,662 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
864570
2014-11-19 07:52:08,411 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:0:0]
DEBUG o.a.d.e.compile.JaninoClassCompiler - Compiling (source size=617 B):
1:
2: package org.apache.drill.exec.test.generated;
3:
4: import org.apache.drill.exec.exception.SchemaChangeException;
5: import org.apache.drill.exec.ops.FragmentContext;
6: import org.apache.drill.exec.record.RecordBatch;
7:
8: public class ProjectorGen2 {
9:
10:
11: public boolean doEval(int inIndex, int outIndex)
12: throws SchemaChangeException
13: {
14: {
15: return true;
16: }
17: }
18:
19: public void doSetup(FragmentContext context, RecordBatch
incoming, RecordBatch outgoing)
20: throws SchemaChangeException
21: {
22: }
23:
24: public void __DRILL_INIT__()
25: throws SchemaChangeException
26: {
27: }
28:
29: }
Thanks in advance,
Laszlo
2014-11-18 20:44 GMT+01:00 Timothy Chen <tn...@gmail.com>:
> What does the log says when the drillbit stops?
>
> Tim
>
> On Tue, Nov 18, 2014 at 9:11 AM, lapro1 <la...@gmail.com> wrote:
> > Hi,
> > My drill does the following problem, and it's quite disturbing, because
> it
> > stops my job, and I have to wait for it for really long time.
> > Sometimes, if I create a table, or I'd like to query something, it stops
> > without any answer. I have to restart drillbit, but also this is very
> slow.
> > For example it takes about 15-20 minutes for.
> >
> > [root@sandbox ~]# /opt/drill/bin/drillbit.sh stop
> > Drill log directory /var/log/drill does not exist, defaulting to
> > /opt/drill/log
> > stopping drillbit
> >
> .......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................force
> > stopping drillbit with kill -9 10790
> > [root@sandbox ~]#
> >
> >
> > I use drill over hadoop with only one datanode, because I'm a test user,
> > and my computer would be very slowly with more virtual machines. Is it
> > possible, that this couses the problem?
> >
> > Last, when it stopped I gave it the command below:
> > 0: jdbc:drill:zk=master:2181> create table nasadata(host, datetime,
> > request, response1, response2) as select columns[0] AS `host`, columns[1]
> > AS `datetime`, columns[2] AS `request`, columns[3] AS `response1`,
> > columns[4] AS `response2` from dfs.`/drill/datafiles/log_Aug.csv`;
> >
> > Thanks the answer in advance.
> > Laszlo
>
Re: Drill stops immediately
Posted by lapro1 <la...@gmail.com>.
Hi,
I gave the table create command to it again, which was written in my prior
letter.
It stopped again.
Here is the last 50 lines of drillbit.log, please help me to find the
problem :)
[root@sandbox log]# tail -n 50 drillbit.log
2014-11-19 07:52:07,538 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
852683
2014-11-19 07:52:07,543 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200047
2014-11-19 07:52:07,552 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
854048
2014-11-19 07:52:07,557 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
854680
2014-11-19 07:52:07,562 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200082
2014-11-19 07:52:07,572 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
856045
2014-11-19 07:52:07,577 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
856680
2014-11-19 07:52:07,583 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200000
2014-11-19 07:52:07,593 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
858045
2014-11-19 07:52:07,598 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
858666
2014-11-19 07:52:07,605 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200076
2014-11-19 07:52:07,614 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
860031
2014-11-19 07:52:07,621 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
860622
2014-11-19 07:52:07,626 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200085
2014-11-19 07:52:07,637 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
861987
2014-11-19 07:52:07,643 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
862588
2014-11-19 07:52:07,649 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200041
2014-11-19 07:52:07,657 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
863953
2014-11-19 07:52:07,662 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
864570
2014-11-19 07:52:08,411 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:0:0]
DEBUG o.a.d.e.compile.JaninoClassCompiler - Compiling (source size=617 B):
1:
2: package org.apache.drill.exec.test.generated;
3:
4: import org.apache.drill.exec.exception.SchemaChangeException;
5: import org.apache.drill.exec.ops.FragmentContext;
6: import org.apache.drill.exec.record.RecordBatch;
7:
8: public class ProjectorGen2 {
9:
10:
11: public boolean doEval(int inIndex, int outIndex)
12: throws SchemaChangeException
13: {
14: {
15: return true;
16: }
17: }
18:
19: public void doSetup(FragmentContext context, RecordBatch
incoming, RecordBatch outgoing)
20: throws SchemaChangeException
21: {
22: }
23:
24: public void __DRILL_INIT__()
25: throws SchemaChangeException
26: {
27: }
28:
29: }
Thanks in advance,
Laszlo
2014-11-18 20:44 GMT+01:00 Timothy Chen <tn...@gmail.com>:
> What does the log says when the drillbit stops?
>
> Tim
>
> On Tue, Nov 18, 2014 at 9:11 AM, lapro1 <la...@gmail.com> wrote:
> > Hi,
> > My drill does the following problem, and it's quite disturbing, because
> it
> > stops my job, and I have to wait for it for really long time.
> > Sometimes, if I create a table, or I'd like to query something, it stops
> > without any answer. I have to restart drillbit, but also this is very
> slow.
> > For example it takes about 15-20 minutes for.
> >
> > [root@sandbox ~]# /opt/drill/bin/drillbit.sh stop
> > Drill log directory /var/log/drill does not exist, defaulting to
> > /opt/drill/log
> > stopping drillbit
> >
> .......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................force
> > stopping drillbit with kill -9 10790
> > [root@sandbox ~]#
> >
> >
> > I use drill over hadoop with only one datanode, because I'm a test user,
> > and my computer would be very slowly with more virtual machines. Is it
> > possible, that this couses the problem?
> >
> > Last, when it stopped I gave it the command below:
> > 0: jdbc:drill:zk=master:2181> create table nasadata(host, datetime,
> > request, response1, response2) as select columns[0] AS `host`, columns[1]
> > AS `datetime`, columns[2] AS `request`, columns[3] AS `response1`,
> > columns[4] AS `response2` from dfs.`/drill/datafiles/log_Aug.csv`;
> >
> > Thanks the answer in advance.
> > Laszlo
>
Re: Drill stops immediately
Posted by Timothy Chen <tn...@gmail.com>.
What does the log says when the drillbit stops?
Tim
On Tue, Nov 18, 2014 at 9:11 AM, lapro1 <la...@gmail.com> wrote:
> Hi,
> My drill does the following problem, and it's quite disturbing, because it
> stops my job, and I have to wait for it for really long time.
> Sometimes, if I create a table, or I'd like to query something, it stops
> without any answer. I have to restart drillbit, but also this is very slow.
> For example it takes about 15-20 minutes for.
>
> [root@sandbox ~]# /opt/drill/bin/drillbit.sh stop
> Drill log directory /var/log/drill does not exist, defaulting to
> /opt/drill/log
> stopping drillbit
> .......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................force
> stopping drillbit with kill -9 10790
> [root@sandbox ~]#
>
>
> I use drill over hadoop with only one datanode, because I'm a test user,
> and my computer would be very slowly with more virtual machines. Is it
> possible, that this couses the problem?
>
> Last, when it stopped I gave it the command below:
> 0: jdbc:drill:zk=master:2181> create table nasadata(host, datetime,
> request, response1, response2) as select columns[0] AS `host`, columns[1]
> AS `datetime`, columns[2] AS `request`, columns[3] AS `response1`,
> columns[4] AS `response2` from dfs.`/drill/datafiles/log_Aug.csv`;
>
> Thanks the answer in advance.
> Laszlo
Re: Drill stops immediately
Posted by Timothy Chen <tn...@gmail.com>.
What does the log says when the drillbit stops?
Tim
On Tue, Nov 18, 2014 at 9:11 AM, lapro1 <la...@gmail.com> wrote:
> Hi,
> My drill does the following problem, and it's quite disturbing, because it
> stops my job, and I have to wait for it for really long time.
> Sometimes, if I create a table, or I'd like to query something, it stops
> without any answer. I have to restart drillbit, but also this is very slow.
> For example it takes about 15-20 minutes for.
>
> [root@sandbox ~]# /opt/drill/bin/drillbit.sh stop
> Drill log directory /var/log/drill does not exist, defaulting to
> /opt/drill/log
> stopping drillbit
> .......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................force
> stopping drillbit with kill -9 10790
> [root@sandbox ~]#
>
>
> I use drill over hadoop with only one datanode, because I'm a test user,
> and my computer would be very slowly with more virtual machines. Is it
> possible, that this couses the problem?
>
> Last, when it stopped I gave it the command below:
> 0: jdbc:drill:zk=master:2181> create table nasadata(host, datetime,
> request, response1, response2) as select columns[0] AS `host`, columns[1]
> AS `datetime`, columns[2] AS `request`, columns[3] AS `response1`,
> columns[4] AS `response2` from dfs.`/drill/datafiles/log_Aug.csv`;
>
> Thanks the answer in advance.
> Laszlo