You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by Copperfield <xw...@gmail.com> on 2017/01/16 06:34:08 UTC
Streaming Build Timestamp parse error
When i use timestamp as partition col, it occurs exception as follow:
java.text.ParseException: Unparseable date: "1484236798000" does not match
(\p{Nd}++)\Q-\E(\p{Nd}++)\Q-\E(\p{Nd}++)\Q
\E(\p{Nd}++)\Q:\E(\p{Nd}++)\Q:\E(\p{Nd}++)
my kylin version is 1.6.0
--
View this message in context: http://apache-kylin.74782.x6.nabble.com/Streaming-Build-Timestamp-parse-error-tp6952.html
Sent from the Apache Kylin mailing list archive at Nabble.com.
Re: Streaming Build Timestamp parse error
Posted by Mario Copperfield <xw...@gmail.com>.
I write a demo that used 1484236798000 as String in the following picture like process in Kylin code
it always has this exception.
I think it has to be changed to Class Times
tamp in java.sql.Timestamp
On 20 Jan 2017, 16:17 +0800, Mario Copperfield <xw...@gmail.com>, wrote:
> you mean that if i use 1484236798 rather than 1484236798000?
>
>
> On 20 Jan 2017, 16:03 +0800, ShaoFeng Shi <sh...@apache.org>, wrote:
> > I think you would prefer to write SQL like "where partitionCol
> > ''2017-01-12 04:00:00", instead of "where partitionCol > 1484236798000",
> > right?
> >
> > 2017-01-20 16:00 GMT+08:00 ShaoFeng Shi <sh...@apache.org>:
> >
> > > Hi Wu xin,
> > >
> > > It is okay to use the unix time as the "tsColumn" in a Streaming cube;
> > > Then Kylin will parse the value to get the date/time in YYYY-MM-DD or
> > > YYYY-MM-DD HH:MM:SS format; While for the Cube "partition column", it
> > > always need be a valid Date or Timestamp value, not epoch time in
> > > miliseconds;
> > >
> > > 2017-01-20 14:22 GMT+08:00 Mario Copperfield <xw...@gmail.com>:
> > >
> > > > I think it might make a confuse, because we usually define timestamp as
> > > > an unix timestamp such as “1484236798000"
> > > >
> > > > On 20 Jan 2017, 13:25 +0800, ShaoFeng Shi <sh...@apache.org>,
> > > > wrote:
> > > > > "When i use timestamp as partition col, it occurs exception as follow:";
> > > > >
> > > > > Please aware that "1484236798000" isn't a timestamp value. Should use
> > > > the "MINUTE_START" or "HOUR_START" as the cube partition column, which are
> > > > real timestamp.
> > > > >
> > > > > > 2017-01-20 10:38 GMT+08:00 Mario Copperfield <xw...@gmail.com>:
> > > > > > > Additionally, the stack log is in the following picture.
> > > > > > >
> > > > > > > On 20 Jan 2017, 10:27 +0800, Mario Copperfield <
> > > > xwhfcenter@gmail.com>, wrote:
> > > > > > > > I’m sorry i don’t found the property “tsParser”, did you mean
> > > > that “Parser Name”?
> > > > > > > >
> > > > > > > > The following picture is my configure.
> > > > > > > >
> > > > > > > > I change a little codes so that it can work but i found that the
> > > > master branch has changed the class “UpdateCubeInfoAfterBuildStep” so much
> > > > that I did not pull request.
> > > > > > > >
> > > > > > > > This is what my change:
> > > > > > > > https://github.com/xwhfcenter/kylin/commit/3e13bf244b8238710
> > > > 7b5b445ae9946daf919cf54
> > > > > > > >
> > > > > > > >
> > > > > > > > On 19 Jan 2017, 22:31 +0800, ShaoFeng Shi <sh...@apache.org>,
> > > > wrote:
> > > > > > > > > Kylin's DefaultTimeParser will parse the long typed timestamp
> > > > value
> > > > > > > > > like "1484236798000",
> > > > > > > > > so in this case you don't need specify "tsParser".
> > > > > > > > >
> > > > > > > > > 2017-01-19 22:18 GMT+08:00 <xw...@gmail.com>:
> > > > > > > > >
> > > > > > > > > > I'll check tomorrow
> > > > > > > > > >
> > > > > > > > > > Sent from Alto
> > > > > > > > > > On Thursday, January 19, 2017 at 22:10 ShaoFeng Shi <
> > > > > > > > > > shaofengshi@apache.org> wrote:
> > > > > > > > > > Hi,
> > > > > > > > > >
> > > > > > > > > > Could you provide the stack trace? Besdies, did you specifiy
> > > > the "tsParser"
> > > > > > > > > > property when define the table? if yes, what's the value?
> > > > > > > > > >
> > > > > > > > > > 2017-01-19 21:45 GMT+08:00 Li Yang :
> > > > > > > > > >
> > > > > > > > > > > Deserves a JIRA I think.
> > > > > > > > > > >
> > > > > > > > > > > Cheers
> > > > > > > > > > > Yang
> > > > > > > > > > >
> > > > > > > > > > > On Mon, Jan 16, 2017 at 2:34 PM, Copperfield wrote:
> > > > > > > > > > >
> > > > > > >
> > > > > > > > > > > > When i use timestamp as partition col, it occurs
> > > > exception as follow:
> > > > > > > > > > > > java.text.ParseException: Unparseable date:
> > > > "1484236798000" does not
> > > > > > > > > > > match
> > > > > > > > > > > > (\p{Nd}++)\Q-\E(\p{Nd}++)\Q-\E(\p{Nd}++)\Q
> > > > > > > > > > > > \E(\p{Nd}++)\Q:\E(\p{Nd}++)\Q:\E(\p{Nd}++)
> > > > > > > > > > > > my kylin version is 1.6.0
> > > > > > > > > > > >
> > > > > > > > > > > > --
> > > > > > > > > > > > View this message in context:
> > > > http://apache-kylin.74782.x6.
> > > > > > > > > > > > nabble.com/Streaming-Build-Tim
> > > > estamp-parse-error-tp6952.html
> > > > > > > > > > > > Sent from the Apache Kylin mailing list archive at
> > > > Nabble.com.
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > --
> > > > > > > > > > Best regards,
> > > > > > > > > >
> > > > > > > > > > Shaofeng Shi 史少锋
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Best regards,
> > > > > > > > >
> > > > > > > > > Shaofeng Shi 史少锋
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Best regards,
> > > > >
> > > > > Shaofeng Shi 史少锋
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > > Best regards,
> > >
> > > Shaofeng Shi 史少锋
> > >
> > >
> >
> >
> > --
> > Best regards,
> >
> > Shaofeng Shi 史少锋
Re: Streaming Build Timestamp parse error
Posted by Mario Copperfield <xw...@gmail.com>.
you mean that if i use 1484236798 rather than 1484236798000?
On 20 Jan 2017, 16:03 +0800, ShaoFeng Shi <sh...@apache.org>, wrote:
> I think you would prefer to write SQL like "where partitionCol
> ''2017-01-12 04:00:00", instead of "where partitionCol > 1484236798000",
> right?
>
> 2017-01-20 16:00 GMT+08:00 ShaoFeng Shi <sh...@apache.org>:
>
> > Hi Wu xin,
> >
> > It is okay to use the unix time as the "tsColumn" in a Streaming cube;
> > Then Kylin will parse the value to get the date/time in YYYY-MM-DD or
> > YYYY-MM-DD HH:MM:SS format; While for the Cube "partition column", it
> > always need be a valid Date or Timestamp value, not epoch time in
> > miliseconds;
> >
> > 2017-01-20 14:22 GMT+08:00 Mario Copperfield <xw...@gmail.com>:
> >
> > > I think it might make a confuse, because we usually define timestamp as
> > > an unix timestamp such as “1484236798000"
> > >
> > > On 20 Jan 2017, 13:25 +0800, ShaoFeng Shi <sh...@apache.org>,
> > > wrote:
> > > > "When i use timestamp as partition col, it occurs exception as follow:";
> > > >
> > > > Please aware that "1484236798000" isn't a timestamp value. Should use
> > > the "MINUTE_START" or "HOUR_START" as the cube partition column, which are
> > > real timestamp.
> > > >
> > > > > 2017-01-20 10:38 GMT+08:00 Mario Copperfield <xw...@gmail.com>:
> > > > > > Additionally, the stack log is in the following picture.
> > > > > >
> > > > > > On 20 Jan 2017, 10:27 +0800, Mario Copperfield <
> > > xwhfcenter@gmail.com>, wrote:
> > > > > > > I’m sorry i don’t found the property “tsParser”, did you mean
> > > that “Parser Name”?
> > > > > > >
> > > > > > > The following picture is my configure.
> > > > > > >
> > > > > > > I change a little codes so that it can work but i found that the
> > > master branch has changed the class “UpdateCubeInfoAfterBuildStep” so much
> > > that I did not pull request.
> > > > > > >
> > > > > > > This is what my change:
> > > > > > > https://github.com/xwhfcenter/kylin/commit/3e13bf244b8238710
> > > 7b5b445ae9946daf919cf54
> > > > > > >
> > > > > > >
> > > > > > > On 19 Jan 2017, 22:31 +0800, ShaoFeng Shi <sh...@apache.org>,
> > > wrote:
> > > > > > > > Kylin's DefaultTimeParser will parse the long typed timestamp
> > > value
> > > > > > > > like "1484236798000",
> > > > > > > > so in this case you don't need specify "tsParser".
> > > > > > > >
> > > > > > > > 2017-01-19 22:18 GMT+08:00 <xw...@gmail.com>:
> > > > > > > >
> > > > > > > > > I'll check tomorrow
> > > > > > > > >
> > > > > > > > > Sent from Alto
> > > > > > > > > On Thursday, January 19, 2017 at 22:10 ShaoFeng Shi <
> > > > > > > > > shaofengshi@apache.org> wrote:
> > > > > > > > > Hi,
> > > > > > > > >
> > > > > > > > > Could you provide the stack trace? Besdies, did you specifiy
> > > the "tsParser"
> > > > > > > > > property when define the table? if yes, what's the value?
> > > > > > > > >
> > > > > > > > > 2017-01-19 21:45 GMT+08:00 Li Yang :
> > > > > > > > >
> > > > > > > > > > Deserves a JIRA I think.
> > > > > > > > > >
> > > > > > > > > > Cheers
> > > > > > > > > > Yang
> > > > > > > > > >
> > > > > > > > > > On Mon, Jan 16, 2017 at 2:34 PM, Copperfield wrote:
> > > > > > > > > >
> > > > > >
> > > > > > > > > > > When i use timestamp as partition col, it occurs
> > > exception as follow:
> > > > > > > > > > > java.text.ParseException: Unparseable date:
> > > "1484236798000" does not
> > > > > > > > > > match
> > > > > > > > > > > (\p{Nd}++)\Q-\E(\p{Nd}++)\Q-\E(\p{Nd}++)\Q
> > > > > > > > > > > \E(\p{Nd}++)\Q:\E(\p{Nd}++)\Q:\E(\p{Nd}++)
> > > > > > > > > > > my kylin version is 1.6.0
> > > > > > > > > > >
> > > > > > > > > > > --
> > > > > > > > > > > View this message in context:
> > > http://apache-kylin.74782.x6.
> > > > > > > > > > > nabble.com/Streaming-Build-Tim
> > > estamp-parse-error-tp6952.html
> > > > > > > > > > > Sent from the Apache Kylin mailing list archive at
> > > Nabble.com.
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Best regards,
> > > > > > > > >
> > > > > > > > > Shaofeng Shi 史少锋
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > --
> > > > > > > > Best regards,
> > > > > > > >
> > > > > > > > Shaofeng Shi 史少锋
> > > >
> > > >
> > > >
> > > > --
> > > > Best regards,
> > > >
> > > > Shaofeng Shi 史少锋
> > > >
> > >
> >
> >
> >
> > --
> > Best regards,
> >
> > Shaofeng Shi 史少锋
> >
> >
>
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
Re: Streaming Build Timestamp parse error
Posted by ShaoFeng Shi <sh...@apache.org>.
I think you would prefer to write SQL like "where partitionCol >
''2017-01-12 04:00:00", instead of "where partitionCol > 1484236798000",
right?
2017-01-20 16:00 GMT+08:00 ShaoFeng Shi <sh...@apache.org>:
> Hi Wu xin,
>
> It is okay to use the unix time as the "tsColumn" in a Streaming cube;
> Then Kylin will parse the value to get the date/time in YYYY-MM-DD or
> YYYY-MM-DD HH:MM:SS format; While for the Cube "partition column", it
> always need be a valid Date or Timestamp value, not epoch time in
> miliseconds;
>
> 2017-01-20 14:22 GMT+08:00 Mario Copperfield <xw...@gmail.com>:
>
>> I think it might make a confuse, because we usually define timestamp as
>> an unix timestamp such as “1484236798000"
>>
>> On 20 Jan 2017, 13:25 +0800, ShaoFeng Shi <sh...@apache.org>,
>> wrote:
>> > "When i use timestamp as partition col, it occurs exception as follow:";
>> >
>> > Please aware that "1484236798000" isn't a timestamp value. Should use
>> the "MINUTE_START" or "HOUR_START" as the cube partition column, which are
>> real timestamp.
>> >
>> > > 2017-01-20 10:38 GMT+08:00 Mario Copperfield <xw...@gmail.com>:
>> > > > Additionally, the stack log is in the following picture.
>> > > >
>> > > > On 20 Jan 2017, 10:27 +0800, Mario Copperfield <
>> xwhfcenter@gmail.com>, wrote:
>> > > > > I’m sorry i don’t found the property “tsParser”, did you mean
>> that “Parser Name”?
>> > > > >
>> > > > > The following picture is my configure.
>> > > > >
>> > > > > I change a little codes so that it can work but i found that the
>> master branch has changed the class “UpdateCubeInfoAfterBuildStep” so much
>> that I did not pull request.
>> > > > >
>> > > > > This is what my change:
>> > > > > https://github.com/xwhfcenter/kylin/commit/3e13bf244b8238710
>> 7b5b445ae9946daf919cf54
>> > > > >
>> > > > >
>> > > > > On 19 Jan 2017, 22:31 +0800, ShaoFeng Shi <sh...@apache.org>,
>> wrote:
>> > > > > > Kylin's DefaultTimeParser will parse the long typed timestamp
>> value
>> > > > > > like "1484236798000",
>> > > > > > so in this case you don't need specify "tsParser".
>> > > > > >
>> > > > > > 2017-01-19 22:18 GMT+08:00 <xw...@gmail.com>:
>> > > > > >
>> > > > > > > I'll check tomorrow
>> > > > > > >
>> > > > > > > Sent from Alto
>> > > > > > > On Thursday, January 19, 2017 at 22:10 ShaoFeng Shi <
>> > > > > > > shaofengshi@apache.org> wrote:
>> > > > > > > Hi,
>> > > > > > >
>> > > > > > > Could you provide the stack trace? Besdies, did you specifiy
>> the "tsParser"
>> > > > > > > property when define the table? if yes, what's the value?
>> > > > > > >
>> > > > > > > 2017-01-19 21:45 GMT+08:00 Li Yang :
>> > > > > > >
>> > > > > > > > Deserves a JIRA I think.
>> > > > > > > >
>> > > > > > > > Cheers
>> > > > > > > > Yang
>> > > > > > > >
>> > > > > > > > On Mon, Jan 16, 2017 at 2:34 PM, Copperfield wrote:
>> > > > > > > >
>> > > >
>> > > > > > > > > When i use timestamp as partition col, it occurs
>> exception as follow:
>> > > > > > > > > java.text.ParseException: Unparseable date:
>> "1484236798000" does not
>> > > > > > > > match
>> > > > > > > > > (\p{Nd}++)\Q-\E(\p{Nd}++)\Q-\E(\p{Nd}++)\Q
>> > > > > > > > > \E(\p{Nd}++)\Q:\E(\p{Nd}++)\Q:\E(\p{Nd}++)
>> > > > > > > > > my kylin version is 1.6.0
>> > > > > > > > >
>> > > > > > > > > --
>> > > > > > > > > View this message in context:
>> http://apache-kylin.74782.x6.
>> > > > > > > > > nabble.com/Streaming-Build-Tim
>> estamp-parse-error-tp6952.html
>> > > > > > > > > Sent from the Apache Kylin mailing list archive at
>> Nabble.com.
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > > >
>> > > > > > >
>> > > > > > > --
>> > > > > > > Best regards,
>> > > > > > >
>> > > > > > > Shaofeng Shi 史少锋
>> > > > > > >
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > > > --
>> > > > > > Best regards,
>> > > > > >
>> > > > > > Shaofeng Shi 史少锋
>> >
>> >
>> >
>> > --
>> > Best regards,
>> >
>> > Shaofeng Shi 史少锋
>> >
>>
>
>
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
>
>
--
Best regards,
Shaofeng Shi 史少锋
Re: Streaming Build Timestamp parse error
Posted by ShaoFeng Shi <sh...@apache.org>.
Hi Wu xin,
It is okay to use the unix time as the "tsColumn" in a Streaming cube; Then
Kylin will parse the value to get the date/time in YYYY-MM-DD or YYYY-MM-DD
HH:MM:SS format; While for the Cube "partition column", it always need be a
valid Date or Timestamp value, not epoch time in miliseconds;
2017-01-20 14:22 GMT+08:00 Mario Copperfield <xw...@gmail.com>:
> I think it might make a confuse, because we usually define timestamp as an
> unix timestamp such as “1484236798000"
>
> On 20 Jan 2017, 13:25 +0800, ShaoFeng Shi <sh...@apache.org>, wrote:
> > "When i use timestamp as partition col, it occurs exception as follow:";
> >
> > Please aware that "1484236798000" isn't a timestamp value. Should use
> the "MINUTE_START" or "HOUR_START" as the cube partition column, which are
> real timestamp.
> >
> > > 2017-01-20 10:38 GMT+08:00 Mario Copperfield <xw...@gmail.com>:
> > > > Additionally, the stack log is in the following picture.
> > > >
> > > > On 20 Jan 2017, 10:27 +0800, Mario Copperfield <xw...@gmail.com>,
> wrote:
> > > > > I’m sorry i don’t found the property “tsParser”, did you mean that
> “Parser Name”?
> > > > >
> > > > > The following picture is my configure.
> > > > >
> > > > > I change a little codes so that it can work but i found that the
> master branch has changed the class “UpdateCubeInfoAfterBuildStep” so much
> that I did not pull request.
> > > > >
> > > > > This is what my change:
> > > > > https://github.com/xwhfcenter/kylin/commit/
> 3e13bf244b82387107b5b445ae9946daf919cf54
> > > > >
> > > > >
> > > > > On 19 Jan 2017, 22:31 +0800, ShaoFeng Shi <sh...@apache.org>,
> wrote:
> > > > > > Kylin's DefaultTimeParser will parse the long typed timestamp
> value
> > > > > > like "1484236798000",
> > > > > > so in this case you don't need specify "tsParser".
> > > > > >
> > > > > > 2017-01-19 22:18 GMT+08:00 <xw...@gmail.com>:
> > > > > >
> > > > > > > I'll check tomorrow
> > > > > > >
> > > > > > > Sent from Alto
> > > > > > > On Thursday, January 19, 2017 at 22:10 ShaoFeng Shi <
> > > > > > > shaofengshi@apache.org> wrote:
> > > > > > > Hi,
> > > > > > >
> > > > > > > Could you provide the stack trace? Besdies, did you specifiy
> the "tsParser"
> > > > > > > property when define the table? if yes, what's the value?
> > > > > > >
> > > > > > > 2017-01-19 21:45 GMT+08:00 Li Yang :
> > > > > > >
> > > > > > > > Deserves a JIRA I think.
> > > > > > > >
> > > > > > > > Cheers
> > > > > > > > Yang
> > > > > > > >
> > > > > > > > On Mon, Jan 16, 2017 at 2:34 PM, Copperfield wrote:
> > > > > > > >
> > > >
> > > > > > > > > When i use timestamp as partition col, it occurs exception
> as follow:
> > > > > > > > > java.text.ParseException: Unparseable date:
> "1484236798000" does not
> > > > > > > > match
> > > > > > > > > (\p{Nd}++)\Q-\E(\p{Nd}++)\Q-\E(\p{Nd}++)\Q
> > > > > > > > > \E(\p{Nd}++)\Q:\E(\p{Nd}++)\Q:\E(\p{Nd}++)
> > > > > > > > > my kylin version is 1.6.0
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > > View this message in context: http://apache-kylin.74782.x6
> .
> > > > > > > > > nabble.com/Streaming-Build-Timestamp-parse-error-tp6952.
> html
> > > > > > > > > Sent from the Apache Kylin mailing list archive at
> Nabble.com.
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Best regards,
> > > > > > >
> > > > > > > Shaofeng Shi 史少锋
> > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Best regards,
> > > > > >
> > > > > > Shaofeng Shi 史少锋
> >
> >
> >
> > --
> > Best regards,
> >
> > Shaofeng Shi 史少锋
> >
>
--
Best regards,
Shaofeng Shi 史少锋
Re: Streaming Build Timestamp parse error
Posted by Mario Copperfield <xw...@gmail.com>.
I think it might make a confuse, because we usually define timestamp as an unix timestamp such as “1484236798000"
On 20 Jan 2017, 13:25 +0800, ShaoFeng Shi <sh...@apache.org>, wrote:
> "When i use timestamp as partition col, it occurs exception as follow:";
>
> Please aware that "1484236798000" isn't a timestamp value. Should use the "MINUTE_START" or "HOUR_START" as the cube partition column, which are real timestamp.
>
> > 2017-01-20 10:38 GMT+08:00 Mario Copperfield <xw...@gmail.com>:
> > > Additionally, the stack log is in the following picture.
> > >
> > > On 20 Jan 2017, 10:27 +0800, Mario Copperfield <xw...@gmail.com>, wrote:
> > > > I’m sorry i don’t found the property “tsParser”, did you mean that “Parser Name”?
> > > >
> > > > The following picture is my configure.
> > > >
> > > > I change a little codes so that it can work but i found that the master branch has changed the class “UpdateCubeInfoAfterBuildStep” so much that I did not pull request.
> > > >
> > > > This is what my change:
> > > > https://github.com/xwhfcenter/kylin/commit/3e13bf244b82387107b5b445ae9946daf919cf54
> > > >
> > > >
> > > > On 19 Jan 2017, 22:31 +0800, ShaoFeng Shi <sh...@apache.org>, wrote:
> > > > > Kylin's DefaultTimeParser will parse the long typed timestamp value
> > > > > like "1484236798000",
> > > > > so in this case you don't need specify "tsParser".
> > > > >
> > > > > 2017-01-19 22:18 GMT+08:00 <xw...@gmail.com>:
> > > > >
> > > > > > I'll check tomorrow
> > > > > >
> > > > > > Sent from Alto
> > > > > > On Thursday, January 19, 2017 at 22:10 ShaoFeng Shi <
> > > > > > shaofengshi@apache.org> wrote:
> > > > > > Hi,
> > > > > >
> > > > > > Could you provide the stack trace? Besdies, did you specifiy the "tsParser"
> > > > > > property when define the table? if yes, what's the value?
> > > > > >
> > > > > > 2017-01-19 21:45 GMT+08:00 Li Yang :
> > > > > >
> > > > > > > Deserves a JIRA I think.
> > > > > > >
> > > > > > > Cheers
> > > > > > > Yang
> > > > > > >
> > > > > > > On Mon, Jan 16, 2017 at 2:34 PM, Copperfield wrote:
> > > > > > >
> > >
> > > > > > > > When i use timestamp as partition col, it occurs exception as follow:
> > > > > > > > java.text.ParseException: Unparseable date: "1484236798000" does not
> > > > > > > match
> > > > > > > > (\p{Nd}++)\Q-\E(\p{Nd}++)\Q-\E(\p{Nd}++)\Q
> > > > > > > > \E(\p{Nd}++)\Q:\E(\p{Nd}++)\Q:\E(\p{Nd}++)
> > > > > > > > my kylin version is 1.6.0
> > > > > > > >
> > > > > > > > --
> > > > > > > > View this message in context: http://apache-kylin.74782.x6.
> > > > > > > > nabble.com/Streaming-Build-Timestamp-parse-error-tp6952.html
> > > > > > > > Sent from the Apache Kylin mailing list archive at Nabble.com.
> > > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Best regards,
> > > > > >
> > > > > > Shaofeng Shi 史少锋
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Best regards,
> > > > >
> > > > > Shaofeng Shi 史少锋
>
>
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
>
Re: Streaming Build Timestamp parse error
Posted by ShaoFeng Shi <sh...@apache.org>.
"When i use timestamp as partition col, it occurs exception as follow:";
Please aware that "1484236798000" isn't a timestamp value. Should use the
"MINUTE_START" or "HOUR_START" as the cube partition column, which are real
timestamp.
2017-01-20 10:38 GMT+08:00 Mario Copperfield <xw...@gmail.com>:
> Additionally, the stack log is in the following picture.
>
> On 20 Jan 2017, 10:27 +0800, Mario Copperfield <xw...@gmail.com>,
> wrote:
>
> I’m sorry i don’t found the property “tsParser”, did you mean that “Parser
> Name”?
>
> The following picture is my configure.
>
> I change a little codes so that it can work but i found that the master
> branch has changed the class “UpdateCubeInfoAfterBuildStep” so much that I
> did not pull request.
>
> This is what my change:
> https://github.com/xwhfcenter/kylin/commit/3e13bf244b82387107b5b445ae9946
> daf919cf54
>
>
> On 19 Jan 2017, 22:31 +0800, ShaoFeng Shi <sh...@apache.org>, wrote:
>
> Kylin's DefaultTimeParser will parse the long typed timestamp value
> like "1484236798000",
> so in this case you don't need specify "tsParser".
>
> 2017-01-19 22:18 GMT+08:00 <xw...@gmail.com>:
>
> I'll check tomorrow
>
> Sent from Alto
> On Thursday, January 19, 2017 at 22:10 ShaoFeng Shi <
> shaofengshi@apache.org> wrote:
> Hi,
>
> Could you provide the stack trace? Besdies, did you specifiy the "tsParser"
> property when define the table? if yes, what's the value?
>
> 2017-01-19 21:45 GMT+08:00 Li Yang :
>
> Deserves a JIRA I think.
>
> Cheers
> Yang
>
> On Mon, Jan 16, 2017 at 2:34 PM, Copperfield wrote:
>
>
> When i use timestamp as partition col, it occurs exception as follow:
> java.text.ParseException: Unparseable date: "1484236798000" does not
>
> match
>
> (\p{Nd}++)\Q-\E(\p{Nd}++)\Q-\E(\p{Nd}++)\Q
> \E(\p{Nd}++)\Q:\E(\p{Nd}++)\Q:\E(\p{Nd}++)
> my kylin version is 1.6.0
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/Streaming-Build-Timestamp-parse-error-tp6952.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
>
>
>
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
>
>
>
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
>
>
--
Best regards,
Shaofeng Shi 史少锋
Re: Streaming Build Timestamp parse error
Posted by Mario Copperfield <xw...@gmail.com>.
Additionally, the stack log is in the following picture.
On 20 Jan 2017, 10:27 +0800, Mario Copperfield <xw...@gmail.com>, wrote:
> I’m sorry i don’t found the property “tsParser”, did you mean that “Parser Name”?
>
> The following picture is my configure.
>
> I change a little codes so that it can work but i found that the master branch has changed the class “UpdateCubeInfoAfterBuildStep” so much that I did not pull request.
>
> This is what my change:
> https://github.com/xwhfcenter/kylin/commit/3e13bf244b82387107b5b445ae9946daf919cf54
>
>
> On 19 Jan 2017, 22:31 +0800, ShaoFeng Shi <sh...@apache.org>, wrote:
> > Kylin's DefaultTimeParser will parse the long typed timestamp value
> > like "1484236798000",
> > so in this case you don't need specify "tsParser".
> >
> > 2017-01-19 22:18 GMT+08:00 <xw...@gmail.com>:
> >
> > > I'll check tomorrow
> > >
> > > Sent from Alto
> > > On Thursday, January 19, 2017 at 22:10 ShaoFeng Shi <
> > > shaofengshi@apache.org> wrote:
> > > Hi,
> > >
> > > Could you provide the stack trace? Besdies, did you specifiy the "tsParser"
> > > property when define the table? if yes, what's the value?
> > >
> > > 2017-01-19 21:45 GMT+08:00 Li Yang :
> > >
> > > > Deserves a JIRA I think.
> > > >
> > > > Cheers
> > > > Yang
> > > >
> > > > On Mon, Jan 16, 2017 at 2:34 PM, Copperfield wrote:
> > > >
> > > > > When i use timestamp as partition col, it occurs exception as follow:
> > > > > java.text.ParseException: Unparseable date: "1484236798000" does not
> > > > match
> > > > > (\p{Nd}++)\Q-\E(\p{Nd}++)\Q-\E(\p{Nd}++)\Q
> > > > > \E(\p{Nd}++)\Q:\E(\p{Nd}++)\Q:\E(\p{Nd}++)
> > > > > my kylin version is 1.6.0
> > > > >
> > > > > --
> > > > > View this message in context: http://apache-kylin.74782.x6.
> > > > > nabble.com/Streaming-Build-Timestamp-parse-error-tp6952.html
> > > > > Sent from the Apache Kylin mailing list archive at Nabble.com.
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > > Best regards,
> > >
> > > Shaofeng Shi 史少锋
> > >
> >
> >
> >
> > --
> > Best regards,
> >
> > Shaofeng Shi 史少锋
Re: Streaming Build Timestamp parse error
Posted by Mario Copperfield <xw...@gmail.com>.
I’m sorry i don’t found the property “tsParser”, did you mean that “Parser Name”?
The following picture is my configure.
I change a little codes so that it can work but i found that the master branch has changed the class “UpdateCubeInfoAfterBuildStep” so much that I did not pull request.
This is what my change:
https://github.com/xwhfcenter/kylin/commit/3e13bf244b82387107b5b445ae9946daf919cf54
On 19 Jan 2017, 22:31 +0800, ShaoFeng Shi <sh...@apache.org>, wrote:
> Kylin's DefaultTimeParser will parse the long typed timestamp value
> like "1484236798000",
> so in this case you don't need specify "tsParser".
>
> 2017-01-19 22:18 GMT+08:00 <xw...@gmail.com>:
>
> > I'll check tomorrow
> >
> > Sent from Alto
> > On Thursday, January 19, 2017 at 22:10 ShaoFeng Shi <
> > shaofengshi@apache.org> wrote:
> > Hi,
> >
> > Could you provide the stack trace? Besdies, did you specifiy the "tsParser"
> > property when define the table? if yes, what's the value?
> >
> > 2017-01-19 21:45 GMT+08:00 Li Yang :
> >
> > > Deserves a JIRA I think.
> > >
> > > Cheers
> > > Yang
> > >
> > > On Mon, Jan 16, 2017 at 2:34 PM, Copperfield wrote:
> > >
> > > > When i use timestamp as partition col, it occurs exception as follow:
> > > > java.text.ParseException: Unparseable date: "1484236798000" does not
> > > match
> > > > (\p{Nd}++)\Q-\E(\p{Nd}++)\Q-\E(\p{Nd}++)\Q
> > > > \E(\p{Nd}++)\Q:\E(\p{Nd}++)\Q:\E(\p{Nd}++)
> > > > my kylin version is 1.6.0
> > > >
> > > > --
> > > > View this message in context: http://apache-kylin.74782.x6.
> > > > nabble.com/Streaming-Build-Timestamp-parse-error-tp6952.html
> > > > Sent from the Apache Kylin mailing list archive at Nabble.com.
> > > >
> > >
> >
> >
> >
> > --
> > Best regards,
> >
> > Shaofeng Shi 史少锋
> >
>
>
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
Re: Streaming Build Timestamp parse error
Posted by ShaoFeng Shi <sh...@apache.org>.
Kylin's DefaultTimeParser will parse the long typed timestamp value
like "1484236798000",
so in this case you don't need specify "tsParser".
2017-01-19 22:18 GMT+08:00 <xw...@gmail.com>:
> I'll check tomorrow
>
> Sent from Alto
> On Thursday, January 19, 2017 at 22:10 ShaoFeng Shi <
> shaofengshi@apache.org> wrote:
> Hi,
>
> Could you provide the stack trace? Besdies, did you specifiy the "tsParser"
> property when define the table? if yes, what's the value?
>
> 2017-01-19 21:45 GMT+08:00 Li Yang :
>
> > Deserves a JIRA I think.
> >
> > Cheers
> > Yang
> >
> > On Mon, Jan 16, 2017 at 2:34 PM, Copperfield wrote:
> >
> > > When i use timestamp as partition col, it occurs exception as follow:
> > > java.text.ParseException: Unparseable date: "1484236798000" does not
> > match
> > > (\p{Nd}++)\Q-\E(\p{Nd}++)\Q-\E(\p{Nd}++)\Q
> > > \E(\p{Nd}++)\Q:\E(\p{Nd}++)\Q:\E(\p{Nd}++)
> > > my kylin version is 1.6.0
> > >
> > > --
> > > View this message in context: http://apache-kylin.74782.x6.
> > > nabble.com/Streaming-Build-Timestamp-parse-error-tp6952.html
> > > Sent from the Apache Kylin mailing list archive at Nabble.com.
> > >
> >
>
>
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
>
--
Best regards,
Shaofeng Shi 史少锋
Re: Streaming Build Timestamp parse error
Posted by xw...@gmail.com.
I'll check tomorrow
Sent from Alto
On Thursday, January 19, 2017 at 22:10 ShaoFeng Shi <sh...@apache.org> wrote:
Hi,
Could you provide the stack trace? Besdies, did you specifiy the "tsParser"
property when define the table? if yes, what's the value?
2017-01-19 21:45 GMT+08:00 Li Yang :
> Deserves a JIRA I think.
>
> Cheers
> Yang
>
> On Mon, Jan 16, 2017 at 2:34 PM, Copperfield wrote:
>
> > When i use timestamp as partition col, it occurs exception as follow:
> > java.text.ParseException: Unparseable date: "1484236798000" does not
> match
> > (\p{Nd}++)\Q-\E(\p{Nd}++)\Q-\E(\p{Nd}++)\Q
> > \E(\p{Nd}++)\Q:\E(\p{Nd}++)\Q:\E(\p{Nd}++)
> > my kylin version is 1.6.0
> >
> > --
> > View this message in context: http://apache-kylin.74782.x6.
> > nabble.com/Streaming-Build-Timestamp-parse-error-tp6952.html
> > Sent from the Apache Kylin mailing list archive at Nabble.com.
> >
>
--
Best regards,
Shaofeng Shi 史少锋
Re: Streaming Build Timestamp parse error
Posted by ShaoFeng Shi <sh...@apache.org>.
Hi,
Could you provide the stack trace? Besdies, did you specifiy the "tsParser"
property when define the table? if yes, what's the value?
2017-01-19 21:45 GMT+08:00 Li Yang <li...@apache.org>:
> Deserves a JIRA I think.
>
> Cheers
> Yang
>
> On Mon, Jan 16, 2017 at 2:34 PM, Copperfield <xw...@gmail.com> wrote:
>
> > When i use timestamp as partition col, it occurs exception as follow:
> > java.text.ParseException: Unparseable date: "1484236798000" does not
> match
> > (\p{Nd}++)\Q-\E(\p{Nd}++)\Q-\E(\p{Nd}++)\Q
> > \E(\p{Nd}++)\Q:\E(\p{Nd}++)\Q:\E(\p{Nd}++)
> > my kylin version is 1.6.0
> >
> > --
> > View this message in context: http://apache-kylin.74782.x6.
> > nabble.com/Streaming-Build-Timestamp-parse-error-tp6952.html
> > Sent from the Apache Kylin mailing list archive at Nabble.com.
> >
>
--
Best regards,
Shaofeng Shi 史少锋
Re: Streaming Build Timestamp parse error
Posted by Li Yang <li...@apache.org>.
Deserves a JIRA I think.
Cheers
Yang
On Mon, Jan 16, 2017 at 2:34 PM, Copperfield <xw...@gmail.com> wrote:
> When i use timestamp as partition col, it occurs exception as follow:
> java.text.ParseException: Unparseable date: "1484236798000" does not match
> (\p{Nd}++)\Q-\E(\p{Nd}++)\Q-\E(\p{Nd}++)\Q
> \E(\p{Nd}++)\Q:\E(\p{Nd}++)\Q:\E(\p{Nd}++)
> my kylin version is 1.6.0
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/Streaming-Build-Timestamp-parse-error-tp6952.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>