You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by John Sichi <js...@facebook.com> on 2010/08/26 23:39:34 UTC
failure in load_dyn_part1.q
I'm seeing this failure due to a result diff when running tests on latest trunk:
POSTHOOK: Input: default@srcpart@ds=2008-04-08/hr=12
POSTHOOK: Input: default@srcpart@ds=2008-04-09/hr=11
POSTHOOK: Input: default@srcpart@ds=2008-04-09/hr=12
-POSTHOOK: Output: default@nzhang_part2@ds=2008-12-31/hr=11
-POSTHOOK: Output: default@nzhang_part2@ds=2008-12-31/hr=12
POSTHOOK: Output: default@nzhang_part1@ds=2008-04-08/hr=11
POSTHOOK: Output: default@nzhang_part1@ds=2008-04-08/hr=12
+POSTHOOK: Output: default@nzhang_part2@ds=2008-12-31/hr=11
+POSTHOOK: Output: default@nzhang_part2@ds=2008-12-31/hr=12
Did something change recently? Or are we missing a Java-level sort on the input/output list for determinism?
JVS
RE: failure in load_dyn_part1.q
Posted by Namit Jain <nj...@facebook.com>.
I think I forgot to run tests for HIVE-1523 for hadoop 0.17.
The jsps were added as part of that.
-----Original Message-----
From: John Sichi [mailto:jsichi@facebook.com]
Sent: Thursday, August 26, 2010 6:41 PM
To: <hi...@hadoop.apache.org>
Cc: Ning Zhang; Joydeep Sen Sarma
Subject: Re: failure in load_dyn_part1.q
Now I'm getting this failure while trying to update the logs for 0.17:
compile-test:
[javac] /data/users/jsichi/open/hive-trunk/build-common.xml:304: warning: 'includeantruntime' was not set, defaulting to build.sysclasspath=last; set to false for repeatable builds
[javac] Compiling 33 source files to /data/users/jsichi/open/hive-trunk/build/ql/test/classes
BUILD FAILED
/data/users/jsichi/open/hive-trunk/build.xml:168: The following error occurred while executing this line:
/data/users/jsichi/open/hive-trunk/build.xml:105: The following error occurred while executing this line:
/data/users/jsichi/open/hive-trunk/build-common.xml:304: /data/users/jsichi/open/hive-trunk/build/hadoopcore/hadoop-0.17.2.1/lib/jsp-2.1 does not exist.
Maybe it's environmental, but I noticed that Hudson 0.17 build started failing too with exactly the same exception (whereas 0.20 is fine):
https://hudson.apache.org/hudson/job/Hive-trunk-h0.17/changes
https://hudson.apache.org/hudson/job/Hive-trunk-h0.17/lastCompletedBuild/console
Did HIVE-1523 commit tests pass with 0.17?
JVS
On Aug 26, 2010, at 2:48 PM, John Sichi wrote:
> OK, I'll create a patch for sorting them in Pre/PostExecutePrinter.
>
> JVS
>
> On Aug 26, 2010, at 2:47 PM, Ning Zhang wrote:
>
>> Yes I saw this error before but if it does not repro. So it's probably an ordering issue in POSTHOOK.
>>
>> On Aug 26, 2010, at 2:39 PM, John Sichi wrote:
>>
>>> I'm seeing this failure due to a result diff when running tests on latest trunk:
>>>
>>> POSTHOOK: Input: default@srcpart@ds=2008-04-08/hr=12
>>> POSTHOOK: Input: default@srcpart@ds=2008-04-09/hr=11
>>> POSTHOOK: Input: default@srcpart@ds=2008-04-09/hr=12
>>> -POSTHOOK: Output: default@nzhang_part2@ds=2008-12-31/hr=11
>>> -POSTHOOK: Output: default@nzhang_part2@ds=2008-12-31/hr=12
>>> POSTHOOK: Output: default@nzhang_part1@ds=2008-04-08/hr=11
>>> POSTHOOK: Output: default@nzhang_part1@ds=2008-04-08/hr=12
>>> +POSTHOOK: Output: default@nzhang_part2@ds=2008-12-31/hr=11
>>> +POSTHOOK: Output: default@nzhang_part2@ds=2008-12-31/hr=12
>>>
>>> Did something change recently? Or are we missing a Java-level sort on the input/output list for determinism?
>>>
>>> JVS
>>>
>>
>
Re: failure in load_dyn_part1.q
Posted by John Sichi <js...@facebook.com>.
Now I'm getting this failure while trying to update the logs for 0.17:
compile-test:
[javac] /data/users/jsichi/open/hive-trunk/build-common.xml:304: warning: 'includeantruntime' was not set, defaulting to build.sysclasspath=last; set to false for repeatable builds
[javac] Compiling 33 source files to /data/users/jsichi/open/hive-trunk/build/ql/test/classes
BUILD FAILED
/data/users/jsichi/open/hive-trunk/build.xml:168: The following error occurred while executing this line:
/data/users/jsichi/open/hive-trunk/build.xml:105: The following error occurred while executing this line:
/data/users/jsichi/open/hive-trunk/build-common.xml:304: /data/users/jsichi/open/hive-trunk/build/hadoopcore/hadoop-0.17.2.1/lib/jsp-2.1 does not exist.
Maybe it's environmental, but I noticed that Hudson 0.17 build started failing too with exactly the same exception (whereas 0.20 is fine):
https://hudson.apache.org/hudson/job/Hive-trunk-h0.17/changes
https://hudson.apache.org/hudson/job/Hive-trunk-h0.17/lastCompletedBuild/console
Did HIVE-1523 commit tests pass with 0.17?
JVS
On Aug 26, 2010, at 2:48 PM, John Sichi wrote:
> OK, I'll create a patch for sorting them in Pre/PostExecutePrinter.
>
> JVS
>
> On Aug 26, 2010, at 2:47 PM, Ning Zhang wrote:
>
>> Yes I saw this error before but if it does not repro. So it's probably an ordering issue in POSTHOOK.
>>
>> On Aug 26, 2010, at 2:39 PM, John Sichi wrote:
>>
>>> I'm seeing this failure due to a result diff when running tests on latest trunk:
>>>
>>> POSTHOOK: Input: default@srcpart@ds=2008-04-08/hr=12
>>> POSTHOOK: Input: default@srcpart@ds=2008-04-09/hr=11
>>> POSTHOOK: Input: default@srcpart@ds=2008-04-09/hr=12
>>> -POSTHOOK: Output: default@nzhang_part2@ds=2008-12-31/hr=11
>>> -POSTHOOK: Output: default@nzhang_part2@ds=2008-12-31/hr=12
>>> POSTHOOK: Output: default@nzhang_part1@ds=2008-04-08/hr=11
>>> POSTHOOK: Output: default@nzhang_part1@ds=2008-04-08/hr=12
>>> +POSTHOOK: Output: default@nzhang_part2@ds=2008-12-31/hr=11
>>> +POSTHOOK: Output: default@nzhang_part2@ds=2008-12-31/hr=12
>>>
>>> Did something change recently? Or are we missing a Java-level sort on the input/output list for determinism?
>>>
>>> JVS
>>>
>>
>
Re: failure in load_dyn_part1.q
Posted by John Sichi <js...@facebook.com>.
OK, I'll create a patch for sorting them in Pre/PostExecutePrinter.
JVS
On Aug 26, 2010, at 2:47 PM, Ning Zhang wrote:
> Yes I saw this error before but if it does not repro. So it's probably an ordering issue in POSTHOOK.
>
> On Aug 26, 2010, at 2:39 PM, John Sichi wrote:
>
>> I'm seeing this failure due to a result diff when running tests on latest trunk:
>>
>> POSTHOOK: Input: default@srcpart@ds=2008-04-08/hr=12
>> POSTHOOK: Input: default@srcpart@ds=2008-04-09/hr=11
>> POSTHOOK: Input: default@srcpart@ds=2008-04-09/hr=12
>> -POSTHOOK: Output: default@nzhang_part2@ds=2008-12-31/hr=11
>> -POSTHOOK: Output: default@nzhang_part2@ds=2008-12-31/hr=12
>> POSTHOOK: Output: default@nzhang_part1@ds=2008-04-08/hr=11
>> POSTHOOK: Output: default@nzhang_part1@ds=2008-04-08/hr=12
>> +POSTHOOK: Output: default@nzhang_part2@ds=2008-12-31/hr=11
>> +POSTHOOK: Output: default@nzhang_part2@ds=2008-12-31/hr=12
>>
>> Did something change recently? Or are we missing a Java-level sort on the input/output list for determinism?
>>
>> JVS
>>
>
Re: failure in load_dyn_part1.q
Posted by Ning Zhang <nz...@facebook.com>.
Yes I saw this error before but if it does not repro. So it's probably an ordering issue in POSTHOOK.
On Aug 26, 2010, at 2:39 PM, John Sichi wrote:
> I'm seeing this failure due to a result diff when running tests on latest trunk:
>
> POSTHOOK: Input: default@srcpart@ds=2008-04-08/hr=12
> POSTHOOK: Input: default@srcpart@ds=2008-04-09/hr=11
> POSTHOOK: Input: default@srcpart@ds=2008-04-09/hr=12
> -POSTHOOK: Output: default@nzhang_part2@ds=2008-12-31/hr=11
> -POSTHOOK: Output: default@nzhang_part2@ds=2008-12-31/hr=12
> POSTHOOK: Output: default@nzhang_part1@ds=2008-04-08/hr=11
> POSTHOOK: Output: default@nzhang_part1@ds=2008-04-08/hr=12
> +POSTHOOK: Output: default@nzhang_part2@ds=2008-12-31/hr=11
> +POSTHOOK: Output: default@nzhang_part2@ds=2008-12-31/hr=12
>
> Did something change recently? Or are we missing a Java-level sort on the input/output list for determinism?
>
> JVS
>