You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by Sergey Shelukhin <se...@hortonworks.com> on 2015/10/13 20:58:59 UTC

proxy errors from HiveQA Jenkins?

I am trying to look at slow tests on HiveQA and tests’ history.
I keep getting 502 proxy error - often from history of any kind, rarely
from test results, sometimes just from random pages.
E.g.

Proxy ErrorThe proxy server received an invalid
response from an upstream server.
The proxy server could not handle the request GET
/jenkins/job/PreCommit-HIVE-TRUNK-Build/5623/testReport/org.apache.hadoop.h
ive.cli/TestMiniTezCliDriver/history/
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HI
VE-TRUNK-Build/5623/testReport/org.apache.hadoop.hive.cli/TestMiniTezCliDri
ver/history/>.
Reason: Error reading from remote server


Is HiveQA jenkins ok? :)

Re: proxy errors from HiveQA Jenkins?

Posted by Szehon Ho <sz...@cloudera.com>.
FYI I bumped last night the jenkins memory, I think the responses
empirically have been somewhat faster and less likely to timeout (though
not 100% sure that was the root cause).

This should also fix Pengcheong's problem of the summary not showing for
thousands of failures.

On Tue, Oct 13, 2015 at 2:12 PM, Szehon Ho <sz...@cloudera.com> wrote:

> Hm yea that's true, I don't know why the http response is so large.
>
> The ...TestMiniTezCliDriver link is pretty fast, links to Jenkins test
> reports that are probably statically stored.  I guess
> ...TestMiniTezCliDriver/history might be dynamically generated, and Jenkins
> is just slow to calculate it.
>
> All these datas are stored by Jenkins, I dont know exactly how to dump
> them.
>
> On Tue, Oct 13, 2015 at 1:56 PM, Sergey Shelukhin <se...@hortonworks.com>
> wrote:
>
>> Actually, it is possible to get database dump, or something similar, of
>> test stats from wherever they are stored?
>>
>> On 15/10/13, 12:14, "Sergey Shelukhin" <se...@hortonworks.com> wrote:
>>
>> >Sure… how did you find out about large http response? It seems like a
>> >history page with one chart would not be much larger than any other page.
>> >
>> >On 15/10/13, 12:07, "Szehon Ho" <sz...@cloudera.com> wrote:
>> >
>> >>Yea I also noticed its overloaded sometimes.
>> >>
>> >>I think in this case, it is very large http response.. I can try bump
>> the
>> >>timeout, but other than that I dont have that many ideas.
>> >>
>> >>Thanks
>> >>Szehon
>> >>
>> >>On Tue, Oct 13, 2015 at 11:58 AM, Sergey Shelukhin
>> >><se...@hortonworks.com>
>> >>wrote:
>> >>
>> >>> I am trying to look at slow tests on HiveQA and tests’ history.
>> >>> I keep getting 502 proxy error - often from history of any kind,
>> rarely
>> >>> from test results, sometimes just from random pages.
>> >>> E.g.
>> >>>
>> >>> Proxy ErrorThe proxy server received an invalid
>> >>> response from an upstream server.
>> >>> The proxy server could not handle the request GET
>> >>>
>>
>> >>>/jenkins/job/PreCommit-HIVE-TRUNK-Build/5623/testReport/org.apache.hadoo
>> >>>p
>> >>>.h
>> >>> ive.cli/TestMiniTezCliDriver/history/
>> >>> <
>> >>>
>> >>>
>> http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-
>> >>>H
>> >>>I
>> >>>
>>
>> >>>VE-TRUNK-Build/5623/testReport/org.apache.hadoop.hive.cli/TestMiniTezCli
>> >>>D
>> >>>ri
>> >>> ver/history/>.
>> >>> Reason: Error reading from remote server
>> >>>
>> >>>
>> >>> Is HiveQA jenkins ok? :)
>> >>>
>> >>>
>> >
>>
>>
>

Re: proxy errors from HiveQA Jenkins?

Posted by Szehon Ho <sz...@cloudera.com>.
Hm yea that's true, I don't know why the http response is so large.

The ...TestMiniTezCliDriver link is pretty fast, links to Jenkins test
reports that are probably statically stored.  I guess
...TestMiniTezCliDriver/history might be dynamically generated, and Jenkins
is just slow to calculate it.

All these datas are stored by Jenkins, I dont know exactly how to dump them.

On Tue, Oct 13, 2015 at 1:56 PM, Sergey Shelukhin <se...@hortonworks.com>
wrote:

> Actually, it is possible to get database dump, or something similar, of
> test stats from wherever they are stored?
>
> On 15/10/13, 12:14, "Sergey Shelukhin" <se...@hortonworks.com> wrote:
>
> >Sure… how did you find out about large http response? It seems like a
> >history page with one chart would not be much larger than any other page.
> >
> >On 15/10/13, 12:07, "Szehon Ho" <sz...@cloudera.com> wrote:
> >
> >>Yea I also noticed its overloaded sometimes.
> >>
> >>I think in this case, it is very large http response.. I can try bump the
> >>timeout, but other than that I dont have that many ideas.
> >>
> >>Thanks
> >>Szehon
> >>
> >>On Tue, Oct 13, 2015 at 11:58 AM, Sergey Shelukhin
> >><se...@hortonworks.com>
> >>wrote:
> >>
> >>> I am trying to look at slow tests on HiveQA and tests’ history.
> >>> I keep getting 502 proxy error - often from history of any kind, rarely
> >>> from test results, sometimes just from random pages.
> >>> E.g.
> >>>
> >>> Proxy ErrorThe proxy server received an invalid
> >>> response from an upstream server.
> >>> The proxy server could not handle the request GET
> >>>
> >>>/jenkins/job/PreCommit-HIVE-TRUNK-Build/5623/testReport/org.apache.hadoo
> >>>p
> >>>.h
> >>> ive.cli/TestMiniTezCliDriver/history/
> >>> <
> >>>
> >>>
> http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-
> >>>H
> >>>I
> >>>
> >>>VE-TRUNK-Build/5623/testReport/org.apache.hadoop.hive.cli/TestMiniTezCli
> >>>D
> >>>ri
> >>> ver/history/>.
> >>> Reason: Error reading from remote server
> >>>
> >>>
> >>> Is HiveQA jenkins ok? :)
> >>>
> >>>
> >
>
>

Re: proxy errors from HiveQA Jenkins?

Posted by Sergey Shelukhin <se...@hortonworks.com>.
Actually, it is possible to get database dump, or something similar, of
test stats from wherever they are stored?

On 15/10/13, 12:14, "Sergey Shelukhin" <se...@hortonworks.com> wrote:

>Sure… how did you find out about large http response? It seems like a
>history page with one chart would not be much larger than any other page.
>
>On 15/10/13, 12:07, "Szehon Ho" <sz...@cloudera.com> wrote:
>
>>Yea I also noticed its overloaded sometimes.
>>
>>I think in this case, it is very large http response.. I can try bump the
>>timeout, but other than that I dont have that many ideas.
>>
>>Thanks
>>Szehon
>>
>>On Tue, Oct 13, 2015 at 11:58 AM, Sergey Shelukhin
>><se...@hortonworks.com>
>>wrote:
>>
>>> I am trying to look at slow tests on HiveQA and tests’ history.
>>> I keep getting 502 proxy error - often from history of any kind, rarely
>>> from test results, sometimes just from random pages.
>>> E.g.
>>>
>>> Proxy ErrorThe proxy server received an invalid
>>> response from an upstream server.
>>> The proxy server could not handle the request GET
>>> 
>>>/jenkins/job/PreCommit-HIVE-TRUNK-Build/5623/testReport/org.apache.hadoo
>>>p
>>>.h
>>> ive.cli/TestMiniTezCliDriver/history/
>>> <
>>> 
>>>http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-
>>>H
>>>I
>>> 
>>>VE-TRUNK-Build/5623/testReport/org.apache.hadoop.hive.cli/TestMiniTezCli
>>>D
>>>ri
>>> ver/history/>.
>>> Reason: Error reading from remote server
>>>
>>>
>>> Is HiveQA jenkins ok? :)
>>>
>>>
>

Re: proxy errors from HiveQA Jenkins?

Posted by Sergey Shelukhin <se...@hortonworks.com>.
Sure… how did you find out about large http response? It seems like a
history page with one chart would not be much larger than any other page.

On 15/10/13, 12:07, "Szehon Ho" <sz...@cloudera.com> wrote:

>Yea I also noticed its overloaded sometimes.
>
>I think in this case, it is very large http response.. I can try bump the
>timeout, but other than that I dont have that many ideas.
>
>Thanks
>Szehon
>
>On Tue, Oct 13, 2015 at 11:58 AM, Sergey Shelukhin
><se...@hortonworks.com>
>wrote:
>
>> I am trying to look at slow tests on HiveQA and tests’ history.
>> I keep getting 502 proxy error - often from history of any kind, rarely
>> from test results, sometimes just from random pages.
>> E.g.
>>
>> Proxy ErrorThe proxy server received an invalid
>> response from an upstream server.
>> The proxy server could not handle the request GET
>> 
>>/jenkins/job/PreCommit-HIVE-TRUNK-Build/5623/testReport/org.apache.hadoop
>>.h
>> ive.cli/TestMiniTezCliDriver/history/
>> <
>> 
>>http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-H
>>I
>> 
>>VE-TRUNK-Build/5623/testReport/org.apache.hadoop.hive.cli/TestMiniTezCliD
>>ri
>> ver/history/>.
>> Reason: Error reading from remote server
>>
>>
>> Is HiveQA jenkins ok? :)
>>
>>

Re: proxy errors from HiveQA Jenkins?

Posted by Szehon Ho <sz...@cloudera.com>.
Yea I also noticed its overloaded sometimes.

I think in this case, it is very large http response.. I can try bump the
timeout, but other than that I dont have that many ideas.

Thanks
Szehon

On Tue, Oct 13, 2015 at 11:58 AM, Sergey Shelukhin <se...@hortonworks.com>
wrote:

> I am trying to look at slow tests on HiveQA and tests’ history.
> I keep getting 502 proxy error - often from history of any kind, rarely
> from test results, sometimes just from random pages.
> E.g.
>
> Proxy ErrorThe proxy server received an invalid
> response from an upstream server.
> The proxy server could not handle the request GET
> /jenkins/job/PreCommit-HIVE-TRUNK-Build/5623/testReport/org.apache.hadoop.h
> ive.cli/TestMiniTezCliDriver/history/
> <
> http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HI
> VE-TRUNK-Build/5623/testReport/org.apache.hadoop.hive.cli/TestMiniTezCliDri
> ver/history/>.
> Reason: Error reading from remote server
>
>
> Is HiveQA jenkins ok? :)
>
>