You are viewing a plain text version of this content. The canonical link for it is here.
Posted to httpclient-users@hc.apache.org by Kaushal Kothari <ka...@gmail.com> on 2019/07/12 12:25:50 UTC

[HttpClient 4.5.5 ]Proxy-Authorization header missing while requesting HTTPS url

Hi Team,

I am trying to do POC using the *HttpClient 4.5.5* library and want to
access *HTTPS url* masked through a http *proxy server* with *basic
authentication*
and its failing.

The authentication proxy header should be sent as part of the connect but
it is not happening.

I have also added the header "*Proxy-Authorization Basic
<encodedAuth>*" to *POST request
*as it requires and passing request object to httpclient through execute()
method.

Apart from that preemptive authentication is also set.


[image: image.png]

But *over the network,* "*Proxy-Authorization Basic  <encodedAuth>*" header
is *missing*.

I tried *same *scenario to access the HTTP request everything works fine.

*On the fly* [No "Proxy-Authorization" header]:

[image: image.png]
REQUEST:

CONNECT localhost:4080 HTTP/1.1
Host: 127.0.0.1:9090
User-Agent: Apache-HttpClient/4.5.5 (Java/1.8.0_191)

RESPONSE:

"HTTP/1.1 407 Proxy Authentication Required
Server: Proxy
Proxy-Authenticate: Basic realm="**** Authorization"
Cache-control: no-cache
Connection: Close
Proxy-Connection: Close
Content-Length: 0"

Could you please help me on this issue? and let me know if you require any
further information.

-- 
Thanks,
Kaushal.

Re: [HttpClient 4.5.5 ]Proxy-Authorization header missing while requesting HTTPS url

Posted by Bernd Eckenfels <ec...@zusammenkunft.net>.
The scenario is different, with http you have the proxy and taget request being the same, with connect proxies they are separate requests.

In both cases however you would not set the header yourself but use the appropriate authentication method on the proxy scope of the  credential provider (however I am not sure if this works preemptive).

--
https://Bernd.eckenfels.net

________________________________
Von: Kaushal Kothari <ka...@gmail.com>
Gesendet: Montag, Juli 15, 2019 1:40 PM
An: httpclient-users@hc.apache.org
Betreff: Re: [HttpClient 4.5.5 ]Proxy-Authorization header missing while requesting HTTPS url

Does HttpClient not send the "Proxy-Authorization" header along with CONNECT request when we access the HTTPS url?

As I mentioned earlier,I tried same scenario to access the HTTP request everything works fine.

http://hc.apache.org/httpcomponents-client-4.5.x/examples.html

Thanks,
Kaushal.

On Mon, Jul 15, 2019 at 3:02 PM Kaushal Kothari <ka...@gmail.com>> wrote:
Just for clarification,I want to access the HTTPS url via proxy server and proxy server has the basic authentication set.

In order to authenticate,"Proxy-Authorization Basic <encoded auth>" header should be sent along with CONNECT request but which is missing.

you might have seen in last mail attached screenshot.If you are unable to see then let me know how can I send it to you again?

So I created the POST request using the HttpPost class which is from the HttpClient API. HttpClient doesn't generate the "Proxy-Authorization Basic <encode_auth>" header so added the same and pass it to HttpClient to extract it from the POST request.

 request = new HttpPost();   //please refer screenshot in last mail for details in request object
 request.addHeader("Proxy-Authorization","Basic "+encodedAuth);
 httpResponse = httpClientBuilder.execute(request);



On Fri, Jul 12, 2019 at 5:55 PM Kaushal Kothari <ka...@gmail.com>> wrote:
Hi Team,

I am trying to do POC using the HttpClient 4.5.5 library and want to access HTTPS url masked through a http proxy server with basic authentication
and its failing.

The authentication proxy header should be sent as part of the connect but it is not happening.

I have also added the header "Proxy-Authorization Basic <encodedAuth>" to POST request as it requires and passing request object to httpclient through execute() method.

Apart from that preemptive authentication is also set.


[image.png]

But over the network, "Proxy-Authorization Basic  <encodedAuth>" header is missing.

I tried same scenario to access the HTTP request everything works fine.

On the fly [No "Proxy-Authorization" header]:

[image.png]
REQUEST:

CONNECT localhost:4080 HTTP/1.1
Host: 127.0.0.1:9090<http://127.0.0.1:9090>
User-Agent: Apache-HttpClient/4.5.5 (Java/1.8.0_191)

RESPONSE:

"HTTP/1.1 407 Proxy Authentication Required
Server: Proxy
Proxy-Authenticate: Basic realm="**** Authorization"
Cache-control: no-cache
Connection: Close
Proxy-Connection: Close
Content-Length: 0"

Could you please help me on this issue? and let me know if you require any further information.

--
Thanks,
Kaushal.

Re: [HttpClient 4.5.5 ]Proxy-Authorization header missing while requesting HTTPS url

Posted by Kaushal Kothari <ka...@gmail.com>.
Hi,

I looking for to access *HTTPS* url via proxy server and proxy server has
the basic authentication.
I trying this and getting an error message as "HTTP/1.1 407 Proxy
Authentication Required".
Could you please help me on this? and provide any pointer to some example?

I have gone through the below sample but this is for accessing *HTTP *url.

http://hc.apache.org/httpcomponents-client-4.5.x/examples.html

In the mail thread it is also mentioned "It is missing because HttpClient
has not been correctly configured to respond the the authentication
challenge." so please let me know what configuration is missing?

Thanks,
Kaushal.

On Mon, Jul 15, 2019 at 5:07 PM Kaushal Kothari <
kaushalkothari2694@gmail.com> wrote:

> Does HttpClient not send the "Proxy-Authorization" header along with
> CONNECT request when we access the *HTTPS *url?
>
> As I mentioned earlier,I tried *same *scenario to access the *HTTP *request
> everything works fine.
>
> http://hc.apache.org/httpcomponents-client-4.5.x/examples.html
>
>
> Thanks,
> Kaushal.
>
> On Mon, Jul 15, 2019 at 3:02 PM Kaushal Kothari <
> kaushalkothari2694@gmail.com> wrote:
>
>> Just for clarification,I want to access the HTTPS url via proxy server
>> and proxy server has the basic authentication set.
>>
>> In order to authenticate,"Proxy-Authorization Basic <encoded auth>"
>> header should be sent along with CONNECT request but which is missing.
>>
>> you might have seen in last mail attached screenshot.If you are unable to
>> see then let me know how can I send it to you again?
>>
>> So I created the POST request using the HttpPost class which is from the
>> HttpClient API. HttpClient doesn't generate the "Proxy-Authorization Basic
>> <encode_auth>" header so added the same and pass it to HttpClient to
>> extract it from the POST request.
>>
>>  request = new HttpPost();   //please refer screenshot in last mail for
>> details in request object
>>  request.addHeader("Proxy-Authorization","Basic "+encodedAuth);
>>  httpResponse = httpClientBuilder.execute(request);
>>
>>
>>
>> On Fri, Jul 12, 2019 at 5:55 PM Kaushal Kothari <
>> kaushalkothari2694@gmail.com> wrote:
>>
>>> Hi Team,
>>>
>>> I am trying to do POC using the *HttpClient 4.5.5* library and want to
>>> access *HTTPS url* masked through a http *proxy server* with *basic
>>> authentication*
>>> and its failing.
>>>
>>> The authentication proxy header should be sent as part of the connect
>>> but it is not happening.
>>>
>>> I have also added the header "*Proxy-Authorization Basic <encodedAuth>*"
>>> to *POST request *as it requires and passing request object to
>>> httpclient through execute() method.
>>>
>>> Apart from that preemptive authentication is also set.
>>>
>>>
>>> [image: image.png]
>>>
>>> But *over the network,* "*Proxy-Authorization Basic  <encodedAuth>*"
>>> header is *missing*.
>>>
>>> I tried *same *scenario to access the HTTP request everything works
>>> fine.
>>>
>>> *On the fly* [No "Proxy-Authorization" header]:
>>>
>>> [image: image.png]
>>> REQUEST:
>>>
>>> CONNECT localhost:4080 HTTP/1.1
>>> Host: 127.0.0.1:9090
>>> User-Agent: Apache-HttpClient/4.5.5 (Java/1.8.0_191)
>>>
>>> RESPONSE:
>>>
>>> "HTTP/1.1 407 Proxy Authentication Required
>>> Server: Proxy
>>> Proxy-Authenticate: Basic realm="**** Authorization"
>>> Cache-control: no-cache
>>> Connection: Close
>>> Proxy-Connection: Close
>>> Content-Length: 0"
>>>
>>> Could you please help me on this issue? and let me know if you require
>>> any further information.
>>>
>>> --
>>> Thanks,
>>> Kaushal.
>>>
>>

Re: [HttpClient 4.5.5 ]Proxy-Authorization header missing while requesting HTTPS url

Posted by Kaushal Kothari <ka...@gmail.com>.
Does HttpClient not send the "Proxy-Authorization" header along with
CONNECT request when we access the *HTTPS *url?

As I mentioned earlier,I tried *same *scenario to access the *HTTP *request
everything works fine.

http://hc.apache.org/httpcomponents-client-4.5.x/examples.html


Thanks,
Kaushal.

On Mon, Jul 15, 2019 at 3:02 PM Kaushal Kothari <
kaushalkothari2694@gmail.com> wrote:

> Just for clarification,I want to access the HTTPS url via proxy server and
> proxy server has the basic authentication set.
>
> In order to authenticate,"Proxy-Authorization Basic <encoded auth>" header
> should be sent along with CONNECT request but which is missing.
>
> you might have seen in last mail attached screenshot.If you are unable to
> see then let me know how can I send it to you again?
>
> So I created the POST request using the HttpPost class which is from the
> HttpClient API. HttpClient doesn't generate the "Proxy-Authorization Basic
> <encode_auth>" header so added the same and pass it to HttpClient to
> extract it from the POST request.
>
>  request = new HttpPost();   //please refer screenshot in last mail for
> details in request object
>  request.addHeader("Proxy-Authorization","Basic "+encodedAuth);
>  httpResponse = httpClientBuilder.execute(request);
>
>
>
> On Fri, Jul 12, 2019 at 5:55 PM Kaushal Kothari <
> kaushalkothari2694@gmail.com> wrote:
>
>> Hi Team,
>>
>> I am trying to do POC using the *HttpClient 4.5.5* library and want to
>> access *HTTPS url* masked through a http *proxy server* with *basic
>> authentication*
>> and its failing.
>>
>> The authentication proxy header should be sent as part of the connect but
>> it is not happening.
>>
>> I have also added the header "*Proxy-Authorization Basic <encodedAuth>*"
>> to *POST request *as it requires and passing request object to
>> httpclient through execute() method.
>>
>> Apart from that preemptive authentication is also set.
>>
>>
>> [image: image.png]
>>
>> But *over the network,* "*Proxy-Authorization Basic  <encodedAuth>*"
>> header is *missing*.
>>
>> I tried *same *scenario to access the HTTP request everything works fine.
>>
>> *On the fly* [No "Proxy-Authorization" header]:
>>
>> [image: image.png]
>> REQUEST:
>>
>> CONNECT localhost:4080 HTTP/1.1
>> Host: 127.0.0.1:9090
>> User-Agent: Apache-HttpClient/4.5.5 (Java/1.8.0_191)
>>
>> RESPONSE:
>>
>> "HTTP/1.1 407 Proxy Authentication Required
>> Server: Proxy
>> Proxy-Authenticate: Basic realm="**** Authorization"
>> Cache-control: no-cache
>> Connection: Close
>> Proxy-Connection: Close
>> Content-Length: 0"
>>
>> Could you please help me on this issue? and let me know if you require
>> any further information.
>>
>> --
>> Thanks,
>> Kaushal.
>>
>

Re: [HttpClient 4.5.5 ]Proxy-Authorization header missing while requesting HTTPS url

Posted by Oleg Kalnichevski <ol...@apache.org>.
On Mon, 2019-07-15 at 15:02 +0530, Kaushal Kothari wrote:
> Just for clarification,I want to access the HTTPS url via proxy
> server and proxy server has the basic authentication set.
> 
> In order to authenticate,"Proxy-Authorization Basic <encoded auth>"
> header should be sent along with CONNECT request but which is
> missing.
> 

It is missing because HttpClient has not been correctly configured to
respond the the authentication challenge.

you might have seen in last mail attached screenshot.If you are
> unable to see then let me know how can I send it to you again? 
>  
> So I created the POST request using the HttpPost class which is from
> the HttpClient API. HttpClient doesn't generate the "Proxy-
> Authorization Basic <encode_auth>" header so added the same and pass
> it to HttpClient to extract it from the POST request.
> 

Why are you adding `Proxy-Authorization` to the POST request? This
makes no sense.

Please see HttpClient documentation, in particular, `Proxy
authentication` code example:

http://hc.apache.org/httpcomponents-client-4.5.x/examples.html

Oleg


>  request = new HttpPost();   //please refer screenshot in last mail
> for details in request object
>  request.addHeader("Proxy-Authorization","Basic "+encodedAuth);
>  httpResponse = httpClientBuilder.execute(request);
> 
> 
> 
> On Fri, Jul 12, 2019 at 5:55 PM Kaushal Kothari <
> kaushalkothari2694@gmail.com> wrote:
> > Hi Team,
> > 
> > I am trying to do POC using the HttpClient 4.5.5 library and want
> > to access HTTPS url masked through a http proxy server with basic
> > authentication
> > and its failing.
> > 
> > The authentication proxy header should be sent as part of the
> > connect but it is not happening.
> > 
> > I have also added the header "Proxy-Authorization Basic
> > <encodedAuth>" to POST request as it requires and passing request
> > object to httpclient through execute() method.
> > 
> > Apart from that preemptive authentication is also set.
> > 
> > 
> > 
> > 
> > But over the network, "Proxy-Authorization Basic  <encodedAuth>"
> > header is missing.
> > 
> > I tried same scenario to access the HTTP request everything works
> > fine.
> > 
> > On the fly [No "Proxy-Authorization" header]:
> > 
> > 
> > REQUEST:
> > 
> > CONNECT localhost:4080 HTTP/1.1
> > Host: 127.0.0.1:9090
> > User-Agent: Apache-HttpClient/4.5.5 (Java/1.8.0_191)
> > 
> > RESPONSE:
> > 
> > "HTTP/1.1 407 Proxy Authentication Required
> > Server: Proxy
> > Proxy-Authenticate: Basic realm="**** Authorization"
> > Cache-control: no-cache
> > Connection: Close
> > Proxy-Connection: Close
> > Content-Length: 0"
> > 
> > Could you please help me on this issue? and let me know if you
> > require any further information.
> > 
> > -- 
> > Thanks,
> > Kaushal.


---------------------------------------------------------------------
To unsubscribe, e-mail: httpclient-users-unsubscribe@hc.apache.org
For additional commands, e-mail: httpclient-users-help@hc.apache.org


Re: [HttpClient 4.5.5 ]Proxy-Authorization header missing while requesting HTTPS url

Posted by Kaushal Kothari <ka...@gmail.com>.
Just for clarification,I want to access the HTTPS url via proxy server and
proxy server has the basic authentication set.

In order to authenticate,"Proxy-Authorization Basic <encoded auth>" header
should be sent along with CONNECT request but which is missing.

you might have seen in last mail attached screenshot.If you are unable to
see then let me know how can I send it to you again?

So I created the POST request using the HttpPost class which is from the
HttpClient API. HttpClient doesn't generate the "Proxy-Authorization Basic
<encode_auth>" header so added the same and pass it to HttpClient to
extract it from the POST request.

 request = new HttpPost();   //please refer screenshot in last mail for
details in request object
 request.addHeader("Proxy-Authorization","Basic "+encodedAuth);
 httpResponse = httpClientBuilder.execute(request);



On Fri, Jul 12, 2019 at 5:55 PM Kaushal Kothari <
kaushalkothari2694@gmail.com> wrote:

> Hi Team,
>
> I am trying to do POC using the *HttpClient 4.5.5* library and want to
> access *HTTPS url* masked through a http *proxy server* with *basic
> authentication*
> and its failing.
>
> The authentication proxy header should be sent as part of the connect but
> it is not happening.
>
> I have also added the header "*Proxy-Authorization Basic <encodedAuth>*"
> to *POST request *as it requires and passing request object to httpclient
> through execute() method.
>
> Apart from that preemptive authentication is also set.
>
>
> [image: image.png]
>
> But *over the network,* "*Proxy-Authorization Basic  <encodedAuth>*"
> header is *missing*.
>
> I tried *same *scenario to access the HTTP request everything works fine.
>
> *On the fly* [No "Proxy-Authorization" header]:
>
> [image: image.png]
> REQUEST:
>
> CONNECT localhost:4080 HTTP/1.1
> Host: 127.0.0.1:9090
> User-Agent: Apache-HttpClient/4.5.5 (Java/1.8.0_191)
>
> RESPONSE:
>
> "HTTP/1.1 407 Proxy Authentication Required
> Server: Proxy
> Proxy-Authenticate: Basic realm="**** Authorization"
> Cache-control: no-cache
> Connection: Close
> Proxy-Connection: Close
> Content-Length: 0"
>
> Could you please help me on this issue? and let me know if you require any
> further information.
>
> --
> Thanks,
> Kaushal.
>

Re: [HttpClient 4.5.5 ]Proxy-Authorization header missing while requesting HTTPS url

Posted by Oleg Kalnichevski <ol...@apache.org>.
On Fri, 2019-07-12 at 17:55 +0530, Kaushal Kothari wrote:
> Hi Team,
> 
> I am trying to do POC using the HttpClient 4.5.5 library and want to
> access HTTPS url masked through a http proxy server with basic
> authentication
> and its failing.
> 
> The authentication proxy header should be sent as part of the connect
> but it is not happening.
> 
> I have also added the header "Proxy-Authorization Basic
> <encodedAuth>" to POST request as it requires and passing request
> object to httpclient through execute() method.
> 
> Apart from that preemptive authentication is also set.
> 
> 
> 
> 
> But over the network, "Proxy-Authorization Basic  <encodedAuth>"
> header is missing.
> 
> I tried same scenario to access the HTTP request everything works
> fine.
> 
> On the fly [No "Proxy-Authorization" header]:
> 
> 
> REQUEST:
> 
> CONNECT localhost:4080 HTTP/1.1
> Host: 127.0.0.1:9090
> User-Agent: Apache-HttpClient/4.5.5 (Java/1.8.0_191)
> 
> RESPONSE:
> 
> "HTTP/1.1 407 Proxy Authentication Required
> Server: Proxy
> Proxy-Authenticate: Basic realm="**** Authorization"
> Cache-control: no-cache
> Connection: Close
> Proxy-Connection: Close
> Content-Length: 0"
> 
> Could you please help me on this issue? and let me know if you
> require any further information.
> 
> -- 
> Thanks,
> Kaushal.


Hi Kaushal

I am not sure I understand what your expectations are. You are manually
adding the Proxy-Authorization header to the wrong request message
instead of using the standard authentication API and letting HttpClient
generate the header for you.

Oleg


---------------------------------------------------------------------
To unsubscribe, e-mail: httpclient-users-unsubscribe@hc.apache.org
For additional commands, e-mail: httpclient-users-help@hc.apache.org