You are viewing a plain text version of this content. The canonical link for it is here.
Posted to httpclient-users@hc.apache.org by Brian Preston <br...@gmail.com> on 2008/09/04 17:41:35 UTC

need help getting form logon to work

I've gotten this working for about a dozen other sites, each of which has
required different combinations of forms parameters, CookiePolicy,
http.useragent, SINGLE_COOKIE_HEADER param, etc.  But I can't get logged on
to this one site, betus.com, and I would appreciate any help.  It's a sports
betting site.  There's nothing helpful in the response, it just sends back a
message saying 'Oops, there was a problem!'

I've pasted the headers below.  I first request the main page, and then do
the logon.  It looks like it's sending the cookies back on the 2nd request,
which is the post request to logon.  I started out with NOT using
SINGLE_COOKIE_HEADER, and without setting the user-agent, and was unable to
login.  So I tried adding only the user-agent change and still couldn't
login.  Then I added using SINGLE_COOKIE_HEADER, and still couldn't login.
Then I changed the cookiepolicy to BROWSER_COMPATIBILITY and still couldn't
login.  Here's my code to do that:

HttpClient client = new HttpClient();
client.getParams().getDefaults().setBooleanParameter(HttpMethodParams.SINGLE_COOKIE_HEADER,
true);
client.getParams().setParameter("http.useragent","MSIE 6.0");
client.getParams().setCookiePolicy(CookiePolicy.BROWSER_COMPATIBILITY);

I'm wondering if it has something to do with the site being ASP with weird
names for form parameters, and/or doing strange scripting stuff upon login.
When you use the form normally with the browser, there are only 2 field,
user/pwd.  But when I looked at the source, I found additional hidden
fields.  I also used the Firefox plugin TamperData and found more parameters
submitted, so below are the form parameters I'm sending.  I'm assuming the
'ioBB' and '__VIEWSTATE' are generated by asp/js, there are some javascripts
running in there:

NameValuePair[] data = {
    new NameValuePair("ioBB",
"0400T5VlFQJK7yvT7W%2Bbd9sPihDroPvjdLsxiJi8N7%2BKcYyA4zArQ%2FX3oMg99a0%2F7JlCHwDySkLc%2BAlTuALUyXzsKHTiGIBwv90GYtBUbpa7l0HHV%2BElLuXLpP%2F8GjcxXckf%2B6ULwbk0J37r8C7t8cqE5LUVckgKFFSIIt3hzoZd1cFkQcdQkl%2B5FDvMc8mWcnHrIRhJ6zw1DH71TaXMCw4w68VgId5Nh161gmRQrOXfo9bBbgXP9ZLthop1Dzbf6O5qA49e4dxH87DHLdvg6PDAVzAZ8pTxAdsDc06PTAjyDsgpQs%2FEGzmZL%2FDfsWGfh16jbcIO97AXC5zKiZ5GmJmHn7kBR%2FUTEbY3tU0zoT4xTqBP4ehBV15lxPlT9xIMct8fSe0zAMBEe5V5wzug8QBi%2B7I%2BvS3zO1UWqCYU5ipXbctjjZSkBTBViHxgPVj4eN%2FNDw0jf8W5P%2BMt0lJN70M3cti2MYXORD1E%2FfvzsfJoqU7ye3JDlbmr6Jb%2BEZAm5RntIiY5jq6gDW7jG6w%2B6o9CdnWzwvfGKSNu5%2F9Q0NqYnHtWYDOKbGZpj3T689Ewtsp0MDVfLjPLMbYzZQFkKP9mzCcRH4oqo6FPaY4Z59dO67BKC4J%2FNxkDBAXqHTPJ6OS9X8DPxsbfUXSd0EErURKHK0A4lYCnPtlz5v64jSNNhOQHK30Pm%2BeD%2BCES8B%2FVzSGrW4wvGqJJgKGxkHlqGem1Chn5tXACboDNC5XOwRUnGjkUeVOIV7MRoe2Y8DQlUu8qlU99UoH2xkngng1QCbL2dH3PZ0k8ff0YSFNG6hNJYpiG3uq24ExpTAtUQs9g8DqR3xozkCknN5E%3D%3B0400mjGTMCii6Pnz6D%2BYNUMLEb%2B14pKBzvUflN%2BY36Vs2XppUHwKCk5KCt1fboaACyonqA44V2gtR3QgR1wIjQHqiQ%3D%3D%3B0400mjGTMCii6Pnz6D%2BYNUMLEb%2B14pKBzvUflN%2BY36Vs2XpeJVpJWSdJZEoHITiUUMiQJ4crq2IrQ5k%3D"),
    new NameValuePair("m$loginNonAjax1$lvCustLoginView$tbAccountNo",
"myuserid",
    new NameValuePair("m$loginNonAjax1$lvCustLoginView$tbPassword1",
"Password"),
    new NameValuePair("m$loginNonAjax1$lvCustLoginView$btnLogin", "Login"),
    new NameValuePair("m$loginNonAjax1$lvCustLoginView$tbPassword", "mypwd",
    new NameValuePair("__VIEWSTATE",
"%2FwEPDwUJODk5ODEwMTUyDxQrAAJkZxYCZg9kFgRmD2QWAgIFDxYEHgRUZXh0BQRmbGFnHgdWaXNpYmxlaGQCARBkZBYEAgcPZBYCZg9kFgJmD2QWAgIBD2QWBmYPD2QWBh4Hb25mb2N1cwUjQ2xlYXJEZWZhdWx0VGV4dCh0aGlzLCAnQWNjb3VudCMnKTseBm9uYmx1cgUiSW5pdERlZmF1bHRUZXh0KHRoaXMsICdBY2NvdW50IycpOx4FdmFsdWUFCEFjY291bnQjZAIBDw9kFgYfAwVtSW5pdFBhc3N3b3JkVGV4dCgnbV9sb2dpbk5vbkFqYXgxX2x2Q3VzdExvZ2luVmlld190YlBhc3N3b3JkMScsICdtX2xvZ2luTm9uQWpheDFfbHZDdXN0TG9naW5WaWV3X3RiUGFzc3dvcmQnKR8EZR4Kb25rZXlwcmVzcwU%2FRW50ZXJQcmVzc2VkKCdtX2xvZ2luTm9uQWpheDFfbHZDdXN0TG9naW5WaWV3X2J0bkxvZ2luJywgZXZlbnQpZAICDxYCHwIFbkNsZWFyUGFzc3dvcmRUZXh0KCdtX2xvZ2luTm9uQWpheDFfbHZDdXN0TG9naW5WaWV3X3RiUGFzc3dvcmQxJywgJ21fbG9naW5Ob25BamF4MV9sdkN1c3RMb2dpblZpZXdfdGJQYXNzd29yZCcpZAIID2QWBAIBD2QWDAIBDw8WDB4ISW1hZ2VVcmwFaGh0dHA6Ly9pbWFnZXMuYmV0dXMuY29tL2ltYWdlcy9uZXdzaXRlMTAyNC9pbWFnZXMvYmFubmVycy93ZWxjb21lL2FueXRpbWUtd2VsY29tZS1oZWFkZXItYWxsLXJld2FyZHMuZ2lmHgdUb29sVGlwBWlSZWZlciBhIEZyaWVuZCB0byBCZXRVUyBTcG9ydHNib29rIGFuZCBiZSByZXdhcmRlZCEgQmV0VVMuY29tIHRha2VzIGNhcmUgb2YgaXRzIHNwb3J0cyBiZXR0aW5nIGN1c3RvbWVycyEfAAVpUmVmZXIgYSBGcmllbmQgdG8gQmV0VVMgU3BvcnRzYm9vayBhbmQgYmUgcmV3YXJkZWQhIEJldFVTLmNvbSB0YWtlcyBjYXJlIG9mIGl0cyBzcG9ydHMgYmV0dGluZyBjdXN0b21lcnMhHgtOYXZpZ2F0ZVVybAUWL2JlbmVmaXRzL3Jld2FyZHMuYXNweB4IQ3NzQ2xhc3MFBGIyLTEeBF8hU0ICAmRkAgMPFgIfAWdkAgUPDxYMHwYFbWh0dHA6Ly9pbWFnZXMuYmV0dXMuY29tL2ltYWdlcy9uZXdzaXRlMTAyNC9pbWFnZXMvYmFubmVycy93ZWxjb21lL2FueXRpbWUtd2VsY29tZS1oZWFkZXItYWxsLXJlZmVyYWZyaWVuZC5naWYfBwWDAUJldFVTLmNvbSB0YWtlcyBjYXJlIG9mIHNwb3J0cyBiZXR0aW5nIGZhbnMgd2l0aCB0aGUgbW9zdCBnZW5lcm91cyByZXdhcmRzIGluIHRoZSBzcG9ydHNib29rIGluZHVzdHJ5LiBKb2luIEJldFVTIFNwb3J0c2Jvb2sgdG9kYXkuHwAFgwFCZXRVUy5jb20gdGFrZXMgY2FyZSBvZiBzcG9ydHMgYmV0dGluZyBmYW5zIHdpdGggdGhlIG1vc3QgZ2VuZXJvdXMgcmV3YXJkcyBpbiB0aGUgc3BvcnRzYm9vayBpbmR1c3RyeS4gSm9pbiBCZXRVUyBTcG9ydHNib29rIHRvZGF5Lh8IBRYvYmVuZWZpdHMvYm9udXNlcy5hc3B4HwkFBGIyLTIfCgICZGQCBw8WAh8BZ2QCCQ8PFgIfAWhkZAILDxYCHwFoZAIFD2QWDAIBDw8WDB8GBWBodHRwOi8vaW1hZ2VzLmJldHVzLmNvbS9pbWFnZXMvbmV3c2l0ZTEwMjQvaW1hZ2VzL2Jhbm5lcnMvd2VsY29tZS8yMDA4MDgwOS13ZWxjb21lLTQtYWxsLW1sYi5naWYfBwU6TUxCIEJhc2ViYWxsIGJldHRpbmcgaXMgaW4gZnVsbCBzd2luZyBhdCBCZXRVUyBTcG9ydHNib29rIR8ABTpNTEIgQmFzZWJhbGwgYmV0dGluZyBpcyBpbiBmdWxsIHN3aW5nIGF0IEJldFVTIFNwb3J0c2Jvb2shHwgFIy9zcG9ydHNib29rL21sYi1iYXNlYmFsbC1saW5lcy5hc3B4HwkFBGIzLTEfCgICZGQCAw8WAh8BZ2QCBQ8PFgwfBgVpaHR0cDovL2ltYWdlcy5iZXR1cy5jb20vaW1hZ2VzL25ld3NpdGUxMDI0L2ltYWdlcy9iYW5uZXJzL3dlbGNvbWUvMjAwODA4Mjktd2VsY29tZS00LWFsbC1uY2FhZm9vdGJhbGwuZ2lmHwcFKk5DQUEgRm9vdGJhbGwgQmV0dGluZyBhdCBCZXRVUyBTcG9ydHNib29rIR8ABSpOQ0FBIEZvb3RiYWxsIEJldHRpbmcgYXQgQmV0VVMgU3BvcnRzYm9vayEfCAUnL3Nwb3J0c2Jvb2svY29sbGVnZS1mb290YmFsbC1saW5lcy5hc3B4HwkFBGIzLTIfCgICZGQCBw8WAh8BZ2QCCQ8PFgwfBgVnaHR0cDovL2ltYWdlcy5iZXR1cy5jb20vaW1hZ2VzL25ld3NpdGUxMDI0L2ltYWdlcy9iYW5uZXJzL3dlbGNvbWUvMjAwODA4Mjktd2VsY29tZS01LWFsbC1uZmxmdXR1cmVzLmdpZh8HBShORkwgRnV0dXJlcyBCZXR0aW5nIGF0IEJldFVTIFNwb3J0c2Jvb2shHwAFKE5GTCBGdXR1cmVzIEJldHRpbmcgYXQgQmV0VVMgU3BvcnRzYm9vayEfCAUhL3Nwb3J0c2Jvb2svZm9vdGJhbGwtZnV0dXJlcy5hc3B4HwkFBGIzLTMfCgICZGQCCw8WAh8BZ2Rk")
};

Here are the headers:

httpclient.wire.header  >> "GET / HTTP/1.1[\r][\n]"
httpclient.wire.header  >> "User-Agent: MSIE 6.0[\r][\n]"
httpclient.wire.header  >> "Host: www.betus.com[\r][\n]"
httpclient.wire.header  >> "[\r][\n]"
httpclient.wire.header  << "HTTP/1.1 200 OK[\r][\n]"
httpclient.wire.header  << "HTTP/1.1 200 OK[\r][\n]"
httpclient.wire.header  << "Date: Thu, 04 Sep 2008 00:29:04 GMT[\r][\n]"
httpclient.wire.header  << "Server: Microsoft-IIS/6.0[\r][\n]"
httpclient.wire.header  << "X-Powered-By: ASP.NET[\r][\n]"
httpclient.wire.header  << "X-AspNet-Version: 2.0.50727[\r][\n]"
httpclient.wire.header  << "Set-Cookie: AtsMonitoring=Enabled; expires=Thu,
04-Sep-2008 00:29:13 GMT; path=/[\r][\n]"
httpclient.wire.header  << "Set-Cookie:
Ats=ExpDate=9/18/2008&VisitID=174335299&AdvertiserID=0&CompanySiteID=2&MediaID=0;
expires=Thu, 18-Sep-2008 04:00:00 GMT; path=/[\r][\n]"
httpclient.wire.header  << "Set-Cookie:
Ats4Session=ExpDate=9/18/2008&VisitID=174335299&AdvertiserID=0&CompanySiteID=2&MediaID=0;
expires=Thu, 04-Sep-2008 00:34:03 GMT; path=/[\r][\n]"
httpclient.wire.header  << "Set-Cookie:
ASP.NET_SessionId=u2iyjt553cwfxo45jk0zco22; path=/; HttpOnly[\r][\n]"
httpclient.wire.header  << "Cache-Control: no-cache[\r][\n]"
httpclient.wire.header  << "Pragma: no-cache[\r][\n]"
httpclient.wire.header  << "Expires: -1[\r][\n]"
httpclient.wire.header  << "Content-Type: text/html; charset=utf-8[\r][\n]"
httpclient.wire.header  << "Content-Length: 18657[\r][\n]"
httpclient.wire.header  << "Set-Cookie:
BIGipServerCERES_Pool=3549825546.20480.0000; path=/[\r][\n]"
httpclient.wire.header  << "[\r][\n]"

httpclient.wire.header  >> "POST /default.aspx HTTP/1.1[\r][\n]"
httpclient.wire.header  >> "User-Agent: MSIE 6.0[\r][\n]"
httpclient.wire.header  >> "Host: www.betus.com[\r][\n]"
httpclient.wire.header  >> "Cookie: AtsMonitoring=Enabled;
Ats=ExpDate=9/18/2008&VisitID=174335299&AdvertiserID=0&CompanySiteID=2&MediaID=0;
Ats4Session=ExpDate=9/18/2008&VisitID=174335299&AdvertiserID=0&CompanySiteID=2&MediaID=0;
ASP.NET_SessionId=u2iyjt553cwfxo45jk0zco22;
BIGipServerCERES_Pool=3549825546.20480.0000[\r][\n]"
httpclient.wire.header  >> "Content-Length: 4417[\r][\n]"
httpclient.wire.header  >> "Content-Type:
application/x-www-form-urlencoded[\r][\n]"
httpclient.wire.header  >> "[\r][\n]"
httpclient.wire.header  << "HTTP/1.1 200 OK[\r][\n]"
httpclient.wire.header  << "HTTP/1.1 200 OK[\r][\n]"
httpclient.wire.header  << "Date: Thu, 04 Sep 2008 00:29:05 GMT[\r][\n]"
httpclient.wire.header  << "Server: Microsoft-IIS/6.0[\r][\n]"
httpclient.wire.header  << "X-Powered-By: ASP.NET[\r][\n]"
httpclient.wire.header  << "X-AspNet-Version: 2.0.50727[\r][\n]"
httpclient.wire.header  << "Cache-Control: private[\r][\n]"
httpclient.wire.header  << "Content-Type: text/html; charset=utf-8[\r][\n]"
httpclient.wire.header  << "Content-Length: 14046[\r][\n]"
httpclient.wire.header  << "[\r][\n]"