java - Why can't Apache HttpClient 4.2 retrieve this page? -

-

i'm trying retrieve page using apache httpclient: http://quick-dish.tablespoon.com/

unfortunately, when try this, returns following (as returned jsoup, it's returning http... string itself):

<html>  <head></head>  <body>   http/1.1 200 ok [server: nginx/1.0.11, content-type: text/html;charset=utf-8, last-modified: mon, 02 jul 2012 15:30:40 gmt, vary: accept-encoding, cookie,accept-encoding, x-powered-by: php/5.3.6, x-pingback: http://quick-dish.tablespoon.com/xmlrpc.php, x-powered-by: asp.net, content-encoding: gzip, x-blz: lb1.blaze.io, date: mon, 02 jul 2012 16:06:21 gmt, content-length: 11723, connection: keep-alive]  </body> </html>

here code (note i'm emulating google bot i've found web servers tend better behaved way):

url sourceurl = new url("http://quick-dish.tablespoon.com/"); httpclient httpclient =  new contentencodinghttpclient(); httpclient.getparams().setbooleanparameter("http.protocol.handle-redirects", true);  final httpget httpget = new httpget(sourceurl.touri()); httpget.setheader("user-agent", "mozilla/5.0 (compatible; googlebot/2.1; +http://www.google.com/bot.html)"); httpget.setheader("accept", "text/html"); httpget.setheader("accept-charset", "utf-8");  final httpresponse response = httpclient.execute(httpget); return jsoup.parse(response.tostring());

needless say, page returns fine in web browser. ideas?

instead of tostring need response entity 

// hold of response entity  httpentity entity = response.getentity();

then can contents of that


Comments

Post a Comment

Popular posts from this blog

c# - SVN Error : "svnadmin: E205000: Too many arguments" -

-
i trying reposotries using c# code process svncommand = null; var psi = new processstartinfo("svnadmin"); psi.redirectstandardoutput = true; psi.redirectstandarderror = true; psi.useshellexecute = false; psi.arguments= @"dump c:\repositories\myrepo > c:\temp\myrepodumpfile.dump"; using (svncommand = process.start(psi)) { var myoutput = svncommand.standardoutput; var myerror = svncommand.standarderror; debug.write("output :" + environment.newline + environment.newline + myoutput.readtoend() + environment.newline + "error :" + environment.newline + environment.newline + myerror.readtoend()); svncommand.close(); } when use dump command commandline svnadmin dump c:\repositories\myrepo > c:\temp\myrepodumpfile.dump it works fine when try ...
Read more

c# - Copy ObservableCollection to another ObservableCollection -

-
how copy observablecollection item observablecollection without reference of first collection? here observablecollection item value changes affecting both collections. code private observablecollection<ratemodel> _allmetalrate = new observablecollection<ratemodel>(); private observablecollection<ratemodel> _metalrateondate = new observablecollection<ratemodel>(); public observablecollection<ratemodel> allmetalrate { { return this._allmetalrate; } set { this._allmetalrate = value; notifypropertychanged("metalrate"); } } public observablecollection<ratemodel> metalrateondate { { return this._metalrateondate; } set { this._metalrateondate = value; notifypropertychanged("metalrateondate"); } } foreach (var item in metalrateondate) allmetalrate.add(item); what causing , how can solve it? you need clone object referenced item before it's a...
Read more

All overlapping substrings matching a java regex -

-
is there api method returns (possibly overlapping) substrings match regular expression? for example, have text string: string t = 04/31 412-555-1235; , , have pattern: pattern p = new pattern("\\d\\d+"); matches strings of 2 or more characters. the matches are: 04, 31, 412, 555, 1235. how overlapping matches? i want code return: 04, 31, 41, 412, 12, 55, 555, 55, 12, 123, 1235, 23, 235, 35. theoretically should possible -- there obvious o(n^2) algorithm enumerates , checks substrings against pattern. edit rather enumerating substrings, safer use region(int start, int end) method in matcher . checking pattern against separate, extracted substring might change result of match (e.g. if there non-capturing group or word boundary check @ start/end of pattern). edit 2 actually, it's unclear whether region() expect zero-width matches. specification vague, , experiments yield disappointing results. for example: string line = "xx90xx"; strin...
Read more