Peteris Krumins comment on Python Library for Google Search

Privacy Controls Software from ParetoLogic

Any fool can use a computer. Many do.

Ted Nelson

I am doing a startup!

Cross-browser testing from your browser

I have written my third book!

Perl one-liners explained

You're viewing a comment by Peteris Krumins and its responses.

Peteris Krumins pkrumins Permalink

October 07, 2009, 18:51

Stray, here is the code that I just tried:

>>> from xgoogle.search import GoogleSearch
>>> import time
>>>
>>> gs = GoogleSearch("inurl:polito")
>>> gs.results_per_page = 100
>>> res = []
>>> while True:
...  tmp = gs.get_results()
...  if not tmp:
...   break
...  res.extend(tmp)               
...  time.sleep(5)
...
>>> print len(res)
618

Seems to work for me.

The thing is that Google can show that it has 10 billion results but in reality it will return only 1000 for any search. And if it thinks there are some duplicates in those 1000, then it will return even less. In this case it returned 618 results.

Reply to this comment