Python Library for Google Search

You're viewing a comment by Peteris Krumins and its responses.

March 12, 2009, 18:44

Jorge, it does. got to be careful. put a sleep between calls if you are doing a lot of scraping.

Daniel, me too. I have had this idea for a while as well. :)

Steve, can you tell me the query you used? Google sometimes displays 2 results from the same site (2nd usually indented to the right), that's an ok behavior. One way to escape that is to keep a list or dict of seen urls, then check if you have seen the url already.

Reply to this comment

Reply To This Comment

(why do I need your e-mail?)

(Your twitter name, if you have one. (I'm @pkrumins, btw.))

Comment Help

Type first 3 letters of your name: (just to make sure you're a human)

Please preview the comment before submitting to make sure it's OK.