Python Library for Google Search

You're viewing a comment by Bob and its responses.

Bob Permalink
October 19, 2010, 21:13

Chris,
Get a web crawling program, and just crawl that domain. Skip Google.

I do this all the time, using a free program called WinHTTrack (on Windows; also available on other platforms). See http://www.httrack.com/

Aim HTTrack at the top page of the site, and start the crawling. It does a great job grabbing anything that is linked.

Reply to this comment

Reply To This Comment

(why do I need your e-mail?)

(Your twitter name, if you have one. (I'm @pkrumins, btw.))

Comment Help

Type first 3 letters of your name: (just to make sure you're a human)

Please preview the comment before submitting to make sure it's OK.