How To Write A Simple Web Crawler In Ruby - takes you through what you need to know to write a simple web crawler in Ruby from scratch (all code is included). It also mentions some of the ways the web crawler can be made more useful and robust.