Revisting an old post on using Ruby to write a simple web crawler, offering another perspective, borrowing ideas from existing libraries, and featuring Ruby’s Enumerator https://rossta.net/blog/how-to-write-a-simple-web-crawler-in-ruby-revisited.html