Ruby:如何写一个 "DRY"/动态/灵活的树状循环结构

Question

我正在寻找在 Ruby 中完成以下结构/逻辑问题的最佳方法:

一个网站需要完全爬取，收集每个页面的标题。

但是:

• 不知道网站的树状结构(有多少“层级”、“分支”等)
• 代码应该是“DRY”(=“不要重复自己”)

以下(简化的)示例当然是完全愚蠢的:

url = some_root_url
@title_collection = Array.new

go_to_page(url)
@title_collection << find_all_titles_on_page
urls = find_all_urls_on_page

urls.each do |url|
    go_to_page(url)
    @title_collection << find_all_titles_on_page
    urls = find_all_urls_on_page

    urls.each do |url|
        go_to_page(url)
        @title_collection << find_all_titles_on_page
        urls = find_all_urls_on_page

        urls.each do |url|
            go_to_page(url)
            @title_collection << find_all_titles_on_page
            urls = find_all_urls_on_page

            urls.each do |url|
                go_to_page(url)
                @title_collection << find_all_titles_on_page
                urls = find_all_urls_on_page

                urls.each do |url|
                    go_to_page(url)
                    @title_collection << find_all_titles_on_page
                    urls = find_all_urls_on_page

                    [...]
                end
            end
        end
    end
end

那么您将如何以“DRY”方式灵活高效地实现这一目标？

非常感谢!

汤姆

Answer 1

递归是你的 friend :

def walk_tree(url)
  go_to_page(url)
  title_collection << find_all_titles_on_page
  urls = find_all_urls_on_page

  urls.each do |child_url|
    title_collection << walk_tree(child_url)
  end

  title_collection
end