python - 如何使用 scrapy python 通过 xmlfeed 循环节点

Question

您好，我第一次使用 scrapy 并尝试 xml feed，下面是我的代码

class TestxmlItemSpider(XMLFeedSpider):
    name = "TestxmlItem"
    allowed_domains = {"http://www.nasinteractive.com"}


    start_urls = [
        "http://www.nasinteractive.com/jobexport/advance/hcantexasexport.xml"
    ]
    iterator = 'iternodes'
    itertag = 'job'


    def parse_node(self, response, node):
        title = node.select('title/text()').extract()
        job_code = node.select('job-code/text()').extract()
        detail_url = node.select('detail-url/text()').extract()
        category = node.select('job-category/text()').extract()

        print title,";;;;;;;;;;;;;;;;;;;;;"
        print job_code,";;;;;;;;;;;;;;;;;;;;;"

        item = TestxmlItem()
        item['title'] = node.select('title/text()').extract()
        .......  
        return item

结果:

  File "/usr/lib/python2.7/site-packages/Scrapy-0.14.3-py2.7.egg/scrapy/item.py", line 56, in __setitem__
    (self.__class__.__name__, key))
exceptions.KeyError: 'TestxmlItem does not support field: title'

总共有 200 多个项目，所以我需要循环并将节点文本分配给项目但在这里，当我们打印时，所有结果都会立即显示，实际上我们如何在使用 xmlfeedspider

抓取 xml 文件时在节点上循环

Answer 1

来自巴勃罗·霍夫曼:

You don't have a "title" field declared in your item (TestxmlItem).

您需要添加:

title = Field()