Question

如何用python获取百度这种通过200状态码跳转后的链接

Answer 1

爬虫跟踪下一页的方法是自己模拟点击下一页连接，然后发出新的请求。请看： item1 = Item()yield item1item2 = Item()yield item2req = Request(url='下一页的链接', callback=self.parse)yield req 注意使用yield时不要用return语句。

Answer 2

>>> url = r'http://m.baidu.com/from=1012585f/bd_page_type=1/ssid=15567761646568656174327407/uid=0/pu=usm%402%2Csz%401320_2001%2Cta%40iphone_1_3.0_3_528/baiduid=F8CF1C9B13A69F341A9A38C3718410D8/w=10_10_%E9%B1%BC%E8%82%9D%E6%B2%B9%E7%9A%84%E5%8A%9F%E6%95%88%E4%B8%8E%E4%BD%9C%E7%94%A8/t=iphone/l=1/tc?ref=www_iphone&lid=16538771669423618855&order=4&waplogo=1&fm=wnor&dict=-1&tj=www_zhidao_normal_4_10_10_title&sec=8644&di=312580a852c21860&bdenc=1&nsrc=IlPT2AEptyoA_yixCFOxXnANedT62v3IDBqMMS6LLDivpEmixP4kHREsRC0aNWiCGkb8gTCcshYFuX3b_71l8hRArKtosWka6SWhuKC'
>>> import requests
>>> res = requests.head(url)
>>> res.headers['Location']
'http://zhidao.baidu.com/question/390970477767010205.html'

Answer 3

　　然后发出新的请求。