您当前的位置: 首页 >  scrapy

壹小俊

暂无认证

  • 2浏览

    0关注

    885博文

    0收益

  • 0浏览

    0点赞

    0打赏

    0留言

私信
关注
热门博文

scrapy爬取智联,只用于学习,不能商用

壹小俊 发布时间:2019-04-27 11:20:46 ,浏览量:2

# -*- coding: utf-8 -*-
import scrapy
import json
from ..items import ZhiLianItem
class SpiderZhelianSpider(scrapy.Spider):
    name = 'spider_zhelian'
    # allowed_domains = ['aaa']
    start = 0
    start_urls = ['https://fe-api.zhaopin.com/c/i/sou?start=0&pageSize=90&cityId=530&salary=0,0&workExperience=-1&education=-1&companyType=-1&employmentType=-1&jobWelfareTag=-1&kw=Python&kt=3&=0&_v=0.52954025&x-zp-page-request-id=127a7ae5ebaf4868ba0a60c03175ac5f-1556274802306-939362']
    def parse(self, response):
        data = json.loads(response.text)
        datas = data['data']['results']
        for data in datas:
            if data['positionURL']:
                request = scrapy.Request(url=data['positionURL'], callback=self.info_pares)
  
关注
打赏
1664335782
查看更多评论
立即登录/注册

微信扫码登录

0.0394s