dseax40600 2018-04-10 14:54
浏览 85

Laravel和Goutte刮刀[关闭]

Iam going to scraper 4 website using Laravel and Goutte .

number of url(s) are 900 and I don't have any idea, how to send url(s)

(I wrote crawler code and don't have any question about this)

but I don't know How to send url(s)? Must I use queue or cronJob or ... ?

Do you recognize any package or tool or idea ? I don't have any idea to send 900 urls, 5 times in a day

  • 写回答

1条回答 默认 最新

  • dongrong3171 2018-04-10 15:03
    关注

    If you wrote crawl code for websites, you can separate the links and store in CSV format file. You should write another script that enable to read with an exact numbers of these urls in CSV file and send you back. It's very easy in Ruby with open.csv library.

    评论

报告相同问题？

悬赏问题

  • ¥15 关于#matlab#的问题：在模糊控制器中选出线路信息，在simulink中根据线路信息生成速度时间目标曲线（初速度为20m/s，15秒后减为0的速度时间图像）我想问线路信息是什么
  • ¥15 banner广告展示设置多少时间不怎么会消耗用户价值
  • ¥16 mybatis的代理对象无法通过@Autowired装填
  • ¥15 可见光定位matlab仿真
  • ¥15 arduino 四自由度机械臂
  • ¥15 wordpress 产品图片 GIF 没法显示
  • ¥15 求三国群英传pl国战时间的修改方法
  • ¥15 matlab代码代写，需写出详细代码，代价私
  • ¥15 ROS系统搭建请教（跨境电商用途）
  • ¥15 AIC3204的示例代码有吗，想用AIC3204测量血氧，找不到相关的代码。