Search results

想问一下，怎么知道爬虫结束没有？

enhancement

minor

Status: Open.

#545 In code4craft/webmagic;

· zhangmianhongni opened on Apr 23, 2017

超链接相对路径导致的重定向页面获取到错误的link

bug

minor

Status: Open.

#479 In code4craft/webmagic;

· hoyoung2015 opened on Mar 7, 2017

代理池加入域名类型的代理时，无法正确取出代理信息的BUG

bug

minor

toTest

Status: Open.

#465 In code4craft/webmagic;

· setamv opened on Feb 15, 2017

怎么将xpath选择的内容，删除掉不需要的节点？

enhancement

minor

Status: Open.

#464 In code4craft/webmagic;

· savagery opened on Feb 12, 2017

hit exception when using fuzzy match

enhancement

minor

xpath

Status: Open.

#337 In code4craft/webmagic;

· emperorxiaomai opened on Jun 17, 2016

设置 setUseGzip 为 false 仍发送 Accept-Encoding: gzip

bug

minor

toTest

Status: Open.

#302 In code4craft/webmagic;

· suclogger opened on Apr 28, 2016

TargetUrl中的sourceRegion问题

bug

minor

toTest

Status: Open.

#299 In code4craft/webmagic;

· wjk1982 opened on Apr 22, 2016

获取<a href="javascript:xxx"为空问题

bug

minor

toTest

Status: Open.

#213 In code4craft/webmagic;

· swbssd opened on Jun 1, 2015

xpath 无法获取开头有空格的 class

bug

minor

toTest

Status: Open.

#185 In code4craft/webmagic;

· seveniu opened on Jan 8, 2015

 ·  

WebMagic-0.9.0

是否是FileCacheQueueScheduler的BUG

bug

minor

toTest

Status: Open.

#156 In code4craft/webmagic;

· zhugw opened on Sep 11, 2014

页面 head 中 设置base 导致 页面内链接解析错误

bug

minor

toTest

Status: Open.

#142 In code4craft/webmagic;

· seveniu opened on Jul 9, 2014

关于setSleepTime的疑问

enhancement

minor

Status: Open.

#136 In code4craft/webmagic;

· stonesun opened on Jun 22, 2014