Web Scraper 是一款网页数据采集工具,只要是我们日常在网页上可以浏览到的内容,它都可以帮助我们爬取下来。
Web Scraper最大的特色是免费和免编程,不懂编程的人也很容易操作,尽管在爬取网页数据方面也有很多工具,但综合对比来看还是web scraper更加方便快捷一些。
Web Scraper主要有以下几个特点:
轻量级,只是浏览器插件,无需在电脑中安装
免费,并且没有按下载数据条数收费的要求
免编程,好上手,一天学会无压力
唯一缺点是免费版不能设置定时任务
webscraper下载
登录官方网站进行插件安装,插件有两种浏览器可供选择:火狐或者谷歌的Chrome。我选择的是火狐浏览器,如果选用Chrome浏览器,则需要科学上网。
(具体下载网址不方便粘贴,可以私信获取)
知乎关键字搜索信息爬取代码
{"_id":"zhihuchaxun","startUrl":["
https://www.zhihu.com/search?type=content&q=k30s至尊"],"selectors":[{"id":"question","type":"SelectorElementScroll","parentSelectors":["_root"],"selector":"div[] div.List-item","multiple":true,"delay":"3000"},{"id":"url","type":"SelectorLink","parentSelectors":["question"],"selector":"div [itemprop='zhihu:question'] a","multiple":true,"delay":0},{"id":"title","type":"SelectorText","parentSelectors":["url"],"selector":".QuestionHeader h1","multiple":false,"regex":"","delay":0},{"id":"view","type":"SelectorText","parentSelectors":["url"],"selector":"div.NumberBoard-item strong","multiple":false,"regex":"","delay":0},{"id":"follower","type":"SelectorText","parentSelectors":["url"],"selector":"button strong","multiple":false,"regex":"","delay":0},{"id":"answer","type":"SelectorText","parentSelectors":["url"],"selector":"div.Card:nth-of-type(1) a.QuestionMainAction","multiple":false,"regex":"","delay":0}]}
webscraper安装
下载好插件后,打开火狐浏览器,点击右上角的几个横杆按钮,然后点击附加组件
声明:本文为原创文章,版权归终究美好所有,欢迎分享本文,转载请保留出处!
你可能也喜欢
- ♥ 为什么曹操的后代都短命?12/12
- ♥ 身份证丢了怎么办01/11
- ♥ 频繁访问某人抖音他知道吗12/06
- ♥ 口腔溃疡怎么办最快最有效的方法01/11
- ♥ 算命真的准吗12/27
- ♥ dr钻戒真的只能买一次吗12/27