Newspaper： 新闻文章元数据抽取的开源Python库.PDFVIP

Newspaper: 新闻文章元数据抽取的开源Python库 Spark大数据博客 - Newspaper: 新闻文章元数据抽取的开源Python库 来自于requests的灵感，因为它很简单；并且由lxml驱动，因为它速度很快。 Newspaper是一个惊人的新闻、全文以及文章元数据抽取开源的Python类库，这个类库支持 10多种语言，所有的东西都是用unicode编码的。我们可以使用下面命令查看： /** * User: 过往记忆 * Date: 2015-05-20 * Time: 下午23:14 * bolg: * 本文地址：/archives/1363 * 过往记忆博客，专注于hadoop、hive、spark、shark、flume的技术博客，大量的干货 * 过往记忆博客微信公共帐号：iteblog_hadoop */ import newspaper newspaper.languages() Your available langauges are: input code full name ar Arabic ru Russian nl Dutch de German en English es Spanish fr French it Italian ko Korean no Norwegian pt Portuguese sv Swedish hu Hungarian fi Finnish da Danish zh Chinese id Indonesian vi Vietnamese 1 / 4 Newspaper: 新闻文章元数据抽取的开源Python库 Spark大数据博客 - 来看看这个如何使用： import newspaper cnn_paper = newspaper.build() for article in cnn_paper.articles: print(article.url) u/2013/11/27/justice/tucson-arizona-captive-girls/ u/2013/12/11/us/texas-teen-dwi-wreck/index.html ... for category in cnn_paper.category_urls(): print(category) u u/world u ... article = cnn_paper.articles[0] article.download() article.html u!DOCTYPE HTMLhtml itemscope itemtype=http://... article.parse() article.authors [uLeigh Ann Caldwell, John Honway] article.text uWashington (CNN) -- Not everyone subscribes to a New Years resolution... article.top_image uhttp://someCDN.com/blah/blah/blah/file.png article.movies [u/path/to/, ...] article.nlp() article.keywords [New Years, resolution, ...] article.summary uThe study shows that 93% of people ...