【发布时间】：2016-03-29 09:43:29
【问题描述】：
我正在尝试使用 R 从 Yahoo Finance 网页上抓取新闻，以构建一个包含两列的表格：日期和新闻标题。 按照here 的指示，我正确地创建了一个带有新闻标题的专栏；下一步是获取日期并将其作为列添加到表中。
我想我只需要修改这个命令：
out_dt <- xpathSApply(d, "//ul[contains(@class,'newsheadlines')]/following::ul/li/a", xmlValue)
为了获取日期而不是标题，例如，以下代码：
<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"><title>BMPS.MI Headlines | BANCA MPS Stock - Yahoo! Finance</title><script type="text/javascript" src="http://l.yimg.com/a/i/us/fi/03rd/yg_csstare_nobgcolor.js"></script><link rel="stylesheet" href="http://l.yimg.com/zz/combo?kx/yucs/uh3/uh/1138/css/uh_non_mail-min.css&kx/yucs/uh3s/atomic/84/css/atomic-min.css&kx/yucs/uh_common/meta/3/css/meta-min.css&kx/yucs/uh3/top-bar/366/css/no_icons-min.css&kx/yucs/uh3/search/css/588/blue_border-min.css&kx/yucs/uh3/get-the-app/151/css/get_the_app-min.css&bm/lib/fi/common/p/d/static/css/2.0.356981/2.0.0/mini/yfi_yoda_legacy_lego_concat.css&bm/lib/fi/common/p/d/static/css/2.0.356981/2.0.0/mini/yfi_symbol_suggest.css&bm/lib/fi/common/p/d/static/css/2.0.356981/2.0.0/mini/yui_helper.css&bm/lib/fi/common/p/d/static/css/2.0.356981/2.0.0/mini/yfi_theme_teal.css&bm/lib/fi/common/p/d/static/css/2.0.356981/2.0.0/mini/yfi_follow_quote.css&bm/lib/fi/common/p/d/static/css/2.0.356981/2.0.0/mini/yfi_follow_stencil.css" type="text/css"><script language="javascript">
ll_js = new Array();
</script><script type="text/javascript" src="http://l1.yimg.com/bm/combo?fi/common/p/d/static/js/2.0.356981/2.0.0/mini/yui-min-3.9.1.js&fi/common/p/d/static/js/2.0.356981/yui_2.8.0/build/yuiloader-dom-event/2.0.0/mini/yuiloader-dom-event.js&fi/common/p/d/static/js/2.0.356981/yui_2.8.0/build/container/2.0.0/mini/container.js&fi/common/p/d/static/js/2.0.356981/yui_2.8.0/build/datasource/2.0.0/mini/datasource.js&fi/common/p/d/static/js/2.0.356981/yui_2.8.0/build/autocomplete/2.0.0/mini/autocomplete.js"></script><script language="javascript">
YUI.YUICfg = {"base":"http:\/\/l.yimg.com\/","comboBase":"http:\/\/l.yimg.com\/zz\/combo?","combine":true,"allowRollup":true,"maxURLLength":"2000"}
YUI.YUICfg.root = 'yui:'+YUI.version+'/build/';
YUI.applyConfig(YUI.YUICfg);
</script><script language="javascript">
ll_js.push({
'success_callback' : function() {
YUI().use('stencil', 'follow-quote', 'node', function (Y) {
var conf = {'xhrBase': '/', 'lang': 'en-US', 'region': 'US', 'loginUrl': 'https://login.yahoo.com/config/login_verify2?&.done=http://finance.yahoo.com/q?s=BMPS.MI&.intl=us'};
Y.Media.FollowQuote.init(conf, function () {
var exchNode = null,
followSecClass = "",
followHtml = "",
followNode = null;
followSecClass = Y.Media.FollowQuote.getFollowSectionClass();
followHtml = Y.Media.FollowQuote.getFollowBtnHTML({ ticker: 'BMPS.MI', addl_classes: "follow-quote-always-visible", showFollowText: true });
followNode = Y.Node.create(followHtml);
exchNode = Y.one(".wl_sign");
if (!Y.Lang.isNull(exchNode)) {
exchNode.append(followNode);
}
});
});
}
});
有什么建议吗？
【问题讨论】：
标签： html r web-scraping yahoo-finance