Python大数据编程.pptxVIP

Python大数据编程2 大数据处理过程 4数据分析1数据收集3数据描述2数据整理Python大数据编程便捷数据获取4用Python获取数据本地数据如何获取?文件的打开，读写和关闭? 文件打开? 读文件写文件? 文件关闭5用Python获取数据网络数据如何获取?抓取网页，解析网页内容urllibPython 3中被urllib.request代替urllib2Python 3中被http.client代替httplib?httplib2/q/cp?s=%5eDJI+Componen/q/cp?s=%5EDJI+Componen tyahoo财经数据利用urllib库获取yahoo财经数据File# Filename: dji.py import urllib import redBytes = urllib.request.urlopen(/q/cp?s=%5eDJI+Components).read()ht/q/cp?s=%5eDJI+Components).read()tp:///q/cp?s=%5EDJI+Components/q/cp?s=%5eDJI+Components).read()).read() dStr = dBytes.decode(GBK) #在python3中urllib.read()返回bytes对象而非str，语句功能是将dBytes转换成Strm = re.findall(trtd class=yfnc_tabledata1ba href=.*?(.*?)/a/b/tdtdclass=yfnc_tabledata1(.*?)/td.*?b(.*?)/b.*?/tr, dStr)if m:print m print \n print len(m)else:print not match数据形式? 包含多个字符串（dji）AXP, American Express Company, 86.40BA, The Boeing Company, 122.24CAT, Caterpillar Inc., 99.44CSCO, Cisco Systems, Inc., 23.78CVX, Chevron Corporation, 115.91– …便捷网络数据是否能够简单方便并且快速的方式获得雅虎财经上各上市公 司股票的历史数据？File# Filename: quotes.pyfrom matplotlib.finance import quotes_historical_yahoo from datetime import dateimport pandas as pdtoday = date.today()start = (today.year-1, today.month, today.day)quotes = quotes_historical_yahoo_ochl(AXP, start, today) df = pd.DataFrame(quotes)print df函数目前更新为 quotes_historical_ yahoo_ochl便捷网络数据quotes的内容日期开盘价收盘价最高价最低价成交量便捷网络数据自然语言工具包NLTK需要先执行nltk.download()下载某一个或多个包，若下Source载失败，可以在官网（/nltk_data//nltk_data/） ?古腾堡语料库? 布朗语料库? 路透社语料库? 网络和聊天文本? …单独下载后放到本地python目录的nltk_data\corpora下 from nltk.corpus import gutenberg import nltkbrown print gutenberg.fileids()[uausten-emma.txt, uausten-persuasion.txt, uausten-sense.txt, ubible-kjv.txt, ublake-poems.txt, ubryant-stories.txt, uburgess-busterbrown.txt, ucarroll- alice.txt, uchesterton-ball.txt, uchesterton-brown.txt, uchesterton-thursday.txt, uedgeworth-parents.txt, umelville-moby_dick.txt, umilton-paradise.txt, ushakespeare-caesar.txt, ushakespeare-hamlet.txt, ushakespeare-macbeth.txt, uwhitman-leaves.txt] tex