Python3中urllib详细使用方法光环大数据Python培训.pdfVIP

光环大数据--大数据培训人工智能培训 Python3 中urllib 详细使用方法_光环大数据 Python 培训 python3 抓取网页资源的 N 种方法 1、最简单 import urllib.request response = urllib.request.urlopen(‘/’) html = response.read() 2、使用 Request import urllib.request req = urllib.request.Request(‘/’) response = urllib.request.urlopen(req) the_page = response.read() 3、发送数据 #! /usr/bin/env python3 import urllib.parse import urllib.request url = ‘http://localhost/login.php’ user_agent = ‘Mozilla/4.0 (compatible; MSIE 5.5; Windows NT)’ 光环大数据 光环大数据--大数据培训人工智能培训 values = { ‘act’ : ‘login’, ‘login[email]’ : ‘yzhang@’, ‘login[password]’ : ‘123456’ } data = urllib.parse.urlencode(values) req = urllib.request.Request(url, data) req.add_header(‘Referer’, ‘/’) response = urllib.request.urlopen(req) the_page = response.read() print(the_page.decode(“utf8”)) 4、发送数据和 header #! /usr/bin/env python3 import urllib.parse import urllib.request url = ‘http://localhost/login.php’ user_agent = ‘Mozilla/4.0 (compatible; MSIE 5.5; Windows NT)’ values = { ‘act’ : ‘login’, ‘login[email]’ : ‘yzhang@’, ‘login[password]’ : ‘123456’ } 光环大数据 光环大数据--大数据培训人工智能培训 headers = { ‘User-Agent’ : user_agent } data = urllib.parse.urlencode(values) req = urllib.request.Request(url, data, headers) response = urllib.request.urlopen(req) the_page = response.read() print(the_page.decode(“utf8”)) 5、http 错误 #! /usr/bin/env python3 import urllib.request req = urllib.request.Request(‘ ‘) try: urllib.request.urlopen(req) except urllib.error.HTTPError as e: print(e.code) print(e.read().decode(“utf8”)) 6、异常处理 1 #! /usr/bin/env p