广州市二手房价数据分析.docVIP

PAGE PAGE 33 广州市二手房价数据分析 内容摘要 随着随着新中国的繁荣昌盛，国民的生活水平大大提高，人民购房的需求愈来愈多，出现了很多带有房价数据的网站，这些数据可以为各个领域的发展提供良好的帮助。这种情况下，为了能让客户更好地选择适合他们心仪的房子，就要更好的对这些数据进行获取。因此，加强对房价网使用爬虫技术获取数据的研究具有重要意义，促进我国房价市场更好的发展。本选题的意义是设计并实现对广州市二手房价的数据分析，利用大数据爬虫房价网去分析每个地域的房价，为用户提供一个可以最直观了解到广州市房价的具体信息。采用python的scrapy爬虫框架对链家网数据进行爬取，并将爬取到的数据输出为csv格式文件，再使用tableau对数据进行分析与可视化。 关键词 scrapy框架 房价 数据可视化 Abstract With the prosperity of New China, the standard of living of the people has been greatly improved, the demand for housing is increasing, and the data in various fields are increasing, so that the current society can enter the era of big data, which can provide good help for the development of various fields. In this case, in order for people to better choose the right house for them, it is necessary to better access these data. Therefore, it is of great significance to strengthen the research on house price net using crawler technology to obtain data, and to promote the better development of house price market in China. The significance of this topic is to design and realize the data analysis of second-hand house prices in Guangzhou Using the big data crawler house price net to analyze the housing price trend of each region, to provide users with a most intuitive understanding of the housing prices in Guangzhou specific information. The python scrapy crawler frame is used to crawl the data of Lianjia net, and the crawling data is output into csv format file, and then the data is analyzed and visualized by tableau. Key words： scrapy Housing Data Visualization 目 录 TOC \o 1-2 \h \z \u 22886 第一章 绪论 1 17330 1.1 选题背景及意义 1 4235 1.2 国内外研究情况 1 16378 1.3 本文组织架构 2 1070 第二章 相关技术概述 3 17087 2.1 爬虫技术 3 7540 2.2 scrapy框架介绍 3 25163 2.3 常见抓取策略 9 3152 2.4 Robot协议 10 32338 2.5 Tableau简介 11 2826 2.7 xpath 11 25555 2.8 Cookie 12 10010 2.9 Selenium与WebDriver 12 21778 2.10 proxy代理 14 432 第三章 系统分析 15 15995 3.1可行性分析 15 19867 3.2功能需求分析 15 15995 3.3需求概述 15 19867 3.4数据获取 15 15995 3.5数