Scrapy+python基于Spark的国漫推荐系统毕业论文.docx

摘 要 近年来，随着互联网的蓬勃发展，企事业单位对信息的管理提出了更高的要求。以传统的管理方式已无法满足现代人们的需求。为了迎合时代需求，优化管理效率，各种各样的管理系统应运而生，随着各行业的不断发展，基于Spark的国漫推荐系统的建设也逐渐进入了信息化的进程。 这个系统的设计主要包括系统页面的设计和方便用户互动的后端数据库，在开发后需要良好的数据处理能力、友好的界面和易用的功能。 数据要被工作人员通过界面操作传输至数据库中。通过研究，以Mysql数据库和Python技术，以Idea为开发平台，采用Django架构，建立一个提供个人中心、漫画数据管理、系统管理等必要功能的、稳定的国漫推荐系统。 关键词：国漫；Django框架；Mysql数据库 目录 Abstract In recent years, with the vigorous development of the Internet, enterprises and public institutions have put forward higher requirements for information management. Traditional management can no longer meet the needs of modern people. In order to meet the needs of The Times and optimize management efficiency, a variety of management systems emerge at the historic moment. With the continuous development of various industries, the construction of Spark based national film recommendation system has gradually entered the process of informatization. The design of this system mainly includes the design of the system page and the backend database which is convenient for users to interact. After the development, it needs good data processing ability, friendly interface and easy-to-use functions. The data should be transferred to the database by the staff through the interface operation. Through research, using Mysql database and Python technology, Idea as the development platform, using Django architecture, to establish a stable national cartoon recommendation system that provides the necessary functions of personal center, comic data management, system management and so on. Key words: National cartoon; Django framework; Mysql database  目 录 TOC \o 1-3 \h \z \u 1 绪 论 1 1.1开发背景 1 1.2国内外研究现状和发展趋势综述 1 1.3开发设计的意义及研究方向 1 2 系统开发技术 3 2.1 Python可视化技术 3 2.2 Django框架 3 2.3 Hadoop介绍 3 2.4 Scrapy介绍 4 2.5 IDEA介绍 4 2.6 B/S架构 4 2.7 MySQL数据库介绍 5 3系统分析 7 3.1整体分析 7 3.2功能需求分析 7 3.3 系统可行性分析 7 3.3.1技术可行性 7 3.3.2经济可行性 8 3.3.3操作可行性 8 3.4系统流程分析 8 3.4.1操作流程 8 3.4.2添加信息流程 9 3.4.3删除信息流程 10 4