基于音乐网的过式网络爬虫的研究思考.docVIP

本科毕业论文 基于音乐网站的过滤式网络爬虫的研究 BACHELORS DEGREE THESIS OF WUHAN UNIVERSITY Research of the web crawler based on music website By June 2015 郑重声明 本人呈交的学位论文，是在导师的指导下，独立进行研究工作所取得的成果，所有数据、图片资料真实可靠。尽我所知，除文中已经注明引用的内容外，本学位论文的研究成果不包含他人享有著作权的内容。对本论文所涉及的研究工作做出贡献的其他个人和集体，均已在文中以明确的方式标明。本学位论文的知识产权归属于培养单位。 本人签名： 日期： 2015.5.15 摘要 随着社会的进步与电脑的普及，网络逐渐取代了传统的信息平台，成为人们迅速获得和发布资讯的重要工具。在这一背景下，在线数字音乐服务因为其方便、快捷的特点受到大众的普遍欢迎。目前虽然数字音乐服务提供商众多，却同质化现象严重，跟不上部分用户的需求。互联网上的歌曲难以计数，然而用户想要找到自己喜欢的歌曲往往要花费大量的精力去搜索歌曲和浏览各种歌单。本文力求通过开发一个音乐网站，通过数据爬取与算法分析，使得人们找到自己喜欢的歌曲不再困难。该音乐网站采用B/S结构进行开发。使用python + tornado + mysql +redis搭建该网站系统。在软件工程相关规范的约束下，结合实际情况对系统进行开发。 本文首先介绍了目前市面上的音乐电台存在的问题，并且介绍开发环境及开发者运用到的关键技术。之后对网站系统的一些关键技术进行研究和实现。 关键词：音乐电台；网络电台；B/S结构 ABSTRACT As our society develops, computer is becoming more and more important in our daily life , and Internet becomes an important medium for people to get the information quickly. In this context , because online digital music service is convenient and fast, it is welcomed by the general public. Although there are many digital music service providers, but they failed to meet the demand of some of the users. The songs on the Internet are difficult to count, however, that the user needs to spend a lot of energy to search for songs and browse all kinds of playlist in order to find songs they enjoy. This article seeks to develop a music website, so that users can easily find their favorite songs. The music website uses B/S structure to develop. Use python+tornado+mysql+redis to build the website system. The whole system development process followed the software engineering related specification and the actual situation. This paper first introduces the existing problems of the music websites, and then introduces the development environment and the key technology which the author uses. Then we studyand realize some keytechnologies of the website system. Key