a short walk in the blogistan：在blogistan走短.pdfVIP

Computer Networks 50 (2006) 615–630 /locate/comnet A short walk in the Blogistan Edith Cohen *, Balachander Krishnamurthy ATT Labs-Research, 180 Park Avenue, Rm A105, Forham Park, NJ 07932, USA Received 20 December 2004; received in revised form 13 May 2005; accepted 25 May 2005 Available online 21 July 2005 Responsible Editor: R. Boutaba Abstract The increasingly prominent new subset of Web pages, called blogs differs from traditional Web pages both in char- acteristics and potential to applications. We explore three aspects of the blogistan: its overall scope and size, identifica- tion of emerging hot topics of discussion and link patterns, and implications both to blogs and applications such as search. Beyond blogs, we develop a general methodology of mining evolving networks and connections. The first part of our study is longitudinal—based on a five-week continuous fetch of a seed collection of nearly 10,000 blog URLs. The second part is based on a successive crawl of pages suspected to be blogs leading to a larger collection of several million URLs. The collection is examined for a variety of properties. We characterize blogs and study different facets of the link structure in blogs and its evolution over time, attributes of servers and domains that host many of the blogs including their IP addresses, and how blogs behave with respect to various HTTP/1.1 protocol issues. Inferences from our in-depth exploration are relevant to applications ranging from mining to hosting of blogs and other issues of relevance to the measurement community. 2005 Elsevier B.V. All rights reserved. Keywords: Weblog; Blog; Hyperlinks; Measur