arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Computer Science · Information Systems

A New Algorithm of Blog-Oriented Crawler

Weijiang Li, Ru Hua-suo, Hong Kun, Jia Luo

See on the map

Abstract

The general crawler provides a great many help to people for finding information in Web. However, it has some drawbacks in terms of precision and efficiency because of it's generality and no specialty. Blog, as an emerging phenomenon of the Internet, has been concerned by more and more people. We propose a new algorithm of blog-oriented web crawler through considering "Blog" as a special "topic". From the result of experiments, our blog-oriented blog crawler is superior to the generic crawler.

More like this