Autonomous Cooperating Web Crawlers

A web crawler provides an automated way to discover web events ? creation, deletion, or updates of web pages. Competition among web crawlers results in redundant crawling, wasted resources, and less-than-timely discovery of such events. This thesis presents a cooperative sharing crawler algorith...

Full description

Bibliographic Details
Main Author: McLearn, Greg
Format: Others
Language:en
Published: University of Waterloo 2006
Subjects:
WWW
Online Access:http://hdl.handle.net/10012/1080