Polybot: A High-Performance Web Crawler
Polybot is a high-performance distributed web crawler developed in the
Department of Computer and Information
Science at Polytechnic University
as part of an academic research project that explores new
techniques for searching and analyzing the World Wide Web.
Note: we are not in any way connected to the search site www.polybot.com,
which came recently (January 2002) to our attention.
We also have nothing to do with the virus of the same name!
- If you came to this page because you were visited by our crawler,
please click here for more details about
the crawler's behavior and for contact information.
- If you are interested in information about the architecture of the
crawler and about our research project, please