World_wide_web_wanderer

Also referred to as just the Wanderer, this was a perl based web crawler that was first deployed in June, 1993 to measure the size of the World Wide Web. The Wanderer was developed at MIT by Matthew Gray. Later in 1993, it was used to generate an index called the "Wandex", providing the first search engine on the web. Matthew Gray now works for Google.

External links

• Growth of the Web Report -- http://www.mit.edu/~mkgray/net/
• Early mention of www-talk]] -- http://web.archive.org/web/20030512083018/http://ksi.cpsc.ucalgary.ca/archives/WWW-TALK/www-talk-1993q2.messages/706.html

This article is licensed under the GNU Free Documentation License. It uses material from Wikipedia