Martijn Koster
Martijn Koster (born ca 1970) is a Dutch software engineer noted for his pioneering work on Internet searching.
Koster created Aliweb, the Internet's first Search Engine, which was announced in November 1993[1] while working at Nexor and presented in May 1994[2] at the First International Conference on the World Wide Web. Koster also developed Achiplex,[3] a search engine for FTP sites that pre-dates the Web, and CUSI,[4] a simple tool that allowed you to search different search engines in quick succession, useful in the early days of search when services provided varying results.
Koster, also created the Robots Exclusion Standard,[5][6] used to prevent cooperating web crawlers and other web robots from accessing all or part of a website which is otherwise publicly viewable.
References
- ↑ Martijn Koster (30 November 1993). "ANNOUNCEMENT: ALIWEB (Archie-Like Indexing for the WEB)". comp.infosystems (plaintext version). External link in
|work=
(help) - ↑ "List of PostScript files for the WWW94 advance proceedings". First International Conference on the World-Wide Web. June 1994.
Title: "Aliweb - Archie-Like Indexing in the Web." Author: Martijn Koster. Institute: NEXOR Ltd., UK. PostScript, Size: 213616, Printed: 10 pages
- ↑ "Archiplex". Retrieved 4 January 2013.
- ↑ "CUSI". Retrieved 4 January 2013.
- ↑ Martijn Koster. "Robots Exclusion". robotstxt.org.
- ↑ Martijn Koster. "Robots in the Web: threat or treat?". Reprinted with permission from ConneXions, The Interoperability Report, Volume 9, No. 4, April 1995.