Harvest is a system to collect information and make them searchable using a web interface. Harvest can collect information on inter- and intranet using http, ftp, nntp as well as local files like data on harddisk, CDROM and files on file servers. Current list of supported formats in addition to HTML include dvi, ps, fulltext, mail, man pages, news, troff, WordPerfect, C sources and many more. Adding support for new format is easy due to Harvest's modular design.
Similar scripts
webbase
(Popularity: ) : webbase is an internet web crawler written in C and later ported to C++. It uses a MySQL database to ... Larbin
(Popularity: ) : Larbin is a web crawler (also called (web) robot, spider, scooter, etc). It is intended to fetch a large number ...
Script Library
) : webbase is an internet web crawler written in C and later ported to C++. It uses a MySQL database to ...