Java web crawler 1.0
Java based web crawler
All that you need to do is enter the initial webpage, maximum number of websites and domains and let this tiny app take care of the rest.
Java Web Crawler is developed using the Java programming language and can be run on Mac OS X, Windows and Linux.
- HTTP crawler
- Domain validation