Editor: SiteCrawler is a website downloading application that lets you Capture entire sites or selected portions, like image galleries. It features powerful settings that no other application offers.
Simplicity
Screenshot You don't have to be an expert to use SiteCrawler. While the advanced features are easily accessible, they don't bog down the basic settings, so you can stay focused on the task at hand. To start crawling a site, enter a web address and choose a destination folder on your disk. Further options help you fine-tune the behavior, such as which parts of the site to access.
Take a break
While SiteCrawler crawls a site, you can pause it to change the settings. When you resume, the new settings are picked Up immediately. So if you see files being downloaded that you don't really want, there's no need to stop the session.
You can save Sessions for later, even in the midst of downloading. You can then re-open the session later, and pick up right where you left off!
Multilinguality
Multiple Languages
SiteCrawler is currently available in English and Swedish. More languages will be supported in the future. *
URL Patterns
Normally, you choose a single web address to start from. But using URL patterns, you can choose several. To start from a numeric range, put the range inside a pair of square brackets. If you instead have a list of a few options, put those inside a pair of Curly brackets. You can combine these pattern types to Create even more advanced URLs. SiteCrawler 1.1 has even more powerful URL patterns that lets you use square brackets inside curly ones! An address using URL patterns might look like this:
Rewrite that
By default, SiteCrawler changes references in downloaded HTML pages to point locally. This means you can browse downloaded sites without problems with broken links and links that point to the originating web site.
