AutoMapIt Crawlers saves you bandwidth checking your Last-Modified headers by using If-Modified-Since
Wednesday, September 19th, 2007AutoMapIt now uses If-Modified-Since headers with the crawlers. What this means for you is that pages that haven’t been updated since the last time this system crawled your website won’t need to be loaded again. This saves bandwidth and means faster crawls of your website.
Google has used these headers when requesting your pages for years [...]
