<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>AutoMapIt Sitemap Creation Service &#187; Spidering service</title>
	<atom:link href="http://www.automapit.com/news/category/spidering-service/feed" rel="self" type="application/rss+xml" />
	<link>http://www.automapit.com/news</link>
	<description>Keep your website healthy</description>
	<lastBuildDate>Fri, 18 Nov 2011 15:55:43 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.2.1</generator>
		<item>
		<title>Crawl around the world in 1.4 days?</title>
		<link>http://www.automapit.com/news/crawl-around-the-world-in-14-days-33.html</link>
		<comments>http://www.automapit.com/news/crawl-around-the-world-in-14-days-33.html#comments</comments>
		<pubDate>Sat, 28 Mar 2009 21:30:13 +0000</pubDate>
		<dc:creator></dc:creator>
				<category><![CDATA[Spidering service]]></category>

		<guid isPermaLink="false">http://www.automapit.com/news/?p=33</guid>
		<description><![CDATA[Your sitemaps will now be delivered in record time with new web crawlers from AutoMapIt. The web crawlers are responsible for gathering information on your website and then turning it into critical information that you need to know about your website. You\&#8217;ve researched your keywords, you\&#8217;ve managed to obtain some backlinks, maybe you already have [...]]]></description>
			<content:encoded><![CDATA[<p>Your sitemaps will now be delivered in record time with new web crawlers from AutoMapIt. The web crawlers are responsible for gathering information on your website and then turning it into critical information that you need to know about your website. You\&#8217;ve researched your keywords, you\&#8217;ve managed to obtain some backlinks, maybe you already have a sitemap&#8230; what could be holding you back from getting the rank you deserve?</p>
<p>The <a href=\"https://www.automapit.com/signuppro.html\">highly specialized system of web crawlers</a> at AutoMapIt are designed to take your SEO efforts to the next level! Find out exactly what is holding you back from getting the traffic you expected to see when you first started out with your website. Remove the obstacles built into your website since day 1 and try out the blazing fast crawlers at AutoMapIt.</p>
<p>By way of comparison, if Jules Verne had improved the speed of  <a title=\"Phileas Fogg\" href=\"http://en.wikipedia.org/wiki/Phileas_Fogg\">Phileas Fogg</a>\&#8217;s trip around the world by the same amount&#8230; he would have made the trip in only 1.4 days instead of 80!</p>
]]></content:encoded>
			<wfw:commentRss>http://www.automapit.com/news/crawl-around-the-world-in-14-days-33.html/feed</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Politically correct &#8211; a custom spider creation</title>
		<link>http://www.automapit.com/news/politically-correct-a-custom-spider-creation-7.html</link>
		<comments>http://www.automapit.com/news/politically-correct-a-custom-spider-creation-7.html#comments</comments>
		<pubDate>Tue, 10 Jan 2006 23:41:43 +0000</pubDate>
		<dc:creator></dc:creator>
				<category><![CDATA[Spidering service]]></category>

		<guid isPermaLink="false">http://www.automapit.com/news/?p=7</guid>
		<description><![CDATA[A recent request for modification of the AutoMapIt Spider engine came as a referral from my good friend BJ at KWDesign. She was creating a Custom WordPress Theme for PoliticalVine.com by Bill Simon and didn\&#8217;t want to just \&#8217;throw away\&#8217; the content on that domain by hosting it on another. The problem was that PoliticalVine [...]]]></description>
			<content:encoded><![CDATA[<p>A recent request for modification of the AutoMapIt Spider engine came as a referral from my good friend BJ at KWDesign. She was creating a <a href=\"http://kickasswebdesign.com/\">Custom WordPress Theme</a> for <a href=\"http://www.politicalvine.com/\">PoliticalVine.com by Bill Simon</a> and didn\&#8217;t want to just \&#8217;throw away\&#8217; the content on that domain by hosting it on another. The problem was that PoliticalVine was hosted on a windows machine in ASP and Bill Simon wanted to upgrade to a Linux server using PHP. With over 1500 pages being transferred, this was not a manual kind of project.</p>
<p>With a healthy dose of ingenuity and a can-do attitude, I modified the AutoMapIt spider to store the HTML generated by his ASP blog. One of the first hurdles I realized from this was to keep his dynamic pages linking together without breaking the links and without using the query string (after the ? in the URL) anymore. </p>
<p>Regular expressions to the rescue! Using the PERL compatible regular expression (PCRE) available in PHP, I was able to change his links and filenames on the fly as they were created. All of the links within his pages followed the same rules of renaming so in the end, everything matched up and the links in his pages matched the correct filename. </p>
<p>Converting his dynamic ASP to HTML, which is static, allowed him to move the website between servers and technologies without hindering it\&#8217;s performance in any way. Once the spider was converted, his site was spidered and converted in one move within an hour or so. Once the spidering was complete, I was able to zip the files that were created and send it to him. All that he did was unzip and upload and his new pages were in place, functioning as they should. </p>
<p>Tags: <a href=\"http://technorati.com/tag/ASP+to+HTML\" rel=\"tag\">ASP to HTML</a> <a href=\"http://technorati.com/tag/website+conversion\" rel=\"tag\">website conversion</a> was made possible by a custom <a href=\"http://technorati.com/tag/web+spider\" rel=\"tag\">web spider</a> from AutoMapIt. Contact <a href=\"http://www.automapit.com/support.html\">AutoMapIt Support</a> to get your quote for custom spidering today!</p>
]]></content:encoded>
			<wfw:commentRss>http://www.automapit.com/news/politically-correct-a-custom-spider-creation-7.html/feed</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
	</channel>
</rss>

