AutoMapIt Site Map Creation

[ianccc]

I changed some settings in Tweaked pages and have a couple of questions

a) sometimes I see the following listed twice
http://www.domain.com
http://www.domain.com
do I set the priority to 1.0 "Always" and check the BlockURL for the second listing?

b) on my FORUM there are links like:
http://www.domain.com/forum/index.php?action=profile%3Barea%3Dshowposts%3Bu%3D1 I call the CODED-URL
when I want the FRIENDLY-URL to be the one
http://www.domain.com/forum/plant-hardiness-zones/creation-of-a-gardening-journal-page/
so can I check the BLOCK-URL for the CODED-URL and raise the PRIORITY for the FRIENDLY-URL

c) I setup lots of DIRECTORIES that I did not want listed, so I assume the results are only from the APPROVED DIR

d) is there a better wat to set the FILTER so my FRIENDLY-URLs showup

a) sometimes I see the following listed
http://www.domain.com
http://www.domain.com/index.php can this one be BLOCKED

any info appreciated

~ian

[MaxPowers]

Hello,

You can filter broad sections of your site or narrowly block certain pages. You can use robots.txt, robots meta, AutoMapIt filters, AutoMapIt Tweak page.

Putting these together in different ways was the topic of my most recent newsletter!

The robots.txt and robots meta methods affect all search engines (including AutoMapIt) that visit your site while the AutoMapIt filters will only affect how my system handles your site.

You can block what look like duplicate URLs on the Tweak Page. These URLs will still exist on your site, but most sites have a few versions of URL that link to their same index page... http://www.example.com, http://www.example.com/, http://www.example.com/index.html, http://www.example.com/# are all usually the same page on a website. The Tweak page allows you to choose a 'keeper' and to block each of the other versions of that page from showing up in your sitemaps.

You can get rid of your dynamic, coded URLs in AutoMapIt by setting a filter on the Sitemap Setup page to 'Exclude Key' and enter 'action' on it's own line without quotes. This will ignore any URL it finds on your website where it says ?action=......

Your directories can either be blocked in your robots.txt file (blocking ALL crawlers that support robots.txt) or setup as an 'Exclude Directory' on the Sitemap Setup page in your account here. This will depend on whether you hope to block all crawlers or just AutoMapIt to keep them off your sitemaps.

-Shawn